-- Logs begin at Tue 2022-05-10 13:11:48 UTC, end at Tue 2022-05-10 14:19:03 UTC. -- May 10 13:45:16.166954 dv-cinder-840678-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 10 13:45:16.174435 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 10 13:45:16.180000 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 13:45:16 2022] *** May 10 13:45:16.180000 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 13:45:16.180000 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 13:45:16.180000 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: nodename: dv-cinder-840678-6-iscsi May 10 13:45:16.180000 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: machine: x86_64 May 10 13:45:16.180000 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: clock source: unix May 10 13:45:16.180000 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: pcre jit disabled May 10 13:45:16.180000 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: detected number of CPU cores: 4 May 10 13:45:16.180000 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: current working directory: / May 10 13:45:16.180000 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: detected binary path: /usr/bin/uwsgi-core May 10 13:45:16.180000 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: your processes number limit is 47680 May 10 13:45:16.180000 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: your memory page size is 4096 bytes May 10 13:45:16.180000 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: detected max file descriptor number: 2048 May 10 13:45:16.180000 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: lock engine: pthread robust mutexes May 10 13:45:16.180000 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: thunder lock: enabled May 10 13:45:16.180000 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 10 13:45:16.180000 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 13:45:16.222930 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: Python main interpreter initialized at 0x556186b499c0 May 10 13:45:16.222930 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: python threads support enabled May 10 13:45:16.222930 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: your server socket listen backlog is limited to 100 connections May 10 13:45:16.222930 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: your mercy for graceful operations on workers is 90 seconds May 10 13:45:16.223288 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: mapped 403077 bytes (393 KB) for 2 cores May 10 13:45:16.223363 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: *** Operational MODE: preforking *** May 10 13:45:16.223618 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: *** uWSGI is running in multiple interpreter mode *** May 10 13:45:16.223618 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: spawned uWSGI master process (pid: 79916) May 10 13:45:16.223824 dv-cinder-840678-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 10 13:45:16.224393 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: spawned uWSGI worker 1 (pid: 79924, cores: 1) May 10 13:45:16.224736 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: spawned uWSGI worker 2 (pid: 79925, cores: 1) May 10 13:45:16.224889 dv-cinder-840678-6-iscsi devstack@keystone.service[79916]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 13:45:21.943711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:45:21.943711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: from cryptography.utils import int_from_bytes May 10 13:45:21.946691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:45:21.946691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: from cryptography.utils import int_from_bytes May 10 13:45:21.947388 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:45:21.947388 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: from cryptography.utils import int_from_bytes May 10 13:45:21.948589 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:45:21.948589 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: from cryptography.utils import int_from_bytes May 10 13:45:21.994834 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 13:45:21.995008 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 13:45:21.995192 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] command line args: [] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 13:45:21.995456 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 13:45:21.995632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ================================================================================ {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 13:45:21.995882 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] admin_token = **** {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:21.996124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] config_dir = [] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:21.996335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:21.996515 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] config_source = [] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:21.996691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] debug = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:21.996883 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:21.999245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:21.999245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:21.999245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:21.999245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:21.999245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] list_limit = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:21.999245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] log_config_append = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.000404 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 13:45:22.000606 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.000780 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 13:45:22.000978 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] log_dir = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.001174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] command line args: [] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 13:45:22.001398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] log_file = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.001579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 13:45:22.001776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.001968 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ================================================================================ {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 13:45:22.002157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.002347 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] admin_token = **** {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.002544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.002739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] config_dir = [] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.002930 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.003130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.003321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.003551 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] config_source = [] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.003720 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.003925 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] debug = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.004086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.004271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.004473 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.004607 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.004733 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.004889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.005020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.005146 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.005283 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.005415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.005587 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.005734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] list_limit = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.005734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] log_config_append = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.005974 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.006108 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.006246 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.006372 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] log_dir = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.006372 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] log_file = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.006614 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.006742 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.006742 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.007027 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.007027 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] publish_errors = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.007285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.007436 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.007578 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.007710 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.007841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.007974 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.008106 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.008285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.008421 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.008549 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.008674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.008806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] standard_threads = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.008943 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.009086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.009216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.009368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.009495 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.009691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.009826 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.009953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] use_journal = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.009953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] use_json = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.010197 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.010396 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] use_stderr = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.010534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.010667 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] use_syslog = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.010793 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.010921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.010921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.011182 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.011324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.011458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] publish_errors = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.011590 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.011722 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.011856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.011982 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.012108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.012288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.012426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.012552 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.012686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.012828 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.012955 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.013086 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] standard_threads = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.013212 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.013337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.013470 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.013596 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.013596 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.013833 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.013958 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] use_journal = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.014083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.014219 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] use_json = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.014219 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] use_stderr = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.014458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.014596 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] use_syslog = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.014721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.014919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:45:22.015048 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.015179 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.015305 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.015432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.015558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.015695 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.015828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.015960 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.016085 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.016238 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.016382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.016522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.016649 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.016781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.016907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.017032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.017164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.017304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.017436 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.017563 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.017696 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.017829 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.017829 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.018085 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.018220 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.018356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.018488 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.018622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.018748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.018887 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.019018 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.019018 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.019263 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.019389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.019515 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.019653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.019780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.020014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.020213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.020348 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.020476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.020613 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.020741 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.020872 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.020999 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.021124 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.021257 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.021455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.021585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.021718 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.021852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.021994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.022127 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.022266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.022393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.022525 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.022651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.022651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.022889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.023024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.023156 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.023283 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.023414 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.023546 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.023690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.023825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.023951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.024076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.024236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.024370 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.024504 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.024631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.024757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.025381 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.025514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.025641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.025776 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.025904 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.027088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.027256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.027452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.027644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.027871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.028074 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.028248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.028439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.028628 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.028817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.029047 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.029211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.029463 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.029672 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.029871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.030038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.030266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.030430 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.030620 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.030816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.031041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.031522 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.031719 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.031884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.032076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.032324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.032504 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.032637 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.032813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.032954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.033083 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.033252 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.033381 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.033508 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.033640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.033776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.033937 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.034075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.034202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.034330 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.034468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.034605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.034738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.034866 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.034992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.034992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.035278 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.035411 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.035546 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.035674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.035801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.035927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.036060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.036212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.036362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.036491 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.036619 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.036745 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.036871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.037004 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.037140 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.037274 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.037405 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.037534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.037660 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.037787 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.038054 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.038200 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.038334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.038463 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.038591 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.038729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.038858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.038984 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.039112 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.039239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.039367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.039502 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.039631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.039758 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.039886 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.040021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.040149 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.040333 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.040464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.040623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.041264 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.041391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.041519 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.041519 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.041777 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.041917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.042045 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.042172 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.042310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.042438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.042564 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.042703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.042831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.042958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.043085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.043218 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.043344 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.043479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] auth.external = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.043607 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.043734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.043860 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.043986 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.044130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.044296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.044427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.044554 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] auth.password = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.044680 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.044808 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] auth.token = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.044941 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.045077 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.045205 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.045332 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.045458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.045584 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.045710 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.045871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.046017 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.046154 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.046289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.046417 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.046553 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.046753 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.046898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.047040 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] credential.caching = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.047169 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] auth.external = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.047303 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.047442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.047572 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.047700 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.047848 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.047977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.048105 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.048291 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] auth.password = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.048421 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.048560 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] auth.token = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.048689 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.048825 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.048955 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.049083 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.049210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.049345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.049475 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.049603 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.049740 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.049868 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.050003 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.050141 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.050270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.050397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.050397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] credential.caching = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.050678 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.050806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.050942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.051072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.051200 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.051200 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] federation.caching = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.051472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.051602 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.051737 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.051737 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.051980 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.052109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.052259 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.052259 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.052513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.052643 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.052771 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.052904 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.053032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.053161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.053310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.053440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.053573 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.053702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.053838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.053975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.054180 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.054313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.054441 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.054569 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] identity.caching = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.054696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.054824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.054961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] federation.caching = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.055104 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.055235 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.055363 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.055491 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.055618 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.055755 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.055885 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.056012 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.056140 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.056320 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.056450 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.056590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.056720 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.056848 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.056990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.057119 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.057247 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.057408 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.057602 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.057795 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.057952 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.058083 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.058211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.058347 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] identity.caching = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.058477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.058605 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.058733 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.058871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.059000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.059137 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.059265 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.059393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.059521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.059649 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.059785 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.059913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.060040 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.060184 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.060330 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.060460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.060601 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.060601 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.060854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.060982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.061109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.061236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.061372 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.061501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.061629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.061756 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.061883 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.062011 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.062146 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.062281 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.062419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.062547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.062682 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.062810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.062945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.063075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.063202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.063335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.063463 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.063591 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.063727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.063862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.063990 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.064118 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.064277 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.064407 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.064546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.064676 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.064803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.065027 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.065189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.065321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.065459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.065588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.065716 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.065845 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.065972 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.066099 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.066246 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.066376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.066503 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.066631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.066759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.066888 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.067024 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.067153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.067287 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.067420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.067548 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.067676 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.067812 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.067951 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.068079 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.068224 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.068374 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.068503 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.068639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.068768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.068897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.069025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.069152 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.069280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.069415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.069544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.069680 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.069819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.069948 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.070075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.070216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.070345 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.070472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.070599 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.070726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.070854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.070990 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.071119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.071246 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.071373 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.071510 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.071638 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.071797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.071933 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.072063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.072229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.072364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.072493 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.072629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.072759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.072886 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.073014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.073142 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.073278 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.073415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.073544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.073713 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.073846 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.073974 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.074111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.074240 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.074368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.074495 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.074623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.074750 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.074887 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.075016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.075143 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.075282 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.075410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.075537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.075673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.075802 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.075929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.076057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.076267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.076403 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.076544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.076672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.076800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.076934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.077072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.077200 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.077346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.077477 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.077605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.077732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.077859 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.077986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.078122 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] resource.caching = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.078250 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.078379 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.078505 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.078633 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.078760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.078905 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.079034 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.079161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.079288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.079416 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.079542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.079745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.079876 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.080004 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.080131 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.080282 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.080412 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.080555 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.080685 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.080827 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] role.caching = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.080955 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.081083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] role.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.081210 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.081346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.081476 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.081604 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.081732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.081859 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.081988 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] resource.caching = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.082132 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.082262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.082390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.082535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.082667 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.082796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.082932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.083061 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.083189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.083316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.083530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.083693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.083834 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.083963 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.084091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.084238 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.084372 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.084511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.084652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.084781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] role.caching = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.084916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.085085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] role.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.085214 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.085341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.085485 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.085621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.085756 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.085890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.086025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.086167 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.086313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.086451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.086586 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.086721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.086855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.087003 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.087140 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.087280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.087962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.088096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.088276 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.088421 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.088551 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.088690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.088820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.088948 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.089083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.089220 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.089349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.089477 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.089605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.089605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.089853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.089990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.090119 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.090246 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.090373 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.090511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.090639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.090775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] token.caching = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.090904 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.091033 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.091160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.091289 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.091416 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.091552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.091681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.091809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.091937 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.091937 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.092263 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.092406 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.092536 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.092664 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.092792 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.092920 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.093049 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.093186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.093315 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.093315 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.093556 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.093683 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.093818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.093947 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.094085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.094214 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.094342 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.094342 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.094590 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.094719 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] token.caching = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.094847 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.094974 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.095103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.095230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.095365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.095494 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.095622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.connection = **** {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.095769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.095907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.096079 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.096333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.096465 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.096606 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.096737 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.096865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.096994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.097122 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.097251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.097388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.097517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.097644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.097790 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.097924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.098053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.098189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.098319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.098448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.098575 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.098703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.098831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.098967 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.099096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.099224 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.099224 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.099467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.099604 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.099741 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.connection = **** {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.099879 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.100017 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.100146 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.100297 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.100428 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.100563 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.100710 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 13:45:22.100847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.100847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.100847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.100847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.100847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.100847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.100847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.100847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.100847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.102040 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.102040 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.102040 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.102040 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.102040 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.102040 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:45:22.102040 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 13:45:22.110787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.111033 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.111491 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.115007 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.115238 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.115467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.120572 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.124387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.148716 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.148948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.151102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.151335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.202077 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.202657 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.253354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.253634 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.257079 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.257320 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.319219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.319470 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.319671 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.319761 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.319974 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.320066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.320131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.320215 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.320479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.320578 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.320645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.320843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.344060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.344336 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.344441 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.344516 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.344745 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.344833 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.344898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.344960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.345212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.345296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.345362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.345424 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.345487 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.345780 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.357186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.357468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.372071 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.372401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.372499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.372570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.372632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.372871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.372956 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.373032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.373097 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.373158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.373228 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.373554 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79924) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.373641 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.373641 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79925) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 13:45:22.390765 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.390960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 13:45:22.391232 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.391348 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.391419 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 13:45:22.391482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 13:45:22.391741 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.391828 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.392000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.392093 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 13:45:22.392296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.392403 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.392471 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.392533 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.392814 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.392983 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.403938 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.404229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.404494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.404657 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.404762 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.404942 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.405175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.405452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.413110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.413855 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.416949 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.417225 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.417612 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.417766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.417929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.418013 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.418183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.418377 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.418465 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.418661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.418759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.418941 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.419025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.419196 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.419278 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.419458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.419540 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.419710 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.419793 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.419959 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.420250 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.420519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.446240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.447479 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.448404 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.448682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.449134 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.449410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.453968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.454200 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.454477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.454670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.454946 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.455227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.461743 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.462023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.463054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.463334 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.467173 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.467459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.467736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.467973 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.468082 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.468293 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.468383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.468553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.468635 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.468817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.468900 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.469073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.469157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.469348 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.469618 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.469889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.487721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.487996 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.488587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.488863 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.492593 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.493392 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.496257 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.496549 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.497053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.497346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.501521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.502327 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.505921 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.507086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.510182 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.510477 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.510761 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.511043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.511317 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.511550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.511709 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.511851 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.511991 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.512250 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.512530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.512805 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.531476 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.531867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.532119 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.532407 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.533057 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.533435 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.533712 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.533976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.540339 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.541926 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.542086 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.542332 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.543643 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.543918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.545418 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.545696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.545980 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.546258 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.546533 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.546992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.547271 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.547567 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.547847 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.548124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.559992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.560290 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.560571 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.560864 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.561143 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.561420 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.561566 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.561706 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.561844 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.562083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.562372 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.562647 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.562927 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.563200 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.580490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.582306 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.583884 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.585758 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.587271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.589518 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.589738 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.591164 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.591388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.591551 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.591724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.593130 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.593413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.593708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.599291 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.600948 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.601258 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.602889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.604279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.604574 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.604852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.605122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.606191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.606485 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.606769 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.607045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.614475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.614780 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.615063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.616414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.616729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.617014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.623369 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79925) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.623654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.623934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.624239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.624513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.624798 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.625068 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.625341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.625472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79924) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 13:45:22.625610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.625753 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.625885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.626030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.626154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.626302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.626422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.626571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.626694 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.626856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.626954 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79925) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.627128 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.627403 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.627668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.627943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.628233 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.628504 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.628775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.629033 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79924) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 13:45:22.667969 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556186b499c0 pid: 79925 (default app) May 10 13:45:22.669663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556186b499c0 pid: 79924 (default app) May 10 13:45:22.671354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe408d9-33c6-45a6-833c-8c4e849e346e None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:22.671648 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe408d9-33c6-45a6-833c-8c4e849e346e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:22.671932 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe408d9-33c6-45a6-833c-8c4e849e346e None None] PATH_INFO: `/v3` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:22.676187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Tue May 10 13:45:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:30.628556 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b35f3-17bf-48f9-ac20-2c3eae56bd81 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:30.629124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b35f3-17bf-48f9-ac20-2c3eae56bd81 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:30.629124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b35f3-17bf-48f9-ac20-2c3eae56bd81 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:30.633517 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:45:30.639397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2295f17-af81-474f-aedf-1b4fa6239613 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:30.639803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2295f17-af81-474f-aedf-1b4fa6239613 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:30.639938 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2295f17-af81-474f-aedf-1b4fa6239613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:30.670435 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG oslo_db.sqlalchemy.engines [None req-b2295f17-af81-474f-aedf-1b4fa6239613 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79925) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:45:30.851961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG passlib.handlers.bcrypt [None req-b2295f17-af81-474f-aedf-1b4fa6239613 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79925) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 13:45:30.852391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG passlib.handlers.bcrypt [None req-b2295f17-af81-474f-aedf-1b4fa6239613 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79925) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 13:45:30.911634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-b2295f17-af81-474f-aedf-1b4fa6239613 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:30.913217 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b2295f17-af81-474f-aedf-1b4fa6239613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:31.038869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 10 13:45:31.186272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b35f3-17bf-48f9-ac20-2c3eae56bd81 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:31.219838 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG oslo_db.sqlalchemy.engines [None req-496b35f3-17bf-48f9-ac20-2c3eae56bd81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:45:31.346225 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b35f3-17bf-48f9-ac20-2c3eae56bd81 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:31.350523 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31736b-4abe-4757-a693-9095643c7e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:31.351171 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31736b-4abe-4757-a693-9095643c7e08 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:31.351453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31736b-4abe-4757-a693-9095643c7e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:31.351731 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31736b-4abe-4757-a693-9095643c7e08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:31.359730 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31736b-4abe-4757-a693-9095643c7e08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:31.411671 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bb31736b-4abe-4757-a693-9095643c7e08 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 13:45:31.412012 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31736b-4abe-4757-a693-9095643c7e08 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:31.422455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Tue May 10 13:45:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 13:45:31.428234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2295f17-af81-474f-aedf-1b4fa6239613 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:31.442674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2295f17-af81-474f-aedf-1b4fa6239613 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:31.447054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6cfd6-9c7b-4409-98ce-cb2e030566d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:31.448161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6cfd6-9c7b-4409-98ce-cb2e030566d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:31.448472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6cfd6-9c7b-4409-98ce-cb2e030566d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:31.448748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6cfd6-9c7b-4409-98ce-cb2e030566d1 admin admin] PATH_INFO: `/v3/projects/71179eb4635448dd8ef63856db24457f` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:31.450241 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6cfd6-9c7b-4409-98ce-cb2e030566d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=71179eb4635448dd8ef63856db24457f)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:31.501050 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0ae6cfd6-9c7b-4409-98ce-cb2e030566d1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 13:45:31.501391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6cfd6-9c7b-4409-98ce-cb2e030566d1 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:31.505940 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Tue May 10 13:45:31 2022] GET /identity/v3/projects/71179eb4635448dd8ef63856db24457f => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:33.691108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf00af-4e90-49c7-a263-56f3cafe94c0 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:33.691620 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf00af-4e90-49c7-a263-56f3cafe94c0 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:33.691620 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf00af-4e90-49c7-a263-56f3cafe94c0 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:33.695729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:45:33.701409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baedf3-e0df-468f-b1bd-583847325c44 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:33.701804 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baedf3-e0df-468f-b1bd-583847325c44 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:33.701966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baedf3-e0df-468f-b1bd-583847325c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:33.722006 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-d8baedf3-e0df-468f-b1bd-583847325c44 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:33.723520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d8baedf3-e0df-468f-b1bd-583847325c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:33.731922 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 13:45:33.754581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf00af-4e90-49c7-a263-56f3cafe94c0 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:33.766492 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf00af-4e90-49c7-a263-56f3cafe94c0 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:33.770742 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa86c6-4d9d-4634-adee-c2a615374f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:33.771372 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa86c6-4d9d-4634-adee-c2a615374f51 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:33.771655 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa86c6-4d9d-4634-adee-c2a615374f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:33.771935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa86c6-4d9d-4634-adee-c2a615374f51 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:33.779526 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa86c6-4d9d-4634-adee-c2a615374f51 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:33.781582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa86c6-4d9d-4634-adee-c2a615374f51 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:33.790709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Tue May 10 13:45:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 13:45:33.796015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baedf3-e0df-468f-b1bd-583847325c44 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:33.804793 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baedf3-e0df-468f-b1bd-583847325c44 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:33.809776 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c7d3d-1e2b-406a-a3eb-ea2619a32b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:33.810623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c7d3d-1e2b-406a-a3eb-ea2619a32b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:33.810903 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c7d3d-1e2b-406a-a3eb-ea2619a32b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:33.811177 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c7d3d-1e2b-406a-a3eb-ea2619a32b58 admin admin] PATH_INFO: `/v3/users/bfaa5ec258f44012bccce1e5ad959ff1` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:33.812581 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c7d3d-1e2b-406a-a3eb-ea2619a32b58 admin admin] RBAC: Authorizing `identity:get_user(user_id=bfaa5ec258f44012bccce1e5ad959ff1)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:33.814393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c7d3d-1e2b-406a-a3eb-ea2619a32b58 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:33.815935 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Tue May 10 13:45:33 2022] GET /identity/v3/users/bfaa5ec258f44012bccce1e5ad959ff1 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:36.100644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ad901-716b-4afa-9c57-05c02c7989ff None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:36.101179 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ad901-716b-4afa-9c57-05c02c7989ff None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:36.101179 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ad901-716b-4afa-9c57-05c02c7989ff None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:36.102551 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:36.107984 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a8f1a-ce4b-4f37-9f0d-49a605b7a6e8 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:36.108449 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a8f1a-ce4b-4f37-9f0d-49a605b7a6e8 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:36.108577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a8f1a-ce4b-4f37-9f0d-49a605b7a6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:36.234614 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-c95a8f1a-ce4b-4f37-9f0d-49a605b7a6e8 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:36.235805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-c95a8f1a-ce4b-4f37-9f0d-49a605b7a6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:36.242234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e4857-7253-45de-bae4-39c6919c426c None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:36.242525 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e4857-7253-45de-bae4-39c6919c426c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:36.242804 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e4857-7253-45de-bae4-39c6919c426c None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:36.244215 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:45:36.249443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f023af8-eb85-4bee-a16d-54a246e74b3f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:36.249724 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f023af8-eb85-4bee-a16d-54a246e74b3f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:36.250004 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f023af8-eb85-4bee-a16d-54a246e74b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:36.289443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG passlib.handlers.bcrypt [None req-0f023af8-eb85-4bee-a16d-54a246e74b3f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79924) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 13:45:36.289873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG passlib.handlers.bcrypt [None req-0f023af8-eb85-4bee-a16d-54a246e74b3f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79924) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 13:45:36.314571 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:45:36.336948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-0f023af8-eb85-4bee-a16d-54a246e74b3f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:36.337538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a8f1a-ce4b-4f37-9f0d-49a605b7a6e8 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:36.338525 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-0f023af8-eb85-4bee-a16d-54a246e74b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:36.433206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a8f1a-ce4b-4f37-9f0d-49a605b7a6e8 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:36.435198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:45:36.457400 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f023af8-eb85-4bee-a16d-54a246e74b3f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:36.465101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a809f7-2cba-4611-a435-70bd4416ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:36.465886 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a809f7-2cba-4611-a435-70bd4416ef50 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:36.466167 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a809f7-2cba-4611-a435-70bd4416ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:36.466442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a809f7-2cba-4611-a435-70bd4416ef50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:36.477165 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a809f7-2cba-4611-a435-70bd4416ef50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:45:36.488208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-a2a809f7-2cba-4611-a435-70bd4416ef50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:45:36.488208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:45:36.488208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:45:36.488208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:45:36.488208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:45:36.488208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:45:36.488208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:45:36.488208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:45:36.488208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:45:36.488208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:45:36.488208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:45:36.488208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:45:36.488208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:45:36.488208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:45:36.488208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:45:36.488208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:45:36.489390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:45:36.489390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:45:36.489390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:45:36.489390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:45:36.489390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:45:36.489390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:45:36.489390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:45:36.489390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:45:36.489390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:45:36.489390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:45:36.489390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:45:36.489390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:45:36.489390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:45:36.489390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:45:36.489390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:45:36.489390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:45:36.490244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:45:36.490244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:45:36.490244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:45:36.490244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:45:36.490244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:45:36.490244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:45:36.490244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:45:36.490244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:45:36.490244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:45:36.490244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:45:36.490244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:45:36.490244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:45:36.490244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:45:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:45:36.495554 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a809f7-2cba-4611-a435-70bd4416ef50 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:36.552546 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f023af8-eb85-4bee-a16d-54a246e74b3f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:36.583759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d905f-dea1-477f-9e41-d8fd17939453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:36.584672 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d905f-dea1-477f-9e41-d8fd17939453 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:36.584955 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d905f-dea1-477f-9e41-d8fd17939453 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:36.585234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d905f-dea1-477f-9e41-d8fd17939453 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:36.589493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a809f7-2cba-4611-a435-70bd4416ef50 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:36.621863 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedab84-ce08-4b63-846f-2fa023d61e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:36.622523 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedab84-ce08-4b63-846f-2fa023d61e4b None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:36.622806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedab84-ce08-4b63-846f-2fa023d61e4b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:36.623084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedab84-ce08-4b63-846f-2fa023d61e4b None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:36.623831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedab84-ce08-4b63-846f-2fa023d61e4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:36.624138 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedab84-ce08-4b63-846f-2fa023d61e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:36.625558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedab84-ce08-4b63-846f-2fa023d61e4b None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:36.636943 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:45:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:45:36.642326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedab84-ce08-4b63-846f-2fa023d61e4b None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:36.649279 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d905f-dea1-477f-9e41-d8fd17939453 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:36.651305 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d905f-dea1-477f-9e41-d8fd17939453 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:36.735387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedab84-ce08-4b63-846f-2fa023d61e4b None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:36.742039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:45:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 13:45:36.747486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d905f-dea1-477f-9e41-d8fd17939453 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:36.769016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b58cf-cb3e-4908-986a-c46db0feb1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:36.769886 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b58cf-cb3e-4908-986a-c46db0feb1bf None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:36.770168 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b58cf-cb3e-4908-986a-c46db0feb1bf None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:36.770439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b58cf-cb3e-4908-986a-c46db0feb1bf None admin] PATH_INFO: `/v3/users/bfaa5ec258f44012bccce1e5ad959ff1` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:36.771645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b58cf-cb3e-4908-986a-c46db0feb1bf None admin] RBAC: Authorizing `identity:get_user(user_id=bfaa5ec258f44012bccce1e5ad959ff1)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:36.773942 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b58cf-cb3e-4908-986a-c46db0feb1bf None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:36.775603 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:45:36 2022] GET /identity/v3/users/bfaa5ec258f44012bccce1e5ad959ff1 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:45:36.780754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b58cf-cb3e-4908-986a-c46db0feb1bf None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:36.841688 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d905f-dea1-477f-9e41-d8fd17939453 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:36.873314 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fe102-c2a0-4446-b9d1-a5856b0d46cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:36.874099 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fe102-c2a0-4446-b9d1-a5856b0d46cd None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:36.874375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fe102-c2a0-4446-b9d1-a5856b0d46cd None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:36.874651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fe102-c2a0-4446-b9d1-a5856b0d46cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:36.877369 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b58cf-cb3e-4908-986a-c46db0feb1bf None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:36.911620 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f7905-fd43-42f0-b8b0-c82f55a14422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:36.912377 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7905-fd43-42f0-b8b0-c82f55a14422 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:36.912660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7905-fd43-42f0-b8b0-c82f55a14422 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:36.912931 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7905-fd43-42f0-b8b0-c82f55a14422 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:36.914200 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f7905-fd43-42f0-b8b0-c82f55a14422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:36.916255 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f7905-fd43-42f0-b8b0-c82f55a14422 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:36.917924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:45:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:45:36.923967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f7905-fd43-42f0-b8b0-c82f55a14422 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:37.004413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fe102-c2a0-4446-b9d1-a5856b0d46cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:37.005853 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fe102-c2a0-4446-b9d1-a5856b0d46cd None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:37.026598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-3a3fe102-c2a0-4446-b9d1-a5856b0d46cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:45:37.026598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:45:37.026598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:45:37.026598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:45:37.026598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:45:37.026598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:45:37.026598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:45:37.026598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:45:37.026598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:45:37.026598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:45:37.026598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:45:37.026598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:45:37.026598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:45:37.026598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:45:37.026598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:45:37.027449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:45:37.027449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:45:37.027449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:45:37.027449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:45:37.027449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:45:37.027449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:45:37.027449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:45:37.027449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:45:37.027449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:45:37.027449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:45:37.027449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:45:37.027449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:45:37.027449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:45:37.027449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:45:37.027449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:45:37.027449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:45:37.027449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:45:37.028324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:45:37.028324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:45:37.028324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:45:37.028324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:45:37.028544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f7905-fd43-42f0-b8b0-c82f55a14422 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:37.028620 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:45:37.033887 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fe102-c2a0-4446-b9d1-a5856b0d46cd None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:37.059800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d9d3c-9c43-4e25-bb12-1605e055d1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:37.060485 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d9d3c-9c43-4e25-bb12-1605e055d1e3 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:37.060776 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d9d3c-9c43-4e25-bb12-1605e055d1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:37.061052 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d9d3c-9c43-4e25-bb12-1605e055d1e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:37.061881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d9d3c-9c43-4e25-bb12-1605e055d1e3 None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.domain.id=default, user.id=bfaa5ec258f44012bccce1e5ad959ff1) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:37.062189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d9d3c-9c43-4e25-bb12-1605e055d1e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:37.063614 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d9d3c-9c43-4e25-bb12-1605e055d1e3 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:37.070096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Tue May 10 13:45:36 2022] GET /identity/v3/role_assignments?user.id=bfaa5ec258f44012bccce1e5ad959ff1&scope.domain.id=default&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:45:37.133552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fe102-c2a0-4446-b9d1-a5856b0d46cd None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:37.169125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7807da2-206f-43f5-bca1-d9ba9a002f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:37.169712 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7807da2-206f-43f5-bca1-d9ba9a002f8a None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:37.169996 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7807da2-206f-43f5-bca1-d9ba9a002f8a None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:37.170273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7807da2-206f-43f5-bca1-d9ba9a002f8a None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:37.171010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7807da2-206f-43f5-bca1-d9ba9a002f8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:37.171315 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7807da2-206f-43f5-bca1-d9ba9a002f8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:37.173031 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7807da2-206f-43f5-bca1-d9ba9a002f8a None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:37.191222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:45:39.579318 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1e2c9-1bda-4ced-b8f8-ba8d2cede4f9 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:39.580374 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1e2c9-1bda-4ced-b8f8-ba8d2cede4f9 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:39.580869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1e2c9-1bda-4ced-b8f8-ba8d2cede4f9 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:39.582707 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:39.588596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3f4d9-15c7-4e4d-8258-0c7ef558e235 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:39.589438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3f4d9-15c7-4e4d-8258-0c7ef558e235 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:39.589958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3f4d9-15c7-4e4d-8258-0c7ef558e235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:39.609309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-cad3f4d9-15c7-4e4d-8258-0c7ef558e235 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:39.610782 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cad3f4d9-15c7-4e4d-8258-0c7ef558e235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:39.699700 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 11/23] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:45:39.733895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1e2c9-1bda-4ced-b8f8-ba8d2cede4f9 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:39.859000 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1e2c9-1bda-4ced-b8f8-ba8d2cede4f9 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:39.892776 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8d61f-0889-4bf2-ac0b-ac2add04d217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:39.893567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8d61f-0889-4bf2-ac0b-ac2add04d217 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:39.893846 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8d61f-0889-4bf2-ac0b-ac2add04d217 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:39.894118 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8d61f-0889-4bf2-ac0b-ac2add04d217 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:39.904582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8d61f-0889-4bf2-ac0b-ac2add04d217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:45:39.912530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-61a8d61f-0889-4bf2-ac0b-ac2add04d217 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:45:39.912530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:45:39.912530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:45:39.912530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:45:39.912530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:45:39.912530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:45:39.912530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:45:39.912530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:45:39.912530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:45:39.912530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:45:39.912530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:45:39.912530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:45:39.912530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:45:39.912530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:45:39.912530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:45:39.912530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:45:39.913413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:45:39.913413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:45:39.913413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:45:39.913413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:45:39.913413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:45:39.913413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:45:39.913413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:45:39.913413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:45:39.913413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:45:39.913413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:45:39.913413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:45:39.913413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:45:39.913413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:45:39.913413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:45:39.913413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:45:39.913413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:45:39.914204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:45:39.914204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:45:39.914204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:45:39.914204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:45:39.914204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:45:39.914204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:45:39.914204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:45:39.914204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:45:39.914204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:45:39.914204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:45:39.914204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:45:39.914204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:45:39.914204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 13/24] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:45:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:45:39.921663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3f4d9-15c7-4e4d-8258-0c7ef558e235 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:39.971696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d0010-0a18-4db3-a427-48ca35f907b7 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:39.972047 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d0010-0a18-4db3-a427-48ca35f907b7 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:39.972447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d0010-0a18-4db3-a427-48ca35f907b7 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:39.974934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 14/25] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:45:39.980304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028a76c-cbe1-42ab-b0fe-788d0d70708c None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:39.980731 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028a76c-cbe1-42ab-b0fe-788d0d70708c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:39.981139 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028a76c-cbe1-42ab-b0fe-788d0d70708c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:40.013311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-7028a76c-cbe1-42ab-b0fe-788d0d70708c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:40.014868 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-7028a76c-cbe1-42ab-b0fe-788d0d70708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:40.131658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 15/26] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:45:40.143358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3f4d9-15c7-4e4d-8258-0c7ef558e235 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:40.167971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028a76c-cbe1-42ab-b0fe-788d0d70708c None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:40.192784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c89733-4f60-4646-89c2-d76db86929e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:40.193466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c89733-4f60-4646-89c2-d76db86929e1 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:40.193749 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c89733-4f60-4646-89c2-d76db86929e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:40.194027 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c89733-4f60-4646-89c2-d76db86929e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:40.194794 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c89733-4f60-4646-89c2-d76db86929e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:40.195101 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c89733-4f60-4646-89c2-d76db86929e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:40.196548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c89733-4f60-4646-89c2-d76db86929e1 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:40.219791 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 12/27] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:45:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:40.221378 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43a7ba-52ed-4d38-ba59-ea9b063c5965 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:40.221948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43a7ba-52ed-4d38-ba59-ea9b063c5965 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:40.222670 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43a7ba-52ed-4d38-ba59-ea9b063c5965 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:40.224524 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 13/28] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:40.229177 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43a7ba-52ed-4d38-ba59-ea9b063c5965 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:40.335840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43a7ba-52ed-4d38-ba59-ea9b063c5965 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:40.371080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5278660-99a7-418f-a538-3f3fd28fcd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:40.372291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5278660-99a7-418f-a538-3f3fd28fcd7b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:40.372718 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5278660-99a7-418f-a538-3f3fd28fcd7b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:40.373134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5278660-99a7-418f-a538-3f3fd28fcd7b None admin] PATH_INFO: `/v3/users/bfaa5ec258f44012bccce1e5ad959ff1` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:40.374840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5278660-99a7-418f-a538-3f3fd28fcd7b None admin] RBAC: Authorizing `identity:get_user(user_id=bfaa5ec258f44012bccce1e5ad959ff1)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:40.376465 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5278660-99a7-418f-a538-3f3fd28fcd7b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:40.378735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 14/29] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:45:40 2022] GET /identity/v3/users/bfaa5ec258f44012bccce1e5ad959ff1 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:40.380044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46704c4c-6174-4f1e-a49e-b095419a44e6 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:40.380494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46704c4c-6174-4f1e-a49e-b095419a44e6 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:40.380919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46704c4c-6174-4f1e-a49e-b095419a44e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:40.398156 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-46704c4c-6174-4f1e-a49e-b095419a44e6 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:40.399927 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-46704c4c-6174-4f1e-a49e-b095419a44e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:40.402285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028a76c-cbe1-42ab-b0fe-788d0d70708c None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:40.469474 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 15/30] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:45:40.476250 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46704c4c-6174-4f1e-a49e-b095419a44e6 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:40.476363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750c6ca-3660-47e1-a69e-c3c600bf956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:40.476363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750c6ca-3660-47e1-a69e-c3c600bf956d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:40.476363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750c6ca-3660-47e1-a69e-c3c600bf956d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:40.476363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750c6ca-3660-47e1-a69e-c3c600bf956d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:40.495033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750c6ca-3660-47e1-a69e-c3c600bf956d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:40.497683 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750c6ca-3660-47e1-a69e-c3c600bf956d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:40.517111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-a750c6ca-3660-47e1-a69e-c3c600bf956d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:45:40.517111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:45:40.517111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:45:40.517111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:45:40.517111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:45:40.517111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:45:40.517111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:45:40.517111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:45:40.517111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:45:40.517111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:45:40.517111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:45:40.517111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:45:40.517111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:45:40.517111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:45:40.517111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:45:40.517966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:45:40.517966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:45:40.517966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:45:40.517966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:45:40.517966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:45:40.517966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:45:40.517966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:45:40.517966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:45:40.517966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:45:40.517966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:45:40.517966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:45:40.517966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:45:40.517966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:45:40.517966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:45:40.517966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:45:40.517966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:45:40.517966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:45:40.518808 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:45:40.518808 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:45:40.518808 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:45:40.518808 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:45:40.518808 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 16/31] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:45:40.519810 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba32b4-6855-4edb-af4f-11643eb24f47 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:40.520096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba32b4-6855-4edb-af4f-11643eb24f47 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:40.520580 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba32b4-6855-4edb-af4f-11643eb24f47 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:40.522133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 17/32] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:40.522861 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba32b4-6855-4edb-af4f-11643eb24f47 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:40.589700 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46704c4c-6174-4f1e-a49e-b095419a44e6 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:40.624229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f7c7e-0c45-4eed-bf98-f333d06ab01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:40.625299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7c7e-0c45-4eed-bf98-f333d06ab01c None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:40.625743 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7c7e-0c45-4eed-bf98-f333d06ab01c None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:40.626163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7c7e-0c45-4eed-bf98-f333d06ab01c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:40.627555 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f7c7e-0c45-4eed-bf98-f333d06ab01c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:40.629240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f7c7e-0c45-4eed-bf98-f333d06ab01c None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:40.635673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 16/33] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:45:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:40.636735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f7c7e-0c45-4eed-bf98-f333d06ab01c None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:40.640282 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba32b4-6855-4edb-af4f-11643eb24f47 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:40.684283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152257-f7cd-4e54-b59e-e75fb38650fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:40.685121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152257-f7cd-4e54-b59e-e75fb38650fe None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:40.685397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152257-f7cd-4e54-b59e-e75fb38650fe None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:40.685673 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152257-f7cd-4e54-b59e-e75fb38650fe None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:40.686803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4152257-f7cd-4e54-b59e-e75fb38650fe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:40.688495 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4152257-f7cd-4e54-b59e-e75fb38650fe None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:40.739537 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f7c7e-0c45-4eed-bf98-f333d06ab01c None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:40.775276 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26993e47-380a-46c8-8a36-ae9cc5999007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:40.776254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26993e47-380a-46c8-8a36-ae9cc5999007 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:40.776674 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26993e47-380a-46c8-8a36-ae9cc5999007 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:40.777154 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26993e47-380a-46c8-8a36-ae9cc5999007 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:40.778114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26993e47-380a-46c8-8a36-ae9cc5999007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:40.778557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26993e47-380a-46c8-8a36-ae9cc5999007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:40.780095 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26993e47-380a-46c8-8a36-ae9cc5999007 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:40.793199 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 17/34] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:40.794875 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae69cf-2b5c-4c47-87bd-7a1e37ec63e0 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:40.795336 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae69cf-2b5c-4c47-87bd-7a1e37ec63e0 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:40.795757 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae69cf-2b5c-4c47-87bd-7a1e37ec63e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:40.812932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-5bae69cf-2b5c-4c47-87bd-7a1e37ec63e0 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:40.814358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-5bae69cf-2b5c-4c47-87bd-7a1e37ec63e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:40.837748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 18/35] 10.222.0.49 () {60 vars in 1131 bytes} [Tue May 10 13:45:40 2022] POST /identity/v3/roles => generated 219 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:45:40.839158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152257-f7cd-4e54-b59e-e75fb38650fe None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:40.945728 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 18/36] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:45:40.946629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae69cf-2b5c-4c47-87bd-7a1e37ec63e0 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:41.053900 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152257-f7cd-4e54-b59e-e75fb38650fe None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:41.091580 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae69cf-2b5c-4c47-87bd-7a1e37ec63e0 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:41.093007 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571211b-19c0-4817-b793-28f856aca91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:41.093912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571211b-19c0-4817-b793-28f856aca91a None admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:41.094196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571211b-19c0-4817-b793-28f856aca91a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:41.094478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571211b-19c0-4817-b793-28f856aca91a None admin] PATH_INFO: `/v3/domains/default/users/bfaa5ec258f44012bccce1e5ad959ff1/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:41.101186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571211b-19c0-4817-b793-28f856aca91a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bfaa5ec258f44012bccce1e5ad959ff1, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:41.103759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571211b-19c0-4817-b793-28f856aca91a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:41.128603 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 19/37] 10.222.0.49 () {58 vars in 1361 bytes} [Tue May 10 13:45:40 2022] PUT /identity/v3/domains/default/users/bfaa5ec258f44012bccce1e5ad959ff1/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:45:41.129906 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571211b-19c0-4817-b793-28f856aca91a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:41.138115 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01693ccf-0e79-4f7b-8a11-b264b0f98456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:41.138796 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01693ccf-0e79-4f7b-8a11-b264b0f98456 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:41.139133 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01693ccf-0e79-4f7b-8a11-b264b0f98456 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:41.139411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01693ccf-0e79-4f7b-8a11-b264b0f98456 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:41.140135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01693ccf-0e79-4f7b-8a11-b264b0f98456 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:41.141693 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01693ccf-0e79-4f7b-8a11-b264b0f98456 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:41.269684 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571211b-19c0-4817-b793-28f856aca91a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:41.302005 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 19/38] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 13:45:40 2022] POST /identity/v3/projects => generated 301 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:45:41.306332 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec2674-8312-4cf0-a939-7fce704e3869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:41.306959 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec2674-8312-4cf0-a939-7fce704e3869 None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:41.307247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec2674-8312-4cf0-a939-7fce704e3869 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:41.307525 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec2674-8312-4cf0-a939-7fce704e3869 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:41.308934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec2674-8312-4cf0-a939-7fce704e3869 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:41.311728 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec2674-8312-4cf0-a939-7fce704e3869 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:41.322367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4290a3-16fb-4821-b323-ce472447e178 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:41.322749 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4290a3-16fb-4821-b323-ce472447e178 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:41.322981 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4290a3-16fb-4821-b323-ce472447e178 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:41.324646 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 20/39] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:41.334130 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49047bb3-d4fd-44cb-b774-b8d7ab2f2110 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:41.336252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 20/40] 10.222.0.49 () {60 vars in 1131 bytes} [Tue May 10 13:45:41 2022] POST /identity/v3/roles => generated 225 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:45:41.339728 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49047bb3-d4fd-44cb-b774-b8d7ab2f2110 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:41.339728 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49047bb3-d4fd-44cb-b774-b8d7ab2f2110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:41.359785 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-49047bb3-d4fd-44cb-b774-b8d7ab2f2110 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:41.361658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-49047bb3-d4fd-44cb-b774-b8d7ab2f2110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:41.449205 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 21/41] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:45:41.474644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec2674-8312-4cf0-a939-7fce704e3869 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:41.591610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec2674-8312-4cf0-a939-7fce704e3869 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:41.627602 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466087e2-bd9d-4977-b54a-3e36f6929112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:41.628349 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466087e2-bd9d-4977-b54a-3e36f6929112 None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:41.628640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466087e2-bd9d-4977-b54a-3e36f6929112 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:41.628924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466087e2-bd9d-4977-b54a-3e36f6929112 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:41.629695 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466087e2-bd9d-4977-b54a-3e36f6929112 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:41.631240 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466087e2-bd9d-4977-b54a-3e36f6929112 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:41.635638 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b4cc2-6d16-47af-a727-5154322e056c None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:41.636225 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b4cc2-6d16-47af-a727-5154322e056c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:41.636597 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b4cc2-6d16-47af-a727-5154322e056c None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:41.638029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 22/42] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:41.644245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab1b5b-1b4a-450d-bf69-2833689418bb None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:41.644542 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab1b5b-1b4a-450d-bf69-2833689418bb None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:41.644823 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab1b5b-1b4a-450d-bf69-2833689418bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:41.651365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 21/43] 10.222.0.49 () {60 vars in 1131 bytes} [Tue May 10 13:45:41 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:45:41.669368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-e4ab1b5b-1b4a-450d-bf69-2833689418bb None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:41.670612 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e4ab1b5b-1b4a-450d-bf69-2833689418bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:41.749941 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 23/44] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:45:41.773052 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466087e2-bd9d-4977-b54a-3e36f6929112 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:41.876238 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466087e2-bd9d-4977-b54a-3e36f6929112 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:41.910571 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e585cd7-4a68-48b8-ae76-669d5f750cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:41.911371 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e585cd7-4a68-48b8-ae76-669d5f750cec None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:41.911665 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e585cd7-4a68-48b8-ae76-669d5f750cec None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:41.911946 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e585cd7-4a68-48b8-ae76-669d5f750cec None admin] PATH_INFO: `/v3/domains/default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:41.913152 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e585cd7-4a68-48b8-ae76-669d5f750cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:41.914596 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e585cd7-4a68-48b8-ae76-669d5f750cec None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:41.917046 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 22/45] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:45:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:41.922564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab1b5b-1b4a-450d-bf69-2833689418bb None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:42.019421 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab1b5b-1b4a-450d-bf69-2833689418bb None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:42.058508 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e80b5-b2ee-4640-90b0-fbbea6f78969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:42.059174 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e80b5-b2ee-4640-90b0-fbbea6f78969 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:42.059460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e80b5-b2ee-4640-90b0-fbbea6f78969 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:42.059741 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e80b5-b2ee-4640-90b0-fbbea6f78969 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:42.060503 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e80b5-b2ee-4640-90b0-fbbea6f78969 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:42.062075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e80b5-b2ee-4640-90b0-fbbea6f78969 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:42.088152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 13:45:41 2022] POST /identity/v3/projects => generated 312 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:45:43.627125 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733bc72-4bee-4af9-a676-1ee102cd6f8d None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:43.627640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733bc72-4bee-4af9-a676-1ee102cd6f8d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:43.627749 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733bc72-4bee-4af9-a676-1ee102cd6f8d None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:43.629090 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 23/47] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:43.635067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b41683-9761-442b-9ab3-b906ff6246f3 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:43.635486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b41683-9761-442b-9ab3-b906ff6246f3 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:43.635571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b41683-9761-442b-9ab3-b906ff6246f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:43.652367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-76b41683-9761-442b-9ab3-b906ff6246f3 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:43.653540 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-76b41683-9761-442b-9ab3-b906ff6246f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:43.717871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 25/48] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:45:43.740309 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733bc72-4bee-4af9-a676-1ee102cd6f8d None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:43.837647 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733bc72-4bee-4af9-a676-1ee102cd6f8d None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:43.869650 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6194154-962c-4b1e-a89e-e1185f60c4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:43.870438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194154-962c-4b1e-a89e-e1185f60c4ac None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:43.870726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194154-962c-4b1e-a89e-e1185f60c4ac None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:43.871004 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194154-962c-4b1e-a89e-e1185f60c4ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:43.880918 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6194154-962c-4b1e-a89e-e1185f60c4ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:45:43.889259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-b6194154-962c-4b1e-a89e-e1185f60c4ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:45:43.889259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:45:43.889259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:45:43.889259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:45:43.889259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:45:43.889259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:45:43.889259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:45:43.889259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:45:43.889259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:45:43.889259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:45:43.889259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:45:43.889259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:45:43.889259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:45:43.889259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:45:43.889259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:45:43.889259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:45:43.890191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:45:43.890191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:45:43.890191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:45:43.890191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:45:43.890191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:45:43.890191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:45:43.890191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:45:43.890191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:45:43.890191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:45:43.890191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:45:43.890191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:45:43.890191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:45:43.890191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:45:43.890191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:45:43.890191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:45:43.890191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:45:43.890998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:45:43.890998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:45:43.890998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:45:43.890998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:45:43.890998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:45:43.890998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:45:43.890998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:45:43.890998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:45:43.890998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:45:43.890998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:45:43.890998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:45:43.890998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:45:43.890998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 24/49] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:45:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:45:43.897708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b41683-9761-442b-9ab3-b906ff6246f3 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:43.990804 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b41683-9761-442b-9ab3-b906ff6246f3 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:44.022975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d5162-8896-4684-85b0-f6beed1cdc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:44.023639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d5162-8896-4684-85b0-f6beed1cdc23 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:44.023921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d5162-8896-4684-85b0-f6beed1cdc23 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:44.024222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d5162-8896-4684-85b0-f6beed1cdc23 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:44.024972 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d5162-8896-4684-85b0-f6beed1cdc23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:44.025277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d5162-8896-4684-85b0-f6beed1cdc23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:44.026643 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d5162-8896-4684-85b0-f6beed1cdc23 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:44.034997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 26/50] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:45:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:44.040596 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6194154-962c-4b1e-a89e-e1185f60c4ac None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:44.139173 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6194154-962c-4b1e-a89e-e1185f60c4ac None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:44.175462 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83a3c5-4288-4a4e-a9b8-78be9ac9e257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:44.176283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83a3c5-4288-4a4e-a9b8-78be9ac9e257 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:44.176569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83a3c5-4288-4a4e-a9b8-78be9ac9e257 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:44.176847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83a3c5-4288-4a4e-a9b8-78be9ac9e257 None admin] PATH_INFO: `/v3/users/bfaa5ec258f44012bccce1e5ad959ff1` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:44.178036 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83a3c5-4288-4a4e-a9b8-78be9ac9e257 None admin] RBAC: Authorizing `identity:get_user(user_id=bfaa5ec258f44012bccce1e5ad959ff1)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:44.179483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83a3c5-4288-4a4e-a9b8-78be9ac9e257 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:44.181865 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 25/51] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:45:44 2022] GET /identity/v3/users/bfaa5ec258f44012bccce1e5ad959ff1 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:44.187240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d5162-8896-4684-85b0-f6beed1cdc23 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:44.283683 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d5162-8896-4684-85b0-f6beed1cdc23 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:44.297535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8e8e1-7d07-4f2a-99e5-66ea91e67d7c None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:44.297825 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8e8e1-7d07-4f2a-99e5-66ea91e67d7c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:44.298113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8e8e1-7d07-4f2a-99e5-66ea91e67d7c None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:44.299484 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 26/52] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:45:44.304542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11462417-b9b5-4b17-ad8e-e985bbff4c64 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:44.304841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11462417-b9b5-4b17-ad8e-e985bbff4c64 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:44.305128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11462417-b9b5-4b17-ad8e-e985bbff4c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:44.316315 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca47b4-6df4-41a7-9837-6e25814d6d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:44.317113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca47b4-6df4-41a7-9837-6e25814d6d90 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:44.317395 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca47b4-6df4-41a7-9837-6e25814d6d90 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:44.317671 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca47b4-6df4-41a7-9837-6e25814d6d90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:44.318849 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca47b4-6df4-41a7-9837-6e25814d6d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:44.320303 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca47b4-6df4-41a7-9837-6e25814d6d90 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:44.321931 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 27/53] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:45:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:44.322241 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-11462417-b9b5-4b17-ad8e-e985bbff4c64 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:44.323813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-11462417-b9b5-4b17-ad8e-e985bbff4c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:44.327477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca47b4-6df4-41a7-9837-6e25814d6d90 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:44.387858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 27/54] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:45:44.411296 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11462417-b9b5-4b17-ad8e-e985bbff4c64 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:44.421057 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca47b4-6df4-41a7-9837-6e25814d6d90 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:44.452878 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce856247-b386-47b1-84ab-48133178277b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:44.453470 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce856247-b386-47b1-84ab-48133178277b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:44.453750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce856247-b386-47b1-84ab-48133178277b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:44.454025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce856247-b386-47b1-84ab-48133178277b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:44.454855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce856247-b386-47b1-84ab-48133178277b None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.domain.id=default, user.id=bfaa5ec258f44012bccce1e5ad959ff1) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:44.455165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce856247-b386-47b1-84ab-48133178277b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:44.456641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce856247-b386-47b1-84ab-48133178277b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:44.465474 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 28/55] 10.222.0.49 () {56 vars in 1322 bytes} [Tue May 10 13:45:44 2022] GET /identity/v3/role_assignments?user.id=bfaa5ec258f44012bccce1e5ad959ff1&scope.domain.id=default&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 530 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:45:44.507156 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11462417-b9b5-4b17-ad8e-e985bbff4c64 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:44.542709 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875283ea-5b07-4f26-a408-08547316c6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:44.543518 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875283ea-5b07-4f26-a408-08547316c6d4 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:44.543799 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875283ea-5b07-4f26-a408-08547316c6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:44.544072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875283ea-5b07-4f26-a408-08547316c6d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:44.545316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875283ea-5b07-4f26-a408-08547316c6d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:44.546781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875283ea-5b07-4f26-a408-08547316c6d4 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:44.548475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 28/56] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:45:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:45:44.554132 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce856247-b386-47b1-84ab-48133178277b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:44.652306 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce856247-b386-47b1-84ab-48133178277b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:44.689449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac412d6-7100-49f4-a22a-63d089516b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:44.690130 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac412d6-7100-49f4-a22a-63d089516b23 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:44.690413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac412d6-7100-49f4-a22a-63d089516b23 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:44.690688 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac412d6-7100-49f4-a22a-63d089516b23 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:44.691410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac412d6-7100-49f4-a22a-63d089516b23 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:44.692947 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac412d6-7100-49f4-a22a-63d089516b23 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:44.717511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 29/57] 10.222.0.49 () {60 vars in 1140 bytes} [Tue May 10 13:45:44 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:45:46.913003 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c04beb-f52a-4b0e-a7ff-3f9ec90d932d None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:46.913518 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c04beb-f52a-4b0e-a7ff-3f9ec90d932d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:46.913602 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c04beb-f52a-4b0e-a7ff-3f9ec90d932d None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:46.915466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 29/58] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:46.920833 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b319cf-2acf-4632-a4bb-466a6d753ee7 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:46.921245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b319cf-2acf-4632-a4bb-466a6d753ee7 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:46.921400 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b319cf-2acf-4632-a4bb-466a6d753ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:46.937511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-54b319cf-2acf-4632-a4bb-466a6d753ee7 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:46.938658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-54b319cf-2acf-4632-a4bb-466a6d753ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:47.000553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 30/59] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:45:47.024852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c04beb-f52a-4b0e-a7ff-3f9ec90d932d None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:47.118285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c04beb-f52a-4b0e-a7ff-3f9ec90d932d None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:47.149580 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0398fe-8475-411c-b10b-13333285bf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:47.150351 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0398fe-8475-411c-b10b-13333285bf02 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:47.150632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0398fe-8475-411c-b10b-13333285bf02 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:47.150905 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0398fe-8475-411c-b10b-13333285bf02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:47.152070 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0398fe-8475-411c-b10b-13333285bf02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:47.153528 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0398fe-8475-411c-b10b-13333285bf02 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:47.155111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 30/60] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:45:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:47.160672 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b319cf-2acf-4632-a4bb-466a6d753ee7 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:47.253337 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b319cf-2acf-4632-a4bb-466a6d753ee7 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:47.285961 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33aab1-f6e4-43dc-b102-155acb7e4546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:47.286617 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33aab1-f6e4-43dc-b102-155acb7e4546 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:47.286900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33aab1-f6e4-43dc-b102-155acb7e4546 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:47.287175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33aab1-f6e4-43dc-b102-155acb7e4546 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:47.287872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33aab1-f6e4-43dc-b102-155acb7e4546 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:47.289320 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33aab1-f6e4-43dc-b102-155acb7e4546 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:47.313019 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 31/61] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:45:47 2022] POST /identity/v3/users => generated 275 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:45:50.881584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7ed3e-ac86-4978-8602-c23b78c17ecd None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:50.883433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7ed3e-ac86-4978-8602-c23b78c17ecd None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:50.884839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7ed3e-ac86-4978-8602-c23b78c17ecd None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:50.887841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 31/62] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:50.894906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f2232-3edc-409d-bd64-c0f18c1ac720 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:50.896425 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f2232-3edc-409d-bd64-c0f18c1ac720 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:50.897188 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f2232-3edc-409d-bd64-c0f18c1ac720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:50.932721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-d86f2232-3edc-409d-bd64-c0f18c1ac720 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:50.934997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d86f2232-3edc-409d-bd64-c0f18c1ac720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:51.080608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 32/63] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:45:51.092061 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215137ba-541a-48fe-ba71-21b60bb48df2 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:51.092642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215137ba-541a-48fe-ba71-21b60bb48df2 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:51.093143 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215137ba-541a-48fe-ba71-21b60bb48df2 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:51.094977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 32/64] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:45:51.100493 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035a987-e459-455a-ae79-11f37cf8ab82 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:51.101050 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035a987-e459-455a-ae79-11f37cf8ab82 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:51.101529 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035a987-e459-455a-ae79-11f37cf8ab82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:51.115866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215137ba-541a-48fe-ba71-21b60bb48df2 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:51.130068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-d035a987-e459-455a-ae79-11f37cf8ab82 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:51.132330 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d035a987-e459-455a-ae79-11f37cf8ab82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:51.302815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 33/65] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:45:51.314317 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215137ba-541a-48fe-ba71-21b60bb48df2 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:51.346262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035a987-e459-455a-ae79-11f37cf8ab82 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:51.365186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea46a21-6ad1-4bf6-aaa9-2d5c83757989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:51.366385 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea46a21-6ad1-4bf6-aaa9-2d5c83757989 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:51.366869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea46a21-6ad1-4bf6-aaa9-2d5c83757989 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:51.367346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea46a21-6ad1-4bf6-aaa9-2d5c83757989 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:51.380308 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea46a21-6ad1-4bf6-aaa9-2d5c83757989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:45:51.389345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-0ea46a21-6ad1-4bf6-aaa9-2d5c83757989 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:45:51.389345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:45:51.389345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:45:51.389345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:45:51.389345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:45:51.389345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:45:51.389345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:45:51.389345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:45:51.389345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:45:51.389345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:45:51.389345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:45:51.389345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:45:51.389345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:45:51.389345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:45:51.389345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:45:51.389345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:45:51.390269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:45:51.390269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:45:51.390269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:45:51.390269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:45:51.390269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:45:51.390269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:45:51.390269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:45:51.390269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:45:51.390269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:45:51.390269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:45:51.390269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:45:51.390269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:45:51.390269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:45:51.390269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:45:51.390269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:45:51.390269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:45:51.391151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:45:51.391151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:45:51.391151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:45:51.391151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:45:51.391151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:45:51.391151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:45:51.391151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:45:51.391151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:45:51.391151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:45:51.391151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:45:51.391151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:45:51.391151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:45:51.394077 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 33/66] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:45:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:45:51.395732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeeffd-62cc-4814-bbb9-cf7858ecfeaa None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:51.396237 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeeffd-62cc-4814-bbb9-cf7858ecfeaa None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:51.396715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeeffd-62cc-4814-bbb9-cf7858ecfeaa None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:51.398484 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 34/67] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:51.403452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdeeffd-62cc-4814-bbb9-cf7858ecfeaa None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:51.521117 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdeeffd-62cc-4814-bbb9-cf7858ecfeaa None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:51.534281 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035a987-e459-455a-ae79-11f37cf8ab82 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:51.559668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ba3cc-481c-40c6-a918-103366bf3388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:51.560365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ba3cc-481c-40c6-a918-103366bf3388 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:51.560780 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ba3cc-481c-40c6-a918-103366bf3388 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:51.561063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ba3cc-481c-40c6-a918-103366bf3388 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:51.561962 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ba3cc-481c-40c6-a918-103366bf3388 None admin] RBAC: Adding query filter params (name=member) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:51.562269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ba3cc-481c-40c6-a918-103366bf3388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:51.563667 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ba3cc-481c-40c6-a918-103366bf3388 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:51.573929 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 35/68] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:45:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:51.575177 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cfff6-2078-483c-aa05-43ad87fadf01 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:51.575464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cfff6-2078-483c-aa05-43ad87fadf01 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:51.575740 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cfff6-2078-483c-aa05-43ad87fadf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:51.594116 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-576cfff6-2078-483c-aa05-43ad87fadf01 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:51.594710 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e4064-efc1-4638-99eb-e045279305d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:51.595289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-576cfff6-2078-483c-aa05-43ad87fadf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:51.596052 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e4064-efc1-4638-99eb-e045279305d5 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:51.596597 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e4064-efc1-4638-99eb-e045279305d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:51.597089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e4064-efc1-4638-99eb-e045279305d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:51.615471 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e4064-efc1-4638-99eb-e045279305d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:45:51.632648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-e75e4064-efc1-4638-99eb-e045279305d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:45:51.632648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:45:51.632648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:45:51.632648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:45:51.632648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:45:51.632648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:45:51.632648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:45:51.632648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:45:51.632648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:45:51.632648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:45:51.632648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:45:51.632648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:45:51.632648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:45:51.632648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:45:51.632648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:45:51.632648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:45:51.633539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:45:51.633539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:45:51.633539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:45:51.633539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:45:51.633539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:45:51.633539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:45:51.633539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:45:51.633539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:45:51.633539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:45:51.633539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:45:51.633539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:45:51.633539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:45:51.633539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:45:51.633539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:45:51.633539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:45:51.633539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:45:51.634334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:45:51.634334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:45:51.634334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:45:51.634334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:45:51.634334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:45:51.634334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:45:51.634334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:45:51.634334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:45:51.634334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:45:51.634334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:45:51.634334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:45:51.634334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:45:51.635449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:45:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:45:51.640861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdd540-2bef-4853-baa8-f5c43fd6b0b6 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:51.640861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdd540-2bef-4853-baa8-f5c43fd6b0b6 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:51.640861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdd540-2bef-4853-baa8-f5c43fd6b0b6 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:51.645136 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 35/70] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:51.645136 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdd540-2bef-4853-baa8-f5c43fd6b0b6 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:51.667076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 36/71] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:45:51.676312 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cfff6-2078-483c-aa05-43ad87fadf01 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:51.765813 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdd540-2bef-4853-baa8-f5c43fd6b0b6 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:51.769862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cfff6-2078-483c-aa05-43ad87fadf01 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:51.804118 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad9baa-f4cb-48dd-81c1-8b70498600e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:51.804368 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1c505-9b0d-4999-b244-71dfe4a7f4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:51.804830 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1c505-9b0d-4999-b244-71dfe4a7f4c1 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:51.805136 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1c505-9b0d-4999-b244-71dfe4a7f4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:51.805452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1c505-9b0d-4999-b244-71dfe4a7f4c1 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:51.805821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad9baa-f4cb-48dd-81c1-8b70498600e1 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:51.806202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1c505-9b0d-4999-b244-71dfe4a7f4c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:51.806381 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad9baa-f4cb-48dd-81c1-8b70498600e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:51.806492 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1c505-9b0d-4999-b244-71dfe4a7f4c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:51.806885 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad9baa-f4cb-48dd-81c1-8b70498600e1 None admin] PATH_INFO: `/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:51.807873 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1c505-9b0d-4999-b244-71dfe4a7f4c1 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:51.815824 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 37/72] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:45:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:51.817168 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c8496-6550-46c5-b28d-2673b2487bb8 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:51.817445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c8496-6550-46c5-b28d-2673b2487bb8 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:51.817721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c8496-6550-46c5-b28d-2673b2487bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:51.827968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad9baa-f4cb-48dd-81c1-8b70498600e1 None admin] RBAC: Authorizing `identity:get_user(user_id=f8ba6a1b884747dbaf2896a3adc5c00f)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:51.829479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad9baa-f4cb-48dd-81c1-8b70498600e1 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:51.835628 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:45:51 2022] GET /identity/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:51.835628 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad9baa-f4cb-48dd-81c1-8b70498600e1 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:51.840642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-d60c8496-6550-46c5-b28d-2673b2487bb8 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:51.841854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d60c8496-6550-46c5-b28d-2673b2487bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:51.905195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 38/74] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:45:51.905962 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c8496-6550-46c5-b28d-2673b2487bb8 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:51.931182 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad9baa-f4cb-48dd-81c1-8b70498600e1 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:51.963013 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60224ffa-cf20-4d09-b2bd-ca188c3eb647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:51.963908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60224ffa-cf20-4d09-b2bd-ca188c3eb647 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:51.964288 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60224ffa-cf20-4d09-b2bd-ca188c3eb647 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:51.964572 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60224ffa-cf20-4d09-b2bd-ca188c3eb647 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:51.974381 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60224ffa-cf20-4d09-b2bd-ca188c3eb647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:45:51.982988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-60224ffa-cf20-4d09-b2bd-ca188c3eb647 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:45:51.982988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:45:51.982988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:45:51.982988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:45:51.982988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:45:51.982988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:45:51.982988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:45:51.982988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:45:51.982988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:45:51.982988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:45:51.982988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:45:51.982988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:45:51.982988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:45:51.982988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:45:51.982988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:45:51.982988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:45:51.983889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:45:51.983889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:45:51.983889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:45:51.983889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:45:51.983889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:45:51.983889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:45:51.983889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:45:51.983889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:45:51.983889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:45:51.983889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:45:51.983889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:45:51.983889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:45:51.983889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:45:51.983889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:45:51.983889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:45:51.983889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:45:51.984702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:45:51.984702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:45:51.984702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:45:51.984702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:45:51.984702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:45:51.984702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:45:51.984702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:45:51.984702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:45:51.984702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:45:51.984702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:45:51.984702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:45:51.984702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:45:51.984702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:45:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:45:51.985349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60224ffa-cf20-4d09-b2bd-ca188c3eb647 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:51.998380 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c8496-6550-46c5-b28d-2673b2487bb8 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:52.030448 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6be53a-db94-4ae6-9b9a-b362ff155371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:52.031561 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6be53a-db94-4ae6-9b9a-b362ff155371 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:52.031843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6be53a-db94-4ae6-9b9a-b362ff155371 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:52.032118 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6be53a-db94-4ae6-9b9a-b362ff155371 None admin] PATH_INFO: `/v3/users/bfaa5ec258f44012bccce1e5ad959ff1` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:52.033352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6be53a-db94-4ae6-9b9a-b362ff155371 None admin] RBAC: Authorizing `identity:get_user(user_id=bfaa5ec258f44012bccce1e5ad959ff1)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:52.034789 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6be53a-db94-4ae6-9b9a-b362ff155371 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:52.036448 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 39/76] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:45:51 2022] GET /identity/v3/users/bfaa5ec258f44012bccce1e5ad959ff1 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:52.037669 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a471b7-f51e-463b-a07a-d1ca3f6ee543 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:52.037961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a471b7-f51e-463b-a07a-d1ca3f6ee543 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:52.038245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a471b7-f51e-463b-a07a-d1ca3f6ee543 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:52.039469 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 40/77] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:52.040734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a471b7-f51e-463b-a07a-d1ca3f6ee543 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:52.082736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60224ffa-cf20-4d09-b2bd-ca188c3eb647 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:52.114515 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c72d76-efec-4d31-a7ae-b2c5b2ae38b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:52.115214 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c72d76-efec-4d31-a7ae-b2c5b2ae38b5 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:52.115507 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c72d76-efec-4d31-a7ae-b2c5b2ae38b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:52.115782 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c72d76-efec-4d31-a7ae-b2c5b2ae38b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:52.135141 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a471b7-f51e-463b-a07a-d1ca3f6ee543 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:52.167395 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d331066-554c-46c8-b98f-076dbbf9c351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:52.168104 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d331066-554c-46c8-b98f-076dbbf9c351 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:52.168411 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d331066-554c-46c8-b98f-076dbbf9c351 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:52.168686 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d331066-554c-46c8-b98f-076dbbf9c351 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:52.178150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d331066-554c-46c8-b98f-076dbbf9c351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:45:52.178635 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c72d76-efec-4d31-a7ae-b2c5b2ae38b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:52.180097 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c72d76-efec-4d31-a7ae-b2c5b2ae38b5 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:52.185704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-1d331066-554c-46c8-b98f-076dbbf9c351 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:45:52.185704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:45:52.185704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:45:52.185704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:45:52.185704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:45:52.185704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:45:52.185704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:45:52.185704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:45:52.185704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:45:52.185704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:45:52.185704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:45:52.185704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:45:52.185704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:45:52.185704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:45:52.185704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:45:52.185704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:45:52.186577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:45:52.186577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:45:52.186577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:45:52.186577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:45:52.186577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:45:52.186577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:45:52.186577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:45:52.186577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:45:52.186577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:45:52.186577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:45:52.186577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:45:52.186577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:45:52.186577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:45:52.186577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:45:52.186577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:45:52.186577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:45:52.187460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:45:52.187460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:45:52.187460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:45:52.187460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:45:52.187460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:45:52.187460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:45:52.187460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:45:52.187460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:45:52.187460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:45:52.187460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:45:52.187460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:45:52.187460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:45:52.187460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 41/78] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:45:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:45:52.188122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d331066-554c-46c8-b98f-076dbbf9c351 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:52.276768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 38/79] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:45:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:45:52.277614 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c72d76-efec-4d31-a7ae-b2c5b2ae38b5 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:52.279918 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d331066-554c-46c8-b98f-076dbbf9c351 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:52.312575 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff348046-6192-41ed-bbef-c3d08c39a815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:52.313236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348046-6192-41ed-bbef-c3d08c39a815 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:52.313524 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348046-6192-41ed-bbef-c3d08c39a815 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:52.313804 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348046-6192-41ed-bbef-c3d08c39a815 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:52.314577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff348046-6192-41ed-bbef-c3d08c39a815 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:52.314885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff348046-6192-41ed-bbef-c3d08c39a815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:52.316272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff348046-6192-41ed-bbef-c3d08c39a815 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:52.325241 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 42/80] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:45:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:52.325759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f854c9-2445-443b-b8d8-51a80901c61e None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:52.326049 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f854c9-2445-443b-b8d8-51a80901c61e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:52.326329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f854c9-2445-443b-b8d8-51a80901c61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:52.342470 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-92f854c9-2445-443b-b8d8-51a80901c61e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:52.343641 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-92f854c9-2445-443b-b8d8-51a80901c61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:52.372759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c72d76-efec-4d31-a7ae-b2c5b2ae38b5 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:52.405356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075ddc1-ad01-4a34-879e-8ed7b735fcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:52.406010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ddc1-ad01-4a34-879e-8ed7b735fcd2 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:52.406557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ddc1-ad01-4a34-879e-8ed7b735fcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:52.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 43/81] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:45:52.407142 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ddc1-ad01-4a34-879e-8ed7b735fcd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:52.409035 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f854c9-2445-443b-b8d8-51a80901c61e None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:52.478511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075ddc1-ad01-4a34-879e-8ed7b735fcd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:52.479900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075ddc1-ad01-4a34-879e-8ed7b735fcd2 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:52.504677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f854c9-2445-443b-b8d8-51a80901c61e None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:52.536731 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acb2e0-ee11-4143-b9f1-cb2ac9d127c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:52.537384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acb2e0-ee11-4143-b9f1-cb2ac9d127c2 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:52.537670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acb2e0-ee11-4143-b9f1-cb2ac9d127c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:52.537946 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acb2e0-ee11-4143-b9f1-cb2ac9d127c2 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:52.538687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5acb2e0-ee11-4143-b9f1-cb2ac9d127c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:52.538993 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5acb2e0-ee11-4143-b9f1-cb2ac9d127c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:52.540914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5acb2e0-ee11-4143-b9f1-cb2ac9d127c2 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:52.548842 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 44/82] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:45:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:52.549419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acb2e0-ee11-4143-b9f1-cb2ac9d127c2 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:52.572824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 39/83] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:45:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:45:52.573646 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075ddc1-ad01-4a34-879e-8ed7b735fcd2 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:52.642037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acb2e0-ee11-4143-b9f1-cb2ac9d127c2 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:52.663973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075ddc1-ad01-4a34-879e-8ed7b735fcd2 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:52.673389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2905c-5e9b-404b-9647-09fe8cfc2496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:52.674244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2905c-5e9b-404b-9647-09fe8cfc2496 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:52.674525 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2905c-5e9b-404b-9647-09fe8cfc2496 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:52.674798 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2905c-5e9b-404b-9647-09fe8cfc2496 None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:52.675977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2905c-5e9b-404b-9647-09fe8cfc2496 None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:52.677449 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2905c-5e9b-404b-9647-09fe8cfc2496 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:52.679118 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 45/84] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:45:52 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:52.679875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2905c-5e9b-404b-9647-09fe8cfc2496 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:52.696714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838a360-c339-4d08-b8cd-85779f2db4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:52.697584 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838a360-c339-4d08-b8cd-85779f2db4d4 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:52.697868 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838a360-c339-4d08-b8cd-85779f2db4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:52.698143 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838a360-c339-4d08-b8cd-85779f2db4d4 None admin] PATH_INFO: `/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:52.699330 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838a360-c339-4d08-b8cd-85779f2db4d4 None admin] RBAC: Authorizing `identity:get_user(user_id=f8ba6a1b884747dbaf2896a3adc5c00f)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:52.700805 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838a360-c339-4d08-b8cd-85779f2db4d4 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:52.702410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 40/85] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:45:52 2022] GET /identity/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f => generated 275 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:52.703153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838a360-c339-4d08-b8cd-85779f2db4d4 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:52.773299 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2905c-5e9b-404b-9647-09fe8cfc2496 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:52.795546 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838a360-c339-4d08-b8cd-85779f2db4d4 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:52.805385 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e279484-0010-41b6-aeac-c6c74d884cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:52.806206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e279484-0010-41b6-aeac-c6c74d884cab None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:52.806492 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e279484-0010-41b6-aeac-c6c74d884cab None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:52.806771 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e279484-0010-41b6-aeac-c6c74d884cab None admin] PATH_INFO: `/v3/domains/default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:52.807940 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e279484-0010-41b6-aeac-c6c74d884cab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:52.809419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e279484-0010-41b6-aeac-c6c74d884cab None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:52.811033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 46/86] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:45:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:52.811792 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e279484-0010-41b6-aeac-c6c74d884cab None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:52.827606 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5988292-95da-4bba-ae03-3a793833188b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:52.828582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5988292-95da-4bba-ae03-3a793833188b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:52.828959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5988292-95da-4bba-ae03-3a793833188b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:52.829243 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5988292-95da-4bba-ae03-3a793833188b None admin] PATH_INFO: `/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:52.830421 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5988292-95da-4bba-ae03-3a793833188b None admin] RBAC: Authorizing `identity:get_user(user_id=f8ba6a1b884747dbaf2896a3adc5c00f)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:52.831834 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5988292-95da-4bba-ae03-3a793833188b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:52.833469 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 41/87] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:45:52 2022] GET /identity/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f => generated 275 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:52.834211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5988292-95da-4bba-ae03-3a793833188b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:52.911679 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e279484-0010-41b6-aeac-c6c74d884cab None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:52.926614 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5988292-95da-4bba-ae03-3a793833188b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:52.943322 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3629782-9cc5-447f-9c31-1262c5abd5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:52.944194 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629782-9cc5-447f-9c31-1262c5abd5d7 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:52.944491 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629782-9cc5-447f-9c31-1262c5abd5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:52.944769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629782-9cc5-447f-9c31-1262c5abd5d7 None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:52.946029 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3629782-9cc5-447f-9c31-1262c5abd5d7 None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:52.947482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3629782-9cc5-447f-9c31-1262c5abd5d7 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:52.949205 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 47/88] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:45:52 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:52.949963 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3629782-9cc5-447f-9c31-1262c5abd5d7 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:52.958186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e8c8c-1c87-43ad-870f-beb10fcc28cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:52.958841 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e8c8c-1c87-43ad-870f-beb10fcc28cd None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:52.959122 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e8c8c-1c87-43ad-870f-beb10fcc28cd None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:52.959395 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e8c8c-1c87-43ad-870f-beb10fcc28cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:52.960246 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e8c8c-1c87-43ad-870f-beb10fcc28cd None admin] RBAC: Adding query filter params (role.id=15845f6e13b44ef7893159f660311b15, scope.project.id=bd162913396140aca4b3f16233ad0c64, user.id=f8ba6a1b884747dbaf2896a3adc5c00f) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:52.960558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e8c8c-1c87-43ad-870f-beb10fcc28cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:52.962515 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e8c8c-1c87-43ad-870f-beb10fcc28cd None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:52.967769 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 42/89] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:45:52 2022] GET /identity/v3/role_assignments?user.id=f8ba6a1b884747dbaf2896a3adc5c00f&scope.project.id=bd162913396140aca4b3f16233ad0c64&role.id=15845f6e13b44ef7893159f660311b15 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:52.968539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e8c8c-1c87-43ad-870f-beb10fcc28cd None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:53.056306 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3629782-9cc5-447f-9c31-1262c5abd5d7 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:53.074520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e8c8c-1c87-43ad-870f-beb10fcc28cd None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:53.091112 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83224f-5025-4e0d-abff-d28f76cd2294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:53.091781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83224f-5025-4e0d-abff-d28f76cd2294 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:53.092068 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83224f-5025-4e0d-abff-d28f76cd2294 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:53.092371 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83224f-5025-4e0d-abff-d28f76cd2294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:53.110004 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594aef6-62a0-44a7-92d8-be63e54054c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:53.110807 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594aef6-62a0-44a7-92d8-be63e54054c9 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:53.111162 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594aef6-62a0-44a7-92d8-be63e54054c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:53.111536 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594aef6-62a0-44a7-92d8-be63e54054c9 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:53.112370 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594aef6-62a0-44a7-92d8-be63e54054c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:53.113819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594aef6-62a0-44a7-92d8-be63e54054c9 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:53.140473 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 43/90] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:45:52 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:45:53.140473 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594aef6-62a0-44a7-92d8-be63e54054c9 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:53.167981 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83224f-5025-4e0d-abff-d28f76cd2294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:53.169536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83224f-5025-4e0d-abff-d28f76cd2294 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:53.245196 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594aef6-62a0-44a7-92d8-be63e54054c9 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:53.280875 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509ee7c-8fea-4861-9544-c89c18119da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:53.281816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ee7c-8fea-4861-9544-c89c18119da5 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:53.282505 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ee7c-8fea-4861-9544-c89c18119da5 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:53.282806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ee7c-8fea-4861-9544-c89c18119da5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:53.298079 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 48/91] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:45:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:45:53.299380 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83224f-5025-4e0d-abff-d28f76cd2294 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:53.362238 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509ee7c-8fea-4861-9544-c89c18119da5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:53.363964 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509ee7c-8fea-4861-9544-c89c18119da5 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:53.429793 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83224f-5025-4e0d-abff-d28f76cd2294 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:53.474135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 44/92] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:45:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:45:53.475278 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509ee7c-8fea-4861-9544-c89c18119da5 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:53.475472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c79ff6-f511-4efd-afc2-34f1ab931c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:53.476144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c79ff6-f511-4efd-afc2-34f1ab931c7a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:53.476459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c79ff6-f511-4efd-afc2-34f1ab931c7a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:53.476744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c79ff6-f511-4efd-afc2-34f1ab931c7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:53.478133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c79ff6-f511-4efd-afc2-34f1ab931c7a None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=bd162913396140aca4b3f16233ad0c64, user.id=bfaa5ec258f44012bccce1e5ad959ff1) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:53.478452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c79ff6-f511-4efd-afc2-34f1ab931c7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:53.479921 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c79ff6-f511-4efd-afc2-34f1ab931c7a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:53.486181 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 49/93] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:45:53 2022] GET /identity/v3/role_assignments?user.id=bfaa5ec258f44012bccce1e5ad959ff1&scope.project.id=bd162913396140aca4b3f16233ad0c64&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:53.486626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c79ff6-f511-4efd-afc2-34f1ab931c7a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:53.608455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c79ff6-f511-4efd-afc2-34f1ab931c7a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:53.609783 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509ee7c-8fea-4861-9544-c89c18119da5 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:53.652759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4337f7-5ab6-4bca-94bc-3bbe54dccd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:53.653644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4337f7-5ab6-4bca-94bc-3bbe54dccd3c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:53.654041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4337f7-5ab6-4bca-94bc-3bbe54dccd3c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:53.654325 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4337f7-5ab6-4bca-94bc-3bbe54dccd3c None admin] PATH_INFO: `/v3/projects/b4b2a644156b4fd9872353a96b930245` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:53.654424 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3497e-b98d-487e-be65-e76df4c55765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:53.655367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3497e-b98d-487e-be65-e76df4c55765 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:53.655548 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4337f7-5ab6-4bca-94bc-3bbe54dccd3c None admin] RBAC: Authorizing `identity:get_project(project_id=b4b2a644156b4fd9872353a96b930245)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:53.655722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3497e-b98d-487e-be65-e76df4c55765 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:53.656378 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3497e-b98d-487e-be65-e76df4c55765 None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:53.657571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3497e-b98d-487e-be65-e76df4c55765 None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:53.657684 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4337f7-5ab6-4bca-94bc-3bbe54dccd3c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:53.659007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3497e-b98d-487e-be65-e76df4c55765 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:53.659341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 50/94] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:45:53 2022] GET /identity/v3/projects/b4b2a644156b4fd9872353a96b930245 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:53.660751 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 45/95] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:45:53 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:53.666300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4337f7-5ab6-4bca-94bc-3bbe54dccd3c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:53.668909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3497e-b98d-487e-be65-e76df4c55765 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:53.786234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4337f7-5ab6-4bca-94bc-3bbe54dccd3c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:53.788427 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3497e-b98d-487e-be65-e76df4c55765 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:53.824509 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628cd0d-d3c1-469d-af2c-20c425687fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:53.825443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628cd0d-d3c1-469d-af2c-20c425687fd1 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:53.825829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628cd0d-d3c1-469d-af2c-20c425687fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:53.826229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628cd0d-d3c1-469d-af2c-20c425687fd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:53.827393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628cd0d-d3c1-469d-af2c-20c425687fd1 None admin] RBAC: Adding query filter params (role.id=c8015925658a407b9977b5b0a7f50f05, scope.project.id=bd162913396140aca4b3f16233ad0c64, user.id=f8ba6a1b884747dbaf2896a3adc5c00f) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:53.827809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628cd0d-d3c1-469d-af2c-20c425687fd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:53.828413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced410a-2a18-4f50-b091-dcde9bd1781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:53.829076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced410a-2a18-4f50-b091-dcde9bd1781d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:53.829366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced410a-2a18-4f50-b091-dcde9bd1781d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:53.829645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced410a-2a18-4f50-b091-dcde9bd1781d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:53.829746 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628cd0d-d3c1-469d-af2c-20c425687fd1 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:53.830486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced410a-2a18-4f50-b091-dcde9bd1781d None admin] RBAC: Adding query filter params (role.id=15845f6e13b44ef7893159f660311b15, scope.project.id=b4b2a644156b4fd9872353a96b930245, user.id=f8ba6a1b884747dbaf2896a3adc5c00f) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:53.830798 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced410a-2a18-4f50-b091-dcde9bd1781d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:53.832472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced410a-2a18-4f50-b091-dcde9bd1781d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:53.835937 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 46/96] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:45:53 2022] GET /identity/v3/role_assignments?user.id=f8ba6a1b884747dbaf2896a3adc5c00f&scope.project.id=bd162913396140aca4b3f16233ad0c64&role.id=c8015925658a407b9977b5b0a7f50f05 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:45:53.843849 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 51/97] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:45:53 2022] GET /identity/v3/role_assignments?user.id=f8ba6a1b884747dbaf2896a3adc5c00f&scope.project.id=b4b2a644156b4fd9872353a96b930245&role.id=15845f6e13b44ef7893159f660311b15 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:45:55.471280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff354d-89de-4d11-bb3f-188321b9149e None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:55.471793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff354d-89de-4d11-bb3f-188321b9149e None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:55.471866 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff354d-89de-4d11-bb3f-188321b9149e None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:55.473609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 47/98] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:55.479351 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04078689-b4a0-4968-bed9-6b20a04be0fc None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:55.479836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04078689-b4a0-4968-bed9-6b20a04be0fc None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:55.479909 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04078689-b4a0-4968-bed9-6b20a04be0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:55.496847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-04078689-b4a0-4968-bed9-6b20a04be0fc None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:55.498201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-04078689-b4a0-4968-bed9-6b20a04be0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:55.580961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 52/99] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:45:55.603699 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff354d-89de-4d11-bb3f-188321b9149e None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:55.710714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff354d-89de-4d11-bb3f-188321b9149e None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:55.745390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8770077-c4d7-4717-a0c4-9ff2872b22af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:55.746200 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8770077-c4d7-4717-a0c4-9ff2872b22af None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:55.746482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8770077-c4d7-4717-a0c4-9ff2872b22af None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:55.746756 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8770077-c4d7-4717-a0c4-9ff2872b22af None admin] PATH_INFO: `/v3/roles/member` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:55.757211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8770077-c4d7-4717-a0c4-9ff2872b22af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:45:55.765830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-d8770077-c4d7-4717-a0c4-9ff2872b22af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:45:55.765830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:45:55.765830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:45:55.765830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:45:55.765830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:45:55.765830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:45:55.765830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:45:55.765830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:45:55.765830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:45:55.765830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:45:55.765830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:45:55.765830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:45:55.765830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:45:55.765830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:45:55.765830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:45:55.765830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:45:55.766703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:45:55.766703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:45:55.766703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:45:55.766703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:45:55.766703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:45:55.766703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:45:55.766703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:45:55.766703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:45:55.766703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:45:55.766703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:45:55.766703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:45:55.766703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:45:55.766703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:45:55.766703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:45:55.766703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:45:55.766703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:45:55.767489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:45:55.767489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:45:55.767489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:45:55.767489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:45:55.767489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:45:55.767489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:45:55.767489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:45:55.767489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:45:55.767489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:45:55.767489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:45:55.767489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:45:55.767489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:45:55.767489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 48/100] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:45:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:45:55.772774 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04078689-b4a0-4968-bed9-6b20a04be0fc None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:55.873340 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04078689-b4a0-4968-bed9-6b20a04be0fc None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:55.908580 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c55fd1-8183-4bfb-b925-0475c0c2a905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:55.909253 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c55fd1-8183-4bfb-b925-0475c0c2a905 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:55.909539 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c55fd1-8183-4bfb-b925-0475c0c2a905 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:55.909815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c55fd1-8183-4bfb-b925-0475c0c2a905 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:55.910572 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c55fd1-8183-4bfb-b925-0475c0c2a905 None admin] RBAC: Adding query filter params (name=member) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:55.910881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c55fd1-8183-4bfb-b925-0475c0c2a905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:55.912289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c55fd1-8183-4bfb-b925-0475c0c2a905 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:55.921298 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 53/101] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:45:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:55.926799 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8770077-c4d7-4717-a0c4-9ff2872b22af None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:56.026827 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8770077-c4d7-4717-a0c4-9ff2872b22af None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:56.060805 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870c4f2-41fd-4d61-993a-7075d82816b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:56.061694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870c4f2-41fd-4d61-993a-7075d82816b0 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:56.061979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870c4f2-41fd-4d61-993a-7075d82816b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:56.062257 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870c4f2-41fd-4d61-993a-7075d82816b0 None admin] PATH_INFO: `/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:56.063487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870c4f2-41fd-4d61-993a-7075d82816b0 None admin] RBAC: Authorizing `identity:get_user(user_id=f8ba6a1b884747dbaf2896a3adc5c00f)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:56.065118 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870c4f2-41fd-4d61-993a-7075d82816b0 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:56.066773 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 49/102] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:45:55 2022] GET /identity/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:56.072274 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c55fd1-8183-4bfb-b925-0475c0c2a905 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:56.174751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c55fd1-8183-4bfb-b925-0475c0c2a905 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:56.210012 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8585c-6de8-4f0e-9996-0e2659e788b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:56.210885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8585c-6de8-4f0e-9996-0e2659e788b4 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:56.211177 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8585c-6de8-4f0e-9996-0e2659e788b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:56.211492 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8585c-6de8-4f0e-9996-0e2659e788b4 None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:56.212724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8585c-6de8-4f0e-9996-0e2659e788b4 None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:56.214187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8585c-6de8-4f0e-9996-0e2659e788b4 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:56.215902 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 54/103] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:45:56 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:56.221785 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870c4f2-41fd-4d61-993a-7075d82816b0 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:56.324612 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870c4f2-41fd-4d61-993a-7075d82816b0 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:56.363209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f2d6f-f5c9-47f2-a195-aa887cc4c1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:56.364120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f2d6f-f5c9-47f2-a195-aa887cc4c1c6 None admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:56.364429 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f2d6f-f5c9-47f2-a195-aa887cc4c1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:56.364710 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f2d6f-f5c9-47f2-a195-aa887cc4c1c6 None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64/users/f8ba6a1b884747dbaf2896a3adc5c00f/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:56.366931 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f2d6f-f5c9-47f2-a195-aa887cc4c1c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd162913396140aca4b3f16233ad0c64, user_id=f8ba6a1b884747dbaf2896a3adc5c00f, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:56.369002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f2d6f-f5c9-47f2-a195-aa887cc4c1c6 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:56.398595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 50/104] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:45:56 2022] PUT /identity/v3/projects/bd162913396140aca4b3f16233ad0c64/users/f8ba6a1b884747dbaf2896a3adc5c00f/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 13:45:56.605535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b1df9-2016-4118-8a28-a79a21297e99 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:56.606316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b1df9-2016-4118-8a28-a79a21297e99 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:56.606316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b1df9-2016-4118-8a28-a79a21297e99 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:56.607386 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 55/105] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:56.613052 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddf420-e19f-4f0b-9cba-7587a910e366 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:56.613584 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddf420-e19f-4f0b-9cba-7587a910e366 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:56.613753 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddf420-e19f-4f0b-9cba-7587a910e366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:56.645265 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-bcddf420-e19f-4f0b-9cba-7587a910e366 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:56.646510 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-bcddf420-e19f-4f0b-9cba-7587a910e366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:56.731956 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 51/106] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:45:56.765929 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b1df9-2016-4118-8a28-a79a21297e99 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:56.912219 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b1df9-2016-4118-8a28-a79a21297e99 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:56.947963 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfe421-d232-4b06-8aaf-feb81175fbf6 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:56.948306 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfe421-d232-4b06-8aaf-feb81175fbf6 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:56.948613 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfe421-d232-4b06-8aaf-feb81175fbf6 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:56.950223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 52/107] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:56.955243 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0dddc-f8bb-44f9-8a57-50b0a2f61d1c None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:56.955527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0dddc-f8bb-44f9-8a57-50b0a2f61d1c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:56.955804 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0dddc-f8bb-44f9-8a57-50b0a2f61d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:56.960863 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafaf000-292e-4f03-8920-c0dbc47989ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:56.961705 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafaf000-292e-4f03-8920-c0dbc47989ec None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:56.961991 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafaf000-292e-4f03-8920-c0dbc47989ec None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:56.962268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafaf000-292e-4f03-8920-c0dbc47989ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:56.985918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-e2b0dddc-f8bb-44f9-8a57-50b0a2f61d1c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:56.986216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafaf000-292e-4f03-8920-c0dbc47989ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:45:56.987166 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e2b0dddc-f8bb-44f9-8a57-50b0a2f61d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:56.994175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-dafaf000-292e-4f03-8920-c0dbc47989ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:45:56.994175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:45:56.994175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:45:56.994175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:45:56.994175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:45:56.994175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:45:56.994175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:45:56.994175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:45:56.994175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:45:56.994175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:45:56.994175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:45:56.994175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:45:56.994175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:45:56.994175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:45:56.994175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:45:56.994175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:45:56.996271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:45:56.996271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:45:56.996271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:45:56.996271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:45:56.996271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:45:56.996271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:45:56.996271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:45:56.996271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:45:56.996271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:45:56.996271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:45:56.996271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:45:56.996271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:45:56.996271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:45:56.996271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:45:56.996271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:45:56.996271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:45:56.998211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:45:56.998211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:45:56.998211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:45:56.998211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:45:56.998211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:45:56.998211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:45:56.998211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:45:56.998211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:45:56.998211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:45:56.998211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:45:56.998211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:45:56.998211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:45:57.004202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 56/108] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:45:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:45:57.005131 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafaf000-292e-4f03-8920-c0dbc47989ec None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:57.140151 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 53/109] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:45:57.175635 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0dddc-f8bb-44f9-8a57-50b0a2f61d1c None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:57.231971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafaf000-292e-4f03-8920-c0dbc47989ec None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:57.300542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4c54b-bef0-4fbb-8f9d-b6434834468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:57.301222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4c54b-bef0-4fbb-8f9d-b6434834468c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:57.301504 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4c54b-bef0-4fbb-8f9d-b6434834468c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:57.301779 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4c54b-bef0-4fbb-8f9d-b6434834468c None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:57.302534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4c54b-bef0-4fbb-8f9d-b6434834468c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:57.302843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4c54b-bef0-4fbb-8f9d-b6434834468c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:57.304263 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4c54b-bef0-4fbb-8f9d-b6434834468c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:57.316595 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 57/110] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:45:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:57.318246 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c9c0-a074-4599-bbf1-de731b84819d None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:57.318750 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c9c0-a074-4599-bbf1-de731b84819d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:57.319397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c9c0-a074-4599-bbf1-de731b84819d None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:57.322054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 58/111] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:57.323555 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca58c3-eacd-4acf-8076-ebf34e12f8be None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:57.324079 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca58c3-eacd-4acf-8076-ebf34e12f8be None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:57.324590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca58c3-eacd-4acf-8076-ebf34e12f8be None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:57.326560 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 59/112] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:57.327005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca58c3-eacd-4acf-8076-ebf34e12f8be None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:57.362542 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0dddc-f8bb-44f9-8a57-50b0a2f61d1c None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:57.411005 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877fdbd-73ca-4b53-9ca9-81998e4f8019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:57.412405 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877fdbd-73ca-4b53-9ca9-81998e4f8019 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:57.412945 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877fdbd-73ca-4b53-9ca9-81998e4f8019 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:57.413277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877fdbd-73ca-4b53-9ca9-81998e4f8019 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:57.426000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877fdbd-73ca-4b53-9ca9-81998e4f8019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:45:57.434150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-1877fdbd-73ca-4b53-9ca9-81998e4f8019 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:45:57.434150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:45:57.434150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:45:57.434150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:45:57.434150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:45:57.434150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:45:57.434150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:45:57.434150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:45:57.434150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:45:57.434150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:45:57.434150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:45:57.434150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:45:57.434150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:45:57.434150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:45:57.434150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:45:57.434150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:45:57.435022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:45:57.435022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:45:57.435022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:45:57.435022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:45:57.435022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:45:57.435022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:45:57.435022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:45:57.435022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:45:57.435022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:45:57.435022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:45:57.435022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:45:57.435022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:45:57.435022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:45:57.435022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:45:57.435022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:45:57.435022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:45:57.435793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:45:57.435793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:45:57.435793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:45:57.435793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:45:57.435793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:45:57.435793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:45:57.435793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:45:57.435793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:45:57.435793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:45:57.435793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:45:57.435793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:45:57.435793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:45:57.435793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 54/113] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:45:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:45:57.437010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a690b3-dce8-431f-a550-18dc7e4582c3 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:57.437010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a690b3-dce8-431f-a550-18dc7e4582c3 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:57.437170 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a690b3-dce8-431f-a550-18dc7e4582c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:57.452424 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca58c3-eacd-4acf-8076-ebf34e12f8be None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:57.461927 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-26a690b3-dce8-431f-a550-18dc7e4582c3 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:57.463812 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-26a690b3-dce8-431f-a550-18dc7e4582c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:57.491187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d459e-4838-47e8-a846-2d720593dbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:57.492479 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d459e-4838-47e8-a846-2d720593dbba None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:57.492772 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d459e-4838-47e8-a846-2d720593dbba None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:57.493050 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d459e-4838-47e8-a846-2d720593dbba None admin] PATH_INFO: `/v3/users/a01d312a58a44fd4a52ddd378f1ca51c` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:57.512871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d459e-4838-47e8-a846-2d720593dbba None admin] RBAC: Authorizing `identity:get_user(user_id=a01d312a58a44fd4a52ddd378f1ca51c)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:57.514355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d459e-4838-47e8-a846-2d720593dbba None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:57.517059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 60/114] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:45:57 2022] GET /identity/v3/users/a01d312a58a44fd4a52ddd378f1ca51c => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:57.518192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d208685-aab0-4b75-bd74-5bf1d6392b9d None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:57.518483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d208685-aab0-4b75-bd74-5bf1d6392b9d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:57.518767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d208685-aab0-4b75-bd74-5bf1d6392b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:57.542554 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-8d208685-aab0-4b75-bd74-5bf1d6392b9d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:57.544023 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8d208685-aab0-4b75-bd74-5bf1d6392b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:57.550329 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 55/115] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:45:57.551221 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a690b3-dce8-431f-a550-18dc7e4582c3 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:57.630890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 61/116] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:45:57.631756 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d208685-aab0-4b75-bd74-5bf1d6392b9d None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:57.666176 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a690b3-dce8-431f-a550-18dc7e4582c3 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:57.700148 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f509d42-b36c-4a9d-a0d0-21ef8261b327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:57.700808 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f509d42-b36c-4a9d-a0d0-21ef8261b327 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:57.701091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f509d42-b36c-4a9d-a0d0-21ef8261b327 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:57.701364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f509d42-b36c-4a9d-a0d0-21ef8261b327 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:57.702109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f509d42-b36c-4a9d-a0d0-21ef8261b327 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:57.702413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f509d42-b36c-4a9d-a0d0-21ef8261b327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:57.703812 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f509d42-b36c-4a9d-a0d0-21ef8261b327 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:57.713089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 56/117] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:45:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:57.717073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f509d42-b36c-4a9d-a0d0-21ef8261b327 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:57.735699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d208685-aab0-4b75-bd74-5bf1d6392b9d None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:57.767859 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fb5f6-4cdb-4ee0-b544-309adf7149b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:57.768540 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fb5f6-4cdb-4ee0-b544-309adf7149b9 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:57.768826 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fb5f6-4cdb-4ee0-b544-309adf7149b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:57.769107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fb5f6-4cdb-4ee0-b544-309adf7149b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:57.814794 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f509d42-b36c-4a9d-a0d0-21ef8261b327 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:57.838292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fb5f6-4cdb-4ee0-b544-309adf7149b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:57.839767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fb5f6-4cdb-4ee0-b544-309adf7149b9 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:57.847287 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0485ba-d2cf-4091-8e47-b0aa31626298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:57.848102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0485ba-d2cf-4091-8e47-b0aa31626298 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:57.848457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0485ba-d2cf-4091-8e47-b0aa31626298 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:57.848742 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0485ba-d2cf-4091-8e47-b0aa31626298 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:57.859009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0485ba-d2cf-4091-8e47-b0aa31626298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:45:57.866975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-2a0485ba-d2cf-4091-8e47-b0aa31626298 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:45:57.866975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:45:57.866975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:45:57.866975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:45:57.866975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:45:57.866975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:45:57.866975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:45:57.866975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:45:57.866975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:45:57.866975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:45:57.866975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:45:57.866975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:45:57.866975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:45:57.866975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:45:57.866975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:45:57.866975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:45:57.867877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:45:57.867877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:45:57.867877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:45:57.867877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:45:57.867877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:45:57.867877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:45:57.867877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:45:57.867877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:45:57.867877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:45:57.867877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:45:57.867877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:45:57.867877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:45:57.867877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:45:57.867877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:45:57.867877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:45:57.867877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:45:57.868692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:45:57.868692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:45:57.868692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:45:57.868692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:45:57.868692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:45:57.868692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:45:57.868692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:45:57.868692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:45:57.868692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:45:57.868692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:45:57.868692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:45:57.868692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:45:57.868692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 57/118] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:45:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:45:57.869350 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0485ba-d2cf-4091-8e47-b0aa31626298 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:57.949666 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 62/119] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:45:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:45:57.950587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784f30f-2b40-427b-981f-0c44b031a15b None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:57.950826 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784f30f-2b40-427b-981f-0c44b031a15b None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:57.951278 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784f30f-2b40-427b-981f-0c44b031a15b None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:57.956214 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 63/120] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:57.956214 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784f30f-2b40-427b-981f-0c44b031a15b None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:57.969437 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0485ba-d2cf-4091-8e47-b0aa31626298 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:58.002633 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbd37b-3a5a-49a4-ba53-3981775a9df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:58.003427 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbd37b-3a5a-49a4-ba53-3981775a9df5 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:58.003706 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbd37b-3a5a-49a4-ba53-3981775a9df5 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:58.003983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbd37b-3a5a-49a4-ba53-3981775a9df5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:58.005298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbd37b-3a5a-49a4-ba53-3981775a9df5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:58.006732 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbd37b-3a5a-49a4-ba53-3981775a9df5 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:58.008382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 58/121] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:45:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:58.009134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbd37b-3a5a-49a4-ba53-3981775a9df5 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:58.059649 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784f30f-2b40-427b-981f-0c44b031a15b None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:58.099309 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a0496-244b-458e-9b47-a6ca247e8ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:58.100543 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a0496-244b-458e-9b47-a6ca247e8ba6 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:58.100832 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a0496-244b-458e-9b47-a6ca247e8ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:58.101105 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a0496-244b-458e-9b47-a6ca247e8ba6 None admin] PATH_INFO: `/v3/users/bfaa5ec258f44012bccce1e5ad959ff1` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:58.102318 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a0496-244b-458e-9b47-a6ca247e8ba6 None admin] RBAC: Authorizing `identity:get_user(user_id=bfaa5ec258f44012bccce1e5ad959ff1)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:58.103777 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a0496-244b-458e-9b47-a6ca247e8ba6 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:58.105725 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 64/122] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:45:57 2022] GET /identity/v3/users/bfaa5ec258f44012bccce1e5ad959ff1 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:58.106381 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a0496-244b-458e-9b47-a6ca247e8ba6 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:58.115415 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbd37b-3a5a-49a4-ba53-3981775a9df5 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:58.149125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b80b35-e737-4fdd-b78a-8038aa862ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:58.149800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b80b35-e737-4fdd-b78a-8038aa862ce6 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:58.150085 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b80b35-e737-4fdd-b78a-8038aa862ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:58.150366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b80b35-e737-4fdd-b78a-8038aa862ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:58.151114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b80b35-e737-4fdd-b78a-8038aa862ce6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:58.151422 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b80b35-e737-4fdd-b78a-8038aa862ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:58.152824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b80b35-e737-4fdd-b78a-8038aa862ce6 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:58.165810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 59/123] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:45:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:58.165810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc005fd-cf9f-4094-bcec-339b75d3ea41 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:58.165810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc005fd-cf9f-4094-bcec-339b75d3ea41 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:58.165810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc005fd-cf9f-4094-bcec-339b75d3ea41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:58.180882 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-6bc005fd-cf9f-4094-bcec-339b75d3ea41 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:58.182067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-6bc005fd-cf9f-4094-bcec-339b75d3ea41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:58.208196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a0496-244b-458e-9b47-a6ca247e8ba6 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:58.241331 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ccaf7-0e1f-4141-9e3a-694a9db21b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:58.242192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ccaf7-0e1f-4141-9e3a-694a9db21b07 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:58.242539 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ccaf7-0e1f-4141-9e3a-694a9db21b07 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:58.242869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ccaf7-0e1f-4141-9e3a-694a9db21b07 None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:58.244092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ccaf7-0e1f-4141-9e3a-694a9db21b07 None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:58.245616 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ccaf7-0e1f-4141-9e3a-694a9db21b07 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:58.252227 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 60/124] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:45:58.252369 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 65/125] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:45:58 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:58.252369 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ccaf7-0e1f-4141-9e3a-694a9db21b07 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:58.252512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc005fd-cf9f-4094-bcec-339b75d3ea41 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:58.349646 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc005fd-cf9f-4094-bcec-339b75d3ea41 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:58.370910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ccaf7-0e1f-4141-9e3a-694a9db21b07 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:58.386568 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6286200-fb70-48e6-ae4b-f2b8cf240c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:58.387394 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6286200-fb70-48e6-ae4b-f2b8cf240c30 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:58.387780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6286200-fb70-48e6-ae4b-f2b8cf240c30 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:58.389551 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6286200-fb70-48e6-ae4b-f2b8cf240c30 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:58.389551 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6286200-fb70-48e6-ae4b-f2b8cf240c30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:58.391140 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6286200-fb70-48e6-ae4b-f2b8cf240c30 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:58.406532 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53d239-9bcc-42ff-8287-ff3c3b69e7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:58.407700 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53d239-9bcc-42ff-8287-ff3c3b69e7e0 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:58.408234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53d239-9bcc-42ff-8287-ff3c3b69e7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:58.408718 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53d239-9bcc-42ff-8287-ff3c3b69e7e0 None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:58.410163 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53d239-9bcc-42ff-8287-ff3c3b69e7e0 None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:58.411865 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53d239-9bcc-42ff-8287-ff3c3b69e7e0 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:58.413763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 66/126] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:45:58 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:58.414498 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53d239-9bcc-42ff-8287-ff3c3b69e7e0 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:58.419518 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 61/127] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 13:45:58 2022] POST /identity/v3/projects => generated 302 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:45:58.420561 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6286200-fb70-48e6-ae4b-f2b8cf240c30 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:58.539730 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53d239-9bcc-42ff-8287-ff3c3b69e7e0 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:58.545617 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6286200-fb70-48e6-ae4b-f2b8cf240c30 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:58.577355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce37b1-ac79-4915-b5b5-ae7bb803bae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:58.578666 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce37b1-ac79-4915-b5b5-ae7bb803bae0 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:58.579099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce37b1-ac79-4915-b5b5-ae7bb803bae0 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:58.579519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce37b1-ac79-4915-b5b5-ae7bb803bae0 None admin] PATH_INFO: `/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:58.581421 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce37b1-ac79-4915-b5b5-ae7bb803bae0 None admin] RBAC: Authorizing `identity:get_user(user_id=f8ba6a1b884747dbaf2896a3adc5c00f)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:58.583377 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce37b1-ac79-4915-b5b5-ae7bb803bae0 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:58.583621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea3b76-d8f0-44df-9994-3ada0152e2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:58.584468 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea3b76-d8f0-44df-9994-3ada0152e2ff None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:58.584855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea3b76-d8f0-44df-9994-3ada0152e2ff None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:58.585242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea3b76-d8f0-44df-9994-3ada0152e2ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:58.585967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 67/128] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:45:58 2022] GET /identity/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:58.590651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea3b76-d8f0-44df-9994-3ada0152e2ff None admin] RBAC: Adding query filter params (role.id=97d9563192e147dda2ea8cd2d201552c, scope.project.id=bd162913396140aca4b3f16233ad0c64, user.id=a01d312a58a44fd4a52ddd378f1ca51c) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:58.590651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea3b76-d8f0-44df-9994-3ada0152e2ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:58.590651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea3b76-d8f0-44df-9994-3ada0152e2ff None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:58.592066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce37b1-ac79-4915-b5b5-ae7bb803bae0 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:58.595666 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 62/129] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:45:58 2022] GET /identity/v3/role_assignments?user.id=a01d312a58a44fd4a52ddd378f1ca51c&scope.project.id=bd162913396140aca4b3f16233ad0c64&role.id=97d9563192e147dda2ea8cd2d201552c => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:58.601896 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea3b76-d8f0-44df-9994-3ada0152e2ff None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:58.720896 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea3b76-d8f0-44df-9994-3ada0152e2ff None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:58.723892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce37b1-ac79-4915-b5b5-ae7bb803bae0 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:58.757358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d73484-4922-4235-86e1-fa0464305d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:58.758840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d73484-4922-4235-86e1-fa0464305d87 None admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:58.759123 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d73484-4922-4235-86e1-fa0464305d87 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:58.759465 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d73484-4922-4235-86e1-fa0464305d87 None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64/users/bfaa5ec258f44012bccce1e5ad959ff1/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:58.761436 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d73484-4922-4235-86e1-fa0464305d87 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd162913396140aca4b3f16233ad0c64, user_id=bfaa5ec258f44012bccce1e5ad959ff1, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:58.762165 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57cebf-6f15-4dba-b8af-54e96b030b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:58.762907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d73484-4922-4235-86e1-fa0464305d87 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:58.763171 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57cebf-6f15-4dba-b8af-54e96b030b3f None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:58.763554 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57cebf-6f15-4dba-b8af-54e96b030b3f None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:58.763933 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57cebf-6f15-4dba-b8af-54e96b030b3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:58.780183 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57cebf-6f15-4dba-b8af-54e96b030b3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:45:58.784715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 63/130] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:45:58 2022] PUT /identity/v3/projects/bd162913396140aca4b3f16233ad0c64/users/bfaa5ec258f44012bccce1e5ad959ff1/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:45:58.786680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d73484-4922-4235-86e1-fa0464305d87 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:58.794087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-4c57cebf-6f15-4dba-b8af-54e96b030b3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:45:58.794087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:45:58.794087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:45:58.794087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:45:58.794087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:45:58.794087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:45:58.794087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:45:58.794087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:45:58.794087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:45:58.794087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:45:58.794087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:45:58.794087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:45:58.794087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:45:58.794087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:45:58.794087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:45:58.794087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:45:58.795196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:45:58.795196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:45:58.795196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:45:58.795196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:45:58.795196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:45:58.795196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:45:58.795196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:45:58.795196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:45:58.795196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:45:58.795196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:45:58.795196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:45:58.795196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:45:58.795196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:45:58.795196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:45:58.795196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:45:58.795196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:45:58.796316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:45:58.796316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:45:58.796316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:45:58.796316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:45:58.796316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:45:58.796316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:45:58.796316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:45:58.796316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:45:58.796316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:45:58.796316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:45:58.796316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:45:58.796316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:45:58.798319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 68/131] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:45:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:45:58.808364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57cebf-6f15-4dba-b8af-54e96b030b3f None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:58.971605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d73484-4922-4235-86e1-fa0464305d87 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:59.006167 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57cebf-6f15-4dba-b8af-54e96b030b3f None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:59.029668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde86b27-c790-4a70-bdbc-7ede28939fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:59.030556 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde86b27-c790-4a70-bdbc-7ede28939fbb None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:59.030837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde86b27-c790-4a70-bdbc-7ede28939fbb None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:59.031367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde86b27-c790-4a70-bdbc-7ede28939fbb None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:59.033253 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde86b27-c790-4a70-bdbc-7ede28939fbb None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:59.034749 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde86b27-c790-4a70-bdbc-7ede28939fbb None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:59.039049 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 64/132] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:45:58 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:45:59.043888 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde86b27-c790-4a70-bdbc-7ede28939fbb None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:59.070775 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77637f-4f7e-4cf3-9025-d14881b59eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:59.071375 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77637f-4f7e-4cf3-9025-d14881b59eed None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:59.071658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77637f-4f7e-4cf3-9025-d14881b59eed None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:59.071936 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77637f-4f7e-4cf3-9025-d14881b59eed None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:59.072723 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77637f-4f7e-4cf3-9025-d14881b59eed None admin] RBAC: Adding query filter params (name=member) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:59.074766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77637f-4f7e-4cf3-9025-d14881b59eed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:59.076125 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77637f-4f7e-4cf3-9025-d14881b59eed None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:59.086289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 69/133] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:45:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:45:59.094843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77637f-4f7e-4cf3-9025-d14881b59eed None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:59.239926 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde86b27-c790-4a70-bdbc-7ede28939fbb None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:59.273270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497e13d-64e1-4cc5-a16a-85edae17dbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:59.274652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497e13d-64e1-4cc5-a16a-85edae17dbda None admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:59.274931 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497e13d-64e1-4cc5-a16a-85edae17dbda None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:59.275204 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497e13d-64e1-4cc5-a16a-85edae17dbda None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64/users/f8ba6a1b884747dbaf2896a3adc5c00f/roles/c8015925658a407b9977b5b0a7f50f05` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:59.277571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497e13d-64e1-4cc5-a16a-85edae17dbda None admin] RBAC: Authorizing `identity:create_grant(project_id=bd162913396140aca4b3f16233ad0c64, user_id=f8ba6a1b884747dbaf2896a3adc5c00f, role_id=c8015925658a407b9977b5b0a7f50f05)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:59.279076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497e13d-64e1-4cc5-a16a-85edae17dbda None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:59.296272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 65/134] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:45:59 2022] PUT /identity/v3/projects/bd162913396140aca4b3f16233ad0c64/users/f8ba6a1b884747dbaf2896a3adc5c00f/roles/c8015925658a407b9977b5b0a7f50f05 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:45:59.298260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec58d0-ba1b-4e58-bf59-3cef9936d0f5 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:59.298691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec58d0-ba1b-4e58-bf59-3cef9936d0f5 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:59.298978 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec58d0-ba1b-4e58-bf59-3cef9936d0f5 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:59.300506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 66/135] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:45:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:45:59.301311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77637f-4f7e-4cf3-9025-d14881b59eed None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:59.306699 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde1913-0871-436b-b588-76b17650125d None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:59.307009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde1913-0871-436b-b588-76b17650125d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:59.307266 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde1913-0871-436b-b588-76b17650125d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:59.328049 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-acde1913-0871-436b-b588-76b17650125d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:45:59.329567 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-acde1913-0871-436b-b588-76b17650125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:45:59.392958 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e7c94-1f68-4d9a-9598-88f87165c3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:59.393866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e7c94-1f68-4d9a-9598-88f87165c3ef None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:59.394149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e7c94-1f68-4d9a-9598-88f87165c3ef None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:59.394423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e7c94-1f68-4d9a-9598-88f87165c3ef None admin] PATH_INFO: `/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:59.395776 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e7c94-1f68-4d9a-9598-88f87165c3ef None admin] RBAC: Authorizing `identity:get_user(user_id=f8ba6a1b884747dbaf2896a3adc5c00f)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:59.397302 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e7c94-1f68-4d9a-9598-88f87165c3ef None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:59.399756 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 70/136] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:45:59 2022] GET /identity/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:45:59.417252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e7c94-1f68-4d9a-9598-88f87165c3ef None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:59.420341 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 67/137] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:45:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:45:59.440191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde1913-0871-436b-b588-76b17650125d None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:59.551989 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde1913-0871-436b-b588-76b17650125d None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:59.591663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bab02-fb84-4c5f-90fc-00a3bd8d1444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:59.592431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bab02-fb84-4c5f-90fc-00a3bd8d1444 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:59.592715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bab02-fb84-4c5f-90fc-00a3bd8d1444 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:59.593435 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bab02-fb84-4c5f-90fc-00a3bd8d1444 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:59.604770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bab02-fb84-4c5f-90fc-00a3bd8d1444 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:45:59.613654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-c78bab02-fb84-4c5f-90fc-00a3bd8d1444 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:45:59.613654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:45:59.613654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:45:59.613654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:45:59.613654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:45:59.613654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:45:59.613654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:45:59.613654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:45:59.613654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:45:59.613654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:45:59.613654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:45:59.613654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:45:59.613654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:45:59.613654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:45:59.613654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:45:59.613654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:45:59.614611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:45:59.614611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:45:59.614611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:45:59.614611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:45:59.614611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:45:59.614611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:45:59.614611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:45:59.614611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:45:59.614611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:45:59.614611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:45:59.614611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:45:59.614611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:45:59.614611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:45:59.614611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:45:59.614611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:45:59.614611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:45:59.615413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:45:59.615413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:45:59.615413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:45:59.615413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:45:59.615413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:45:59.615413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:45:59.615413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:45:59.615413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:45:59.615413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:45:59.615413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:45:59.615413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:45:59.615413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:45:59.619736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 68/138] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:45:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:45:59.621152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bab02-fb84-4c5f-90fc-00a3bd8d1444 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:59.653179 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e7c94-1f68-4d9a-9598-88f87165c3ef None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:59.697872 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dc785-a5d9-4601-82c6-01653b9deaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:59.698757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dc785-a5d9-4601-82c6-01653b9deaaa None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:59.699042 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dc785-a5d9-4601-82c6-01653b9deaaa None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:59.699320 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dc785-a5d9-4601-82c6-01653b9deaaa None admin] PATH_INFO: `/v3/projects/b4b2a644156b4fd9872353a96b930245` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:59.704952 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348dc785-a5d9-4601-82c6-01653b9deaaa None admin] RBAC: Authorizing `identity:get_project(project_id=b4b2a644156b4fd9872353a96b930245)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:59.706433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348dc785-a5d9-4601-82c6-01653b9deaaa None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:59.708195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 71/139] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:45:59 2022] GET /identity/v3/projects/b4b2a644156b4fd9872353a96b930245 => generated 312 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:45:59.718783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dc785-a5d9-4601-82c6-01653b9deaaa None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:59.743966 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bab02-fb84-4c5f-90fc-00a3bd8d1444 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:59.800880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56db596-02ee-44e3-874c-8856c17a2c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:59.801568 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56db596-02ee-44e3-874c-8856c17a2c6b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:59.801853 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56db596-02ee-44e3-874c-8856c17a2c6b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:59.802131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56db596-02ee-44e3-874c-8856c17a2c6b None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:59.802885 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56db596-02ee-44e3-874c-8856c17a2c6b None admin] RBAC: Adding query filter params (name=member) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:45:59.803193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56db596-02ee-44e3-874c-8856c17a2c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:59.804650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56db596-02ee-44e3-874c-8856c17a2c6b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:59.813221 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 69/140] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:45:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:45:59.818784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56db596-02ee-44e3-874c-8856c17a2c6b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:45:59.832267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dc785-a5d9-4601-82c6-01653b9deaaa None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:45:59.867840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88786c46-d89d-4723-86cf-147ec4020599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:45:59.869157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88786c46-d89d-4723-86cf-147ec4020599 None admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:45:59.869658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88786c46-d89d-4723-86cf-147ec4020599 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:45:59.870135 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88786c46-d89d-4723-86cf-147ec4020599 None admin] PATH_INFO: `/v3/projects/b4b2a644156b4fd9872353a96b930245/users/f8ba6a1b884747dbaf2896a3adc5c00f/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:45:59.884908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88786c46-d89d-4723-86cf-147ec4020599 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4b2a644156b4fd9872353a96b930245, user_id=f8ba6a1b884747dbaf2896a3adc5c00f, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:45:59.886493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88786c46-d89d-4723-86cf-147ec4020599 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:45:59.915121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 72/141] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:45:59 2022] PUT /identity/v3/projects/b4b2a644156b4fd9872353a96b930245/users/f8ba6a1b884747dbaf2896a3adc5c00f/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 13:45:59.974725 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56db596-02ee-44e3-874c-8856c17a2c6b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:00.016280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26137335-6360-4e7f-8db5-27849405e8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:00.017540 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26137335-6360-4e7f-8db5-27849405e8ca None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:00.018025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26137335-6360-4e7f-8db5-27849405e8ca None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:00.018528 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26137335-6360-4e7f-8db5-27849405e8ca None admin] PATH_INFO: `/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:00.020982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26137335-6360-4e7f-8db5-27849405e8ca None admin] RBAC: Authorizing `identity:get_user(user_id=f8ba6a1b884747dbaf2896a3adc5c00f)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:00.022777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26137335-6360-4e7f-8db5-27849405e8ca None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:00.025367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 70/142] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:45:59 2022] GET /identity/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:00.031491 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88786c46-d89d-4723-86cf-147ec4020599 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:00.154866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88786c46-d89d-4723-86cf-147ec4020599 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:00.195476 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ca1e8-ef2d-4e6c-9aaf-350c44ebbcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:00.196190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ca1e8-ef2d-4e6c-9aaf-350c44ebbcf4 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:00.196455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ca1e8-ef2d-4e6c-9aaf-350c44ebbcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:00.196729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ca1e8-ef2d-4e6c-9aaf-350c44ebbcf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:00.282559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ca1e8-ef2d-4e6c-9aaf-350c44ebbcf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:00.284038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ca1e8-ef2d-4e6c-9aaf-350c44ebbcf4 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:00.385952 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 73/143] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:00.393835 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26137335-6360-4e7f-8db5-27849405e8ca None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:00.554649 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26137335-6360-4e7f-8db5-27849405e8ca None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:00.599672 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c7f7c-6458-4aa9-b526-a90518226336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:00.600926 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c7f7c-6458-4aa9-b526-a90518226336 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:00.601410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c7f7c-6458-4aa9-b526-a90518226336 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:00.602420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c7f7c-6458-4aa9-b526-a90518226336 None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:00.607951 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c7f7c-6458-4aa9-b526-a90518226336 None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:00.609681 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c7f7c-6458-4aa9-b526-a90518226336 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:00.611584 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 71/144] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:00 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:00.618138 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ca1e8-ef2d-4e6c-9aaf-350c44ebbcf4 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:00.743995 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ca1e8-ef2d-4e6c-9aaf-350c44ebbcf4 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:00.787352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5572f2-fef0-4048-91f8-1054865bdb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:00.788021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5572f2-fef0-4048-91f8-1054865bdb5c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:00.788337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5572f2-fef0-4048-91f8-1054865bdb5c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:00.788624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5572f2-fef0-4048-91f8-1054865bdb5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:00.790017 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5572f2-fef0-4048-91f8-1054865bdb5c None admin] RBAC: Adding query filter params (role.id=15845f6e13b44ef7893159f660311b15, scope.project.id=bd162913396140aca4b3f16233ad0c64, user.id=f8ba6a1b884747dbaf2896a3adc5c00f) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:00.790334 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5572f2-fef0-4048-91f8-1054865bdb5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:00.791786 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5572f2-fef0-4048-91f8-1054865bdb5c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:00.798435 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 74/145] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:00 2022] GET /identity/v3/role_assignments?user.id=f8ba6a1b884747dbaf2896a3adc5c00f&scope.project.id=bd162913396140aca4b3f16233ad0c64&role.id=15845f6e13b44ef7893159f660311b15 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:01.777941 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c66a7-9e44-46c1-8ef5-cfb1a60f7587 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:01.778459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c66a7-9e44-46c1-8ef5-cfb1a60f7587 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:01.778459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c66a7-9e44-46c1-8ef5-cfb1a60f7587 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:01.779783 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 72/146] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:01.785640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aaf11-7978-4bdf-9b6a-d79bb33e8c73 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:01.786038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aaf11-7978-4bdf-9b6a-d79bb33e8c73 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:01.786217 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aaf11-7978-4bdf-9b6a-d79bb33e8c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:01.809188 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-a43aaf11-7978-4bdf-9b6a-d79bb33e8c73 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:01.810718 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a43aaf11-7978-4bdf-9b6a-d79bb33e8c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:01.850497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a32e65-bd5f-44d6-8ca0-0c2fd84345ea None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:01.850795 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a32e65-bd5f-44d6-8ca0-0c2fd84345ea None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:01.851072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a32e65-bd5f-44d6-8ca0-0c2fd84345ea None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:01.852984 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 73/147] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:01.862690 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8b2c8-f164-43f0-bac4-d29e5129e23f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:01.862981 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8b2c8-f164-43f0-bac4-d29e5129e23f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:01.863265 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8b2c8-f164-43f0-bac4-d29e5129e23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:01.889335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 75/148] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:01.897173 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-c1a8b2c8-f164-43f0-bac4-d29e5129e23f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:01.898354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c1a8b2c8-f164-43f0-bac4-d29e5129e23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:01.911956 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aaf11-7978-4bdf-9b6a-d79bb33e8c73 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:02.002497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 74/149] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:02.020045 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aaf11-7978-4bdf-9b6a-d79bb33e8c73 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:02.049175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8b2c8-f164-43f0-bac4-d29e5129e23f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:02.059599 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70635bf-ea92-45f4-8352-d7970f808c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:02.060438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70635bf-ea92-45f4-8352-d7970f808c9b None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:02.060721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70635bf-ea92-45f4-8352-d7970f808c9b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:02.060995 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70635bf-ea92-45f4-8352-d7970f808c9b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:02.071582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70635bf-ea92-45f4-8352-d7970f808c9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:02.079304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-c70635bf-ea92-45f4-8352-d7970f808c9b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:02.079304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:02.079304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:02.079304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:02.079304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:02.079304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:02.079304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:02.079304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:02.079304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:02.079304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:02.079304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:02.079304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:02.079304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:02.079304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:02.079304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:02.079304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:02.080225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:02.080225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:02.080225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:02.080225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:02.080225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:02.080225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:02.080225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:02.080225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:02.080225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:02.080225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:02.080225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:02.080225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:02.080225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:02.080225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:02.080225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:02.080225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:02.081025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:02.081025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:02.081025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:02.081025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:02.081025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:02.081025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:02.081025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:02.081025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:02.081025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:02.081025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:02.081025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:02.081025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:02.081025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 76/150] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:02.086212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70635bf-ea92-45f4-8352-d7970f808c9b None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:02.190545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70635bf-ea92-45f4-8352-d7970f808c9b None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:02.205196 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8b2c8-f164-43f0-bac4-d29e5129e23f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:02.224743 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98f1c3-106a-4cfd-819a-c26527a1a8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:02.225418 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98f1c3-106a-4cfd-819a-c26527a1a8a3 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:02.225704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98f1c3-106a-4cfd-819a-c26527a1a8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:02.225981 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98f1c3-106a-4cfd-819a-c26527a1a8a3 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:02.227377 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98f1c3-106a-4cfd-819a-c26527a1a8a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:02.227710 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98f1c3-106a-4cfd-819a-c26527a1a8a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:02.229129 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98f1c3-106a-4cfd-819a-c26527a1a8a3 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:02.237715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 77/151] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:02.243311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98f1c3-106a-4cfd-819a-c26527a1a8a3 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:02.253446 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a6a00-f8cb-4c48-9187-b5807a6faddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:02.254267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6a00-f8cb-4c48-9187-b5807a6faddd None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:02.254554 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6a00-f8cb-4c48-9187-b5807a6faddd None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:02.254829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6a00-f8cb-4c48-9187-b5807a6faddd None admin] PATH_INFO: `/v3/domains/default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:02.260913 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a6a00-f8cb-4c48-9187-b5807a6faddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:02.262366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a6a00-f8cb-4c48-9187-b5807a6faddd None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:02.264007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 75/152] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:02.269383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a6a00-f8cb-4c48-9187-b5807a6faddd None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:02.344855 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98f1c3-106a-4cfd-819a-c26527a1a8a3 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:02.380035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a6a00-f8cb-4c48-9187-b5807a6faddd None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:02.380368 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfadcaa-6be2-4910-8e36-62b0406c5b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:02.380368 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfadcaa-6be2-4910-8e36-62b0406c5b9d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:02.380368 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfadcaa-6be2-4910-8e36-62b0406c5b9d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:02.380368 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfadcaa-6be2-4910-8e36-62b0406c5b9d None admin] PATH_INFO: `/v3/users/a01d312a58a44fd4a52ddd378f1ca51c` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:02.381321 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfadcaa-6be2-4910-8e36-62b0406c5b9d None admin] RBAC: Authorizing `identity:get_user(user_id=a01d312a58a44fd4a52ddd378f1ca51c)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:02.389093 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfadcaa-6be2-4910-8e36-62b0406c5b9d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:02.389093 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 78/153] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:02 2022] GET /identity/v3/users/a01d312a58a44fd4a52ddd378f1ca51c => generated 289 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:02.389093 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6862a5-6660-4ad7-a6a7-ea5103c4eb88 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:02.389093 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6862a5-6660-4ad7-a6a7-ea5103c4eb88 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:02.389093 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6862a5-6660-4ad7-a6a7-ea5103c4eb88 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:02.389093 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 79/154] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:02.392852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6862a5-6660-4ad7-a6a7-ea5103c4eb88 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:02.417062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9b844-b799-428a-aeef-a50a1955ec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:02.418021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9b844-b799-428a-aeef-a50a1955ec9b None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:02.418310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9b844-b799-428a-aeef-a50a1955ec9b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:02.418589 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9b844-b799-428a-aeef-a50a1955ec9b None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:02.419470 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9b844-b799-428a-aeef-a50a1955ec9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:02.421584 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9b844-b799-428a-aeef-a50a1955ec9b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:02.448210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 76/155] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:46:02 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:46:02.457618 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068d0e5-125e-42f8-9465-d40d4f46ae52 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:02.457909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068d0e5-125e-42f8-9465-d40d4f46ae52 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:02.458194 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068d0e5-125e-42f8-9465-d40d4f46ae52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:02.497541 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-7068d0e5-125e-42f8-9465-d40d4f46ae52 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:02.499150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-7068d0e5-125e-42f8-9465-d40d4f46ae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:02.526658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6862a5-6660-4ad7-a6a7-ea5103c4eb88 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:02.563999 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad07527-8642-43b1-b169-8271d6d0076f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:02.565273 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad07527-8642-43b1-b169-8271d6d0076f None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:02.565758 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad07527-8642-43b1-b169-8271d6d0076f None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:02.566266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad07527-8642-43b1-b169-8271d6d0076f None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:02.567726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad07527-8642-43b1-b169-8271d6d0076f None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:02.569500 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad07527-8642-43b1-b169-8271d6d0076f None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:02.572012 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 80/156] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:02 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:02.578041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad07527-8642-43b1-b169-8271d6d0076f None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:02.611302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 77/157] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:02.651449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068d0e5-125e-42f8-9465-d40d4f46ae52 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:02.739893 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad07527-8642-43b1-b169-8271d6d0076f None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:02.782189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068d0e5-125e-42f8-9465-d40d4f46ae52 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:02.782709 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1303e-281b-4143-8d3b-4b9afeacb331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:02.783223 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1303e-281b-4143-8d3b-4b9afeacb331 None admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:02.783576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1303e-281b-4143-8d3b-4b9afeacb331 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:02.783899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1303e-281b-4143-8d3b-4b9afeacb331 None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64/users/a01d312a58a44fd4a52ddd378f1ca51c/roles/97d9563192e147dda2ea8cd2d201552c` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:02.786023 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1303e-281b-4143-8d3b-4b9afeacb331 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd162913396140aca4b3f16233ad0c64, user_id=a01d312a58a44fd4a52ddd378f1ca51c, role_id=97d9563192e147dda2ea8cd2d201552c)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:02.787533 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1303e-281b-4143-8d3b-4b9afeacb331 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:02.807717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 81/158] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:46:02 2022] PUT /identity/v3/projects/bd162913396140aca4b3f16233ad0c64/users/a01d312a58a44fd4a52ddd378f1ca51c/roles/97d9563192e147dda2ea8cd2d201552c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:02.809329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc317b4-901b-44eb-baa9-dfc63182f16c None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:02.809879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc317b4-901b-44eb-baa9-dfc63182f16c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:02.809879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc317b4-901b-44eb-baa9-dfc63182f16c None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:02.811149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 82/159] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:02.817729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cb385-5b0a-41f2-b295-3bd2c5a00fb6 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:02.818387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cb385-5b0a-41f2-b295-3bd2c5a00fb6 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:02.818865 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cb385-5b0a-41f2-b295-3bd2c5a00fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:02.818968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7428e60-f3d0-486f-a90d-4afc08b421cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:02.819859 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7428e60-f3d0-486f-a90d-4afc08b421cb None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:02.820149 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7428e60-f3d0-486f-a90d-4afc08b421cb None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:02.821009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7428e60-f3d0-486f-a90d-4afc08b421cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:02.850660 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7428e60-f3d0-486f-a90d-4afc08b421cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:02.855737 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-d66cb385-5b0a-41f2-b295-3bd2c5a00fb6 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:02.859755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-d7428e60-f3d0-486f-a90d-4afc08b421cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:02.859755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:02.859755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:02.859755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:02.859755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:02.859755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:02.859755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:02.859755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:02.859755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:02.859755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:02.859755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:02.859755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:02.859755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:02.859755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:02.859755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:02.859755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:02.860770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:02.860770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:02.860770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:02.860770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:02.860770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:02.860770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:02.860770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:02.860770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:02.860770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:02.860770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:02.860770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:02.860770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:02.860770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:02.860770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:02.860770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:02.860770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:02.862110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:02.862110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:02.862110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:02.862110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:02.862110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:02.862110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:02.862110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:02.862110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:02.862110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:02.862110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:02.862110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:02.862110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:02.862110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 78/160] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:46:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:02.863158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d66cb385-5b0a-41f2-b295-3bd2c5a00fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:02.868999 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7428e60-f3d0-486f-a90d-4afc08b421cb None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:02.994034 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 83/161] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:03.021049 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7428e60-f3d0-486f-a90d-4afc08b421cb None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:03.027724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cb385-5b0a-41f2-b295-3bd2c5a00fb6 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:03.092717 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3151568-1cac-49aa-85a1-bab356a38882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:03.093441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3151568-1cac-49aa-85a1-bab356a38882 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:03.093441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3151568-1cac-49aa-85a1-bab356a38882 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:03.093778 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3151568-1cac-49aa-85a1-bab356a38882 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:03.095273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3151568-1cac-49aa-85a1-bab356a38882 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:03.095273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3151568-1cac-49aa-85a1-bab356a38882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:03.096219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3151568-1cac-49aa-85a1-bab356a38882 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:03.109067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 79/162] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:03.117816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3151568-1cac-49aa-85a1-bab356a38882 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:03.203768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cb385-5b0a-41f2-b295-3bd2c5a00fb6 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:03.255352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c84c5f-665a-4f5b-8947-f76f21a49f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:03.259711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3151568-1cac-49aa-85a1-bab356a38882 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:03.260866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84c5f-665a-4f5b-8947-f76f21a49f89 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:03.261351 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84c5f-665a-4f5b-8947-f76f21a49f89 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:03.261836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84c5f-665a-4f5b-8947-f76f21a49f89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:03.279205 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c84c5f-665a-4f5b-8947-f76f21a49f89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:03.290218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-39c84c5f-665a-4f5b-8947-f76f21a49f89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:03.290218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:03.290218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:03.290218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:03.290218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:03.290218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:03.290218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:03.290218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:03.290218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:03.290218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:03.290218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:03.290218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:03.290218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:03.290218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:03.290218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:03.290218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:03.291248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:03.291248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:03.291248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:03.291248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:03.291248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:03.291248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:03.291248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:03.291248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:03.291248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:03.291248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:03.291248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:03.291248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:03.291248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:03.291248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:03.291248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:03.291248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:03.292044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:03.292044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:03.292044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:03.292044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:03.292044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:03.292044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:03.292044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:03.292044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:03.292044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:03.292044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:03.292044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:03.292044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:03.295558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 84/163] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:46:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:03.295822 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2687e-3302-4fb2-a989-aaac2e883cc3 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:03.296102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2687e-3302-4fb2-a989-aaac2e883cc3 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:03.296426 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2687e-3302-4fb2-a989-aaac2e883cc3 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:03.298166 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 85/164] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:03.306650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b0380-7c2a-4e27-aa22-c19f1f1c8197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:03.307556 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b0380-7c2a-4e27-aa22-c19f1f1c8197 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:03.307837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b0380-7c2a-4e27-aa22-c19f1f1c8197 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:03.308109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b0380-7c2a-4e27-aa22-c19f1f1c8197 None admin] PATH_INFO: `/v3/users/bfaa5ec258f44012bccce1e5ad959ff1` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:03.312228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b0380-7c2a-4e27-aa22-c19f1f1c8197 None admin] RBAC: Authorizing `identity:get_user(user_id=bfaa5ec258f44012bccce1e5ad959ff1)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:03.313215 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f53639-0a93-41e2-930e-8c9778679ab4 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:03.313709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b0380-7c2a-4e27-aa22-c19f1f1c8197 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:03.313835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f53639-0a93-41e2-930e-8c9778679ab4 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:03.314402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f53639-0a93-41e2-930e-8c9778679ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:03.315399 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 80/165] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:03 2022] GET /identity/v3/users/bfaa5ec258f44012bccce1e5ad959ff1 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:03.318717 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b0380-7c2a-4e27-aa22-c19f1f1c8197 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:03.338722 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-31f53639-0a93-41e2-930e-8c9778679ab4 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:03.340139 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-31f53639-0a93-41e2-930e-8c9778679ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:03.422606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 86/166] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:03.423875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f53639-0a93-41e2-930e-8c9778679ab4 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:03.443051 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b0380-7c2a-4e27-aa22-c19f1f1c8197 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:03.502585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cd947-1ea2-4cb8-8f37-e85b58dd8918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:03.503170 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cd947-1ea2-4cb8-8f37-e85b58dd8918 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:03.503451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cd947-1ea2-4cb8-8f37-e85b58dd8918 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:03.503727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cd947-1ea2-4cb8-8f37-e85b58dd8918 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:03.505884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cd947-1ea2-4cb8-8f37-e85b58dd8918 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:03.505884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cd947-1ea2-4cb8-8f37-e85b58dd8918 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:03.506552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cd947-1ea2-4cb8-8f37-e85b58dd8918 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:03.517806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 81/167] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:03.520132 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cd947-1ea2-4cb8-8f37-e85b58dd8918 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:03.567842 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f53639-0a93-41e2-930e-8c9778679ab4 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:03.603367 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093de652-09d8-498a-97f7-83dc77fc6e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:03.604397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093de652-09d8-498a-97f7-83dc77fc6e65 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:03.604903 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093de652-09d8-498a-97f7-83dc77fc6e65 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:03.605375 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093de652-09d8-498a-97f7-83dc77fc6e65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:03.673402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cd947-1ea2-4cb8-8f37-e85b58dd8918 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:03.673724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093de652-09d8-498a-97f7-83dc77fc6e65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:03.675388 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093de652-09d8-498a-97f7-83dc77fc6e65 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:03.729301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50113809-af9c-4d22-9979-e7c82209c80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:03.729869 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50113809-af9c-4d22-9979-e7c82209c80b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:03.730158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50113809-af9c-4d22-9979-e7c82209c80b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:03.730429 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50113809-af9c-4d22-9979-e7c82209c80b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:03.753191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50113809-af9c-4d22-9979-e7c82209c80b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:03.765068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-50113809-af9c-4d22-9979-e7c82209c80b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:03.765068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:03.765068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:03.765068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:03.765068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:03.765068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:03.765068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:03.765068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:03.765068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:03.765068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:03.765068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:03.765068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:03.765068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:03.765068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:03.765068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:03.765068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:03.766000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:03.766000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:03.766000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:03.766000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:03.766000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:03.766000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:03.766000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:03.766000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:03.766000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:03.766000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:03.766000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:03.766000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:03.766000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:03.766000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:03.766000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:03.766000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:03.767220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:03.767220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:03.767220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:03.767220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:03.767220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:03.767220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:03.767220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:03.767220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:03.767220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:03.767220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:03.767220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:03.767220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:03.767220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 82/168] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:03.767220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50113809-af9c-4d22-9979-e7c82209c80b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:03.781795 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 87/169] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:03.783068 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093de652-09d8-498a-97f7-83dc77fc6e65 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:03.881596 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093de652-09d8-498a-97f7-83dc77fc6e65 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:03.920957 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50113809-af9c-4d22-9979-e7c82209c80b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:03.928920 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6eb415-5ac4-4e6c-a637-54db9a14ccbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:03.929898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eb415-5ac4-4e6c-a637-54db9a14ccbe None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:03.930402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eb415-5ac4-4e6c-a637-54db9a14ccbe None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:03.930871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eb415-5ac4-4e6c-a637-54db9a14ccbe None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:03.931828 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6eb415-5ac4-4e6c-a637-54db9a14ccbe None admin] RBAC: Adding query filter params (name=member) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:03.932364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6eb415-5ac4-4e6c-a637-54db9a14ccbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:03.934134 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6eb415-5ac4-4e6c-a637-54db9a14ccbe None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:03.942986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 88/170] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:03.948101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6eb415-5ac4-4e6c-a637-54db9a14ccbe None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:03.959541 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fb966-47c0-49f6-951e-7572a412b661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:03.960348 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fb966-47c0-49f6-951e-7572a412b661 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:03.960631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fb966-47c0-49f6-951e-7572a412b661 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:03.965225 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fb966-47c0-49f6-951e-7572a412b661 None admin] PATH_INFO: `/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:03.968190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fb966-47c0-49f6-951e-7572a412b661 None admin] RBAC: Authorizing `identity:get_user(user_id=f8ba6a1b884747dbaf2896a3adc5c00f)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:03.968190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fb966-47c0-49f6-951e-7572a412b661 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:03.969586 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 83/171] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:03 2022] GET /identity/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:03.970163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fb966-47c0-49f6-951e-7572a412b661 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:04.092467 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fb966-47c0-49f6-951e-7572a412b661 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:04.134910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6eb415-5ac4-4e6c-a637-54db9a14ccbe None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:04.151360 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81026da2-eee1-4afe-b058-8f0220dbdf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:04.152272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81026da2-eee1-4afe-b058-8f0220dbdf27 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:04.152663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81026da2-eee1-4afe-b058-8f0220dbdf27 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:04.152940 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81026da2-eee1-4afe-b058-8f0220dbdf27 None admin] PATH_INFO: `/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:04.154787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81026da2-eee1-4afe-b058-8f0220dbdf27 None admin] RBAC: Authorizing `identity:get_user(user_id=f8ba6a1b884747dbaf2896a3adc5c00f)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:04.156500 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81026da2-eee1-4afe-b058-8f0220dbdf27 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:04.158144 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 84/172] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:03 2022] GET /identity/v3/users/f8ba6a1b884747dbaf2896a3adc5c00f => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:04.158903 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81026da2-eee1-4afe-b058-8f0220dbdf27 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:04.196955 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ac2db-eb3c-44fa-b900-52f5396e8eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:04.198246 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ac2db-eb3c-44fa-b900-52f5396e8eb6 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:04.198754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ac2db-eb3c-44fa-b900-52f5396e8eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:04.199227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ac2db-eb3c-44fa-b900-52f5396e8eb6 None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:04.201010 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ac2db-eb3c-44fa-b900-52f5396e8eb6 None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:04.202712 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ac2db-eb3c-44fa-b900-52f5396e8eb6 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:04.204685 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 89/173] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:03 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:04.209166 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ac2db-eb3c-44fa-b900-52f5396e8eb6 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:04.281989 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81026da2-eee1-4afe-b058-8f0220dbdf27 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:04.315498 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbff5a-914d-465a-b318-31f807860650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:04.316151 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbff5a-914d-465a-b318-31f807860650 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:04.316462 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbff5a-914d-465a-b318-31f807860650 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:04.316735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbff5a-914d-465a-b318-31f807860650 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:04.385278 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cbff5a-914d-465a-b318-31f807860650 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:04.386752 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cbff5a-914d-465a-b318-31f807860650 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:04.458376 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ac2db-eb3c-44fa-b900-52f5396e8eb6 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:04.487381 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 85/174] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:04.492806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbff5a-914d-465a-b318-31f807860650 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:04.548889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b6e9e-57b0-445e-9576-27b1814525cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:04.549548 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b6e9e-57b0-445e-9576-27b1814525cb None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:04.549831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b6e9e-57b0-445e-9576-27b1814525cb None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:04.550109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b6e9e-57b0-445e-9576-27b1814525cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:04.592466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbff5a-914d-465a-b318-31f807860650 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:04.626188 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe4e94-d2a7-4e02-b59f-d309b4bd7a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:04.626849 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe4e94-d2a7-4e02-b59f-d309b4bd7a95 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:04.627132 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe4e94-d2a7-4e02-b59f-d309b4bd7a95 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:04.627411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe4e94-d2a7-4e02-b59f-d309b4bd7a95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:04.628293 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe4e94-d2a7-4e02-b59f-d309b4bd7a95 None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=bd162913396140aca4b3f16233ad0c64, user.id=bfaa5ec258f44012bccce1e5ad959ff1) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:04.628608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe4e94-d2a7-4e02-b59f-d309b4bd7a95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:04.630074 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe4e94-d2a7-4e02-b59f-d309b4bd7a95 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:04.636730 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 86/175] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:04 2022] GET /identity/v3/role_assignments?user.id=bfaa5ec258f44012bccce1e5ad959ff1&scope.project.id=bd162913396140aca4b3f16233ad0c64&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:04.637590 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe4e94-d2a7-4e02-b59f-d309b4bd7a95 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:04.703538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b6e9e-57b0-445e-9576-27b1814525cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:04.705034 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b6e9e-57b0-445e-9576-27b1814525cb None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:04.742873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe4e94-d2a7-4e02-b59f-d309b4bd7a95 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:04.778627 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc8d5c-227c-49d3-8ca0-8ae1a685a7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:04.779507 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc8d5c-227c-49d3-8ca0-8ae1a685a7ce None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:04.779787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc8d5c-227c-49d3-8ca0-8ae1a685a7ce None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:04.780060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc8d5c-227c-49d3-8ca0-8ae1a685a7ce None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:04.781604 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc8d5c-227c-49d3-8ca0-8ae1a685a7ce None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:04.783051 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc8d5c-227c-49d3-8ca0-8ae1a685a7ce None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:04.784798 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 87/176] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:04 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:04.803818 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc8d5c-227c-49d3-8ca0-8ae1a685a7ce None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:04.895443 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 90/177] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:04.904081 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b6e9e-57b0-445e-9576-27b1814525cb None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:04.938987 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc8d5c-227c-49d3-8ca0-8ae1a685a7ce None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:05.018980 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b6e9e-57b0-445e-9576-27b1814525cb None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:05.031541 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dade3-3df0-4cf1-a85e-ac0f7fae9833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:05.032219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dade3-3df0-4cf1-a85e-ac0f7fae9833 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:05.032515 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dade3-3df0-4cf1-a85e-ac0f7fae9833 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:05.032969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dade3-3df0-4cf1-a85e-ac0f7fae9833 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:05.033655 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dade3-3df0-4cf1-a85e-ac0f7fae9833 None admin] RBAC: Adding query filter params (role.id=c8015925658a407b9977b5b0a7f50f05, scope.project.id=bd162913396140aca4b3f16233ad0c64, user.id=f8ba6a1b884747dbaf2896a3adc5c00f) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:05.033962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dade3-3df0-4cf1-a85e-ac0f7fae9833 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:05.035403 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dade3-3df0-4cf1-a85e-ac0f7fae9833 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:05.050347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 88/178] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:04 2022] GET /identity/v3/role_assignments?user.id=f8ba6a1b884747dbaf2896a3adc5c00f&scope.project.id=bd162913396140aca4b3f16233ad0c64&role.id=c8015925658a407b9977b5b0a7f50f05 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:05.058553 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66178236-65e8-4cec-9dc9-dee2fc7878ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:05.059807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178236-65e8-4cec-9dc9-dee2fc7878ed None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:05.060337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178236-65e8-4cec-9dc9-dee2fc7878ed None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:05.060829 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178236-65e8-4cec-9dc9-dee2fc7878ed None admin] PATH_INFO: `/v3/projects/b4b2a644156b4fd9872353a96b930245` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:05.062310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66178236-65e8-4cec-9dc9-dee2fc7878ed None admin] RBAC: Authorizing `identity:get_project(project_id=b4b2a644156b4fd9872353a96b930245)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:05.063981 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66178236-65e8-4cec-9dc9-dee2fc7878ed None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:05.066033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 91/179] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:04 2022] GET /identity/v3/projects/b4b2a644156b4fd9872353a96b930245 => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:05.077645 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dade3-3df0-4cf1-a85e-ac0f7fae9833 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:05.208550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dade3-3df0-4cf1-a85e-ac0f7fae9833 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:05.248005 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e6702-fda9-4b71-86d7-9334738b5d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:05.248724 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e6702-fda9-4b71-86d7-9334738b5d86 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:05.248998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e6702-fda9-4b71-86d7-9334738b5d86 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:05.249270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e6702-fda9-4b71-86d7-9334738b5d86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:05.250113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e6702-fda9-4b71-86d7-9334738b5d86 None admin] RBAC: Adding query filter params (role.id=15845f6e13b44ef7893159f660311b15, scope.project.id=b4b2a644156b4fd9872353a96b930245, user.id=f8ba6a1b884747dbaf2896a3adc5c00f) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:05.250420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e6702-fda9-4b71-86d7-9334738b5d86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:05.251871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e6702-fda9-4b71-86d7-9334738b5d86 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:05.259409 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 89/180] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:05 2022] GET /identity/v3/role_assignments?user.id=f8ba6a1b884747dbaf2896a3adc5c00f&scope.project.id=b4b2a644156b4fd9872353a96b930245&role.id=15845f6e13b44ef7893159f660311b15 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:06.230743 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28095b2a-f195-48ec-8658-33655d4a74df None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:06.231265 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28095b2a-f195-48ec-8658-33655d4a74df None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:06.231265 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28095b2a-f195-48ec-8658-33655d4a74df None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:06.232696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 92/181] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:06.238013 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6176eb-bd25-4cd7-929b-8ebbd8f56f95 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:06.238828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6176eb-bd25-4cd7-929b-8ebbd8f56f95 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:06.239307 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6176eb-bd25-4cd7-929b-8ebbd8f56f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:06.257936 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ae7f9-39ae-4791-9895-5ca5a5b52c84 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:06.258218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ae7f9-39ae-4791-9895-5ca5a5b52c84 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:06.258491 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ae7f9-39ae-4791-9895-5ca5a5b52c84 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:06.259992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 93/182] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:06.260268 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-1c6176eb-bd25-4cd7-929b-8ebbd8f56f95 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:06.261454 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-1c6176eb-bd25-4cd7-929b-8ebbd8f56f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:06.265550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972ab4a-6b82-4010-88e0-d577e9d9eb02 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:06.266125 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972ab4a-6b82-4010-88e0-d577e9d9eb02 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:06.266602 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972ab4a-6b82-4010-88e0-d577e9d9eb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:06.284210 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-d972ab4a-6b82-4010-88e0-d577e9d9eb02 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:06.285783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d972ab4a-6b82-4010-88e0-d577e9d9eb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:06.344261 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 90/183] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:06.365767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 94/184] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:06.369628 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6176eb-bd25-4cd7-929b-8ebbd8f56f95 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:06.392056 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972ab4a-6b82-4010-88e0-d577e9d9eb02 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:06.471405 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6176eb-bd25-4cd7-929b-8ebbd8f56f95 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:06.491115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972ab4a-6b82-4010-88e0-d577e9d9eb02 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:06.506021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cb0d3-290d-44ee-9422-53275179bf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:06.507155 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cb0d3-290d-44ee-9422-53275179bf42 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:06.507436 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cb0d3-290d-44ee-9422-53275179bf42 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:06.508247 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cb0d3-290d-44ee-9422-53275179bf42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:06.509682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cb0d3-290d-44ee-9422-53275179bf42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:06.510933 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cb0d3-290d-44ee-9422-53275179bf42 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:06.512607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 91/185] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:06.515027 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1ad28-6c81-4c3c-85f9-40915b3fb0a8 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:06.515497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1ad28-6c81-4c3c-85f9-40915b3fb0a8 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:06.515779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1ad28-6c81-4c3c-85f9-40915b3fb0a8 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:06.517171 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 92/186] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:06.519410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29eb779-ca6b-4afb-a92a-8f2958e96fb2 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:06.519696 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29eb779-ca6b-4afb-a92a-8f2958e96fb2 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:06.519972 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29eb779-ca6b-4afb-a92a-8f2958e96fb2 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:06.521205 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 93/187] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:06.521874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29eb779-ca6b-4afb-a92a-8f2958e96fb2 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:06.526727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84294a8-a525-48a9-b7cd-cd8f23b701c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:06.527736 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84294a8-a525-48a9-b7cd-cd8f23b701c8 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:06.528018 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84294a8-a525-48a9-b7cd-cd8f23b701c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:06.528322 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84294a8-a525-48a9-b7cd-cd8f23b701c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:06.538454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84294a8-a525-48a9-b7cd-cd8f23b701c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:06.546113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-c84294a8-a525-48a9-b7cd-cd8f23b701c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:06.546113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:06.546113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:06.546113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:06.546113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:06.546113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:06.546113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:06.546113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:06.546113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:06.546113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:06.546113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:06.546113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:06.546113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:06.546113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:06.546113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:06.546113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:06.547072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:06.547072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:06.547072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:06.547072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:06.547072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:06.547072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:06.547072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:06.547072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:06.547072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:06.547072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:06.547072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:06.547072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:06.547072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:06.547072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:06.547072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:06.547072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:06.547894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:06.547894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:06.547894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:06.547894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:06.547894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:06.547894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:06.547894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:06.547894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:06.547894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:06.547894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:06.547894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:06.547894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:06.547894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 95/188] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:06.548625 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51415e0-7368-487f-9bdc-d9fb8605641e None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:06.548707 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51415e0-7368-487f-9bdc-d9fb8605641e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:06.549231 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51415e0-7368-487f-9bdc-d9fb8605641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:06.564372 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-f51415e0-7368-487f-9bdc-d9fb8605641e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:06.565619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-f51415e0-7368-487f-9bdc-d9fb8605641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:06.619307 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29eb779-ca6b-4afb-a92a-8f2958e96fb2 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:06.627724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 96/189] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:06.629152 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4466f3a-aa7e-4751-9307-c6dcdd52478e None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:06.629445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4466f3a-aa7e-4751-9307-c6dcdd52478e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:06.629722 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4466f3a-aa7e-4751-9307-c6dcdd52478e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:06.645279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-a4466f3a-aa7e-4751-9307-c6dcdd52478e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:06.646557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a4466f3a-aa7e-4751-9307-c6dcdd52478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:06.653285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15090e77-e1b4-44bf-8eb4-67f0925db25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:06.653947 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15090e77-e1b4-44bf-8eb4-67f0925db25e None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:06.654223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15090e77-e1b4-44bf-8eb4-67f0925db25e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:06.654492 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15090e77-e1b4-44bf-8eb4-67f0925db25e None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:06.655191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15090e77-e1b4-44bf-8eb4-67f0925db25e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:06.656900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15090e77-e1b4-44bf-8eb4-67f0925db25e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:06.682627 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 94/190] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:46:06 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:46:06.682627 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15090e77-e1b4-44bf-8eb4-67f0925db25e None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:06.716075 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 97/191] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:06.716997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4466f3a-aa7e-4751-9307-c6dcdd52478e None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:06.795343 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15090e77-e1b4-44bf-8eb4-67f0925db25e None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:06.828693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4466f3a-aa7e-4751-9307-c6dcdd52478e None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:06.830558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a559d-ceec-45fe-8909-59a5e7b1f173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:06.831248 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a559d-ceec-45fe-8909-59a5e7b1f173 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:06.831522 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a559d-ceec-45fe-8909-59a5e7b1f173 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:06.831862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a559d-ceec-45fe-8909-59a5e7b1f173 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:06.832727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a559d-ceec-45fe-8909-59a5e7b1f173 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:06.833015 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a559d-ceec-45fe-8909-59a5e7b1f173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:06.834429 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a559d-ceec-45fe-8909-59a5e7b1f173 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:06.843456 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 95/192] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:06.848442 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a559d-ceec-45fe-8909-59a5e7b1f173 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:06.868279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fd554-48a1-4e75-a50d-f44639405405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:06.869715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fd554-48a1-4e75-a50d-f44639405405 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:06.869715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fd554-48a1-4e75-a50d-f44639405405 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:06.869715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fd554-48a1-4e75-a50d-f44639405405 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:06.884912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fd554-48a1-4e75-a50d-f44639405405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:06.893085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-c21fd554-48a1-4e75-a50d-f44639405405 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:06.893085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:06.893085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:06.893085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:06.893085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:06.893085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:06.893085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:06.893085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:06.893085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:06.893085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:06.893085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:06.893085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:06.893085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:06.893085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:06.893085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:06.893085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:06.894021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:06.894021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:06.894021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:06.894021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:06.894021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:06.894021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:06.894021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:06.894021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:06.894021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:06.894021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:06.894021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:06.894021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:06.894021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:06.894021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:06.894021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:06.894021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:06.894836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:06.894836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:06.894836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:06.894836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:06.894836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:06.894836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:06.894836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:06.894836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:06.894836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:06.894836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:06.894836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:06.894836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:06.894836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 98/193] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:46:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:06.895545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fd554-48a1-4e75-a50d-f44639405405 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:06.966829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a559d-ceec-45fe-8909-59a5e7b1f173 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:07.010812 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4ebf8-60d3-43c1-9dad-56531ae54098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:07.011637 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4ebf8-60d3-43c1-9dad-56531ae54098 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:07.011918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4ebf8-60d3-43c1-9dad-56531ae54098 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:07.012289 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4ebf8-60d3-43c1-9dad-56531ae54098 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:07.019885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fd554-48a1-4e75-a50d-f44639405405 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:07.023180 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4ebf8-60d3-43c1-9dad-56531ae54098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:07.031242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-e1a4ebf8-60d3-43c1-9dad-56531ae54098 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:07.031242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:07.031242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:07.031242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:07.031242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:07.031242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:07.031242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:07.031242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:07.031242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:07.031242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:07.031242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:07.031242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:07.031242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:07.031242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:07.031242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:07.031242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:07.032663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:07.032663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:07.032663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:07.032663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:07.032663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:07.032663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:07.032663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:07.032663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:07.032663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:07.032663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:07.032663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:07.032663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:07.032663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:07.032663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:07.032663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:07.032663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:07.033632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:07.033632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:07.033632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:07.033632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:07.033632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:07.033632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:07.033632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:07.033632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:07.033632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:07.033632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:07.033632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:07.033632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:07.033632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 96/194] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:46:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:07.033632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4ebf8-60d3-43c1-9dad-56531ae54098 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:07.067521 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5159561-8f18-4bd7-9828-ed02997f1dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:07.068984 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5159561-8f18-4bd7-9828-ed02997f1dd8 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:07.069269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5159561-8f18-4bd7-9828-ed02997f1dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:07.069688 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5159561-8f18-4bd7-9828-ed02997f1dd8 None admin] PATH_INFO: `/v3/users/a01d312a58a44fd4a52ddd378f1ca51c` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:07.071787 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5159561-8f18-4bd7-9828-ed02997f1dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=a01d312a58a44fd4a52ddd378f1ca51c)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:07.073961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5159561-8f18-4bd7-9828-ed02997f1dd8 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:07.075595 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 99/195] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:06 2022] GET /identity/v3/users/a01d312a58a44fd4a52ddd378f1ca51c => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:07.076410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5159561-8f18-4bd7-9828-ed02997f1dd8 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:07.148347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4ebf8-60d3-43c1-9dad-56531ae54098 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:07.193141 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5159561-8f18-4bd7-9828-ed02997f1dd8 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:07.193486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28439084-8900-4b65-8993-207ce7a6800b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:07.194150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28439084-8900-4b65-8993-207ce7a6800b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:07.194430 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28439084-8900-4b65-8993-207ce7a6800b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:07.194707 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28439084-8900-4b65-8993-207ce7a6800b None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:07.195509 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28439084-8900-4b65-8993-207ce7a6800b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:07.195818 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28439084-8900-4b65-8993-207ce7a6800b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:07.198243 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28439084-8900-4b65-8993-207ce7a6800b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:07.208916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 97/196] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:07.210137 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28439084-8900-4b65-8993-207ce7a6800b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:07.236098 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a9e1e-fec8-4ef1-9fb7-af1bdc1b41eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:07.236801 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a9e1e-fec8-4ef1-9fb7-af1bdc1b41eb None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:07.237143 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a9e1e-fec8-4ef1-9fb7-af1bdc1b41eb None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:07.237424 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a9e1e-fec8-4ef1-9fb7-af1bdc1b41eb None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:07.238457 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a9e1e-fec8-4ef1-9fb7-af1bdc1b41eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:07.238764 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a9e1e-fec8-4ef1-9fb7-af1bdc1b41eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:07.240545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a9e1e-fec8-4ef1-9fb7-af1bdc1b41eb None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:07.249499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 100/197] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:07.250157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a9e1e-fec8-4ef1-9fb7-af1bdc1b41eb None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:07.313036 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28439084-8900-4b65-8993-207ce7a6800b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:07.347245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50616490-d7de-4d45-b4a7-2c18ba72fc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:07.348281 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50616490-d7de-4d45-b4a7-2c18ba72fc7e None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:07.348781 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50616490-d7de-4d45-b4a7-2c18ba72fc7e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:07.349277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50616490-d7de-4d45-b4a7-2c18ba72fc7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:07.357476 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a9e1e-fec8-4ef1-9fb7-af1bdc1b41eb None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:07.400435 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403362-394f-4d44-9707-f1c0a0847eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:07.401812 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403362-394f-4d44-9707-f1c0a0847eb8 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:07.402489 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403362-394f-4d44-9707-f1c0a0847eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:07.403320 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403362-394f-4d44-9707-f1c0a0847eb8 None admin] PATH_INFO: `/v3/users/263300ffe8144e3a915971914559b18c` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:07.421953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64403362-394f-4d44-9707-f1c0a0847eb8 None admin] RBAC: Authorizing `identity:get_user(user_id=263300ffe8144e3a915971914559b18c)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:07.424636 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64403362-394f-4d44-9707-f1c0a0847eb8 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:07.424745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50616490-d7de-4d45-b4a7-2c18ba72fc7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:07.426158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50616490-d7de-4d45-b4a7-2c18ba72fc7e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:07.426929 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 101/198] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:07 2022] GET /identity/v3/users/263300ffe8144e3a915971914559b18c => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:07.428071 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403362-394f-4d44-9707-f1c0a0847eb8 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:07.534570 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403362-394f-4d44-9707-f1c0a0847eb8 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:07.542877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 98/199] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:07.544335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50616490-d7de-4d45-b4a7-2c18ba72fc7e None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:07.572553 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb2dcb-ccee-4858-835e-14e1cf7dc1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:07.573479 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb2dcb-ccee-4858-835e-14e1cf7dc1cb None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:07.573752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb2dcb-ccee-4858-835e-14e1cf7dc1cb None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:07.574067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb2dcb-ccee-4858-835e-14e1cf7dc1cb None admin] PATH_INFO: `/v3/users/263300ffe8144e3a915971914559b18c` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:07.575245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb2dcb-ccee-4858-835e-14e1cf7dc1cb None admin] RBAC: Authorizing `identity:get_user(user_id=263300ffe8144e3a915971914559b18c)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:07.576719 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb2dcb-ccee-4858-835e-14e1cf7dc1cb None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:07.578693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 102/200] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:07 2022] GET /identity/v3/users/263300ffe8144e3a915971914559b18c => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:07.579646 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb2dcb-ccee-4858-835e-14e1cf7dc1cb None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:07.666788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50616490-d7de-4d45-b4a7-2c18ba72fc7e None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:07.678477 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb2dcb-ccee-4858-835e-14e1cf7dc1cb None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:07.709332 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d146e2f-b807-489e-af01-a12cc3486d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:07.710036 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d146e2f-b807-489e-af01-a12cc3486d2d None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:07.710320 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d146e2f-b807-489e-af01-a12cc3486d2d None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:07.710593 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d146e2f-b807-489e-af01-a12cc3486d2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:07.713923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164c89a-274c-4cee-ac96-e3054d73bab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:07.714994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164c89a-274c-4cee-ac96-e3054d73bab3 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:07.715464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164c89a-274c-4cee-ac96-e3054d73bab3 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:07.715941 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164c89a-274c-4cee-ac96-e3054d73bab3 None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:07.717353 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164c89a-274c-4cee-ac96-e3054d73bab3 None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:07.718982 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164c89a-274c-4cee-ac96-e3054d73bab3 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:07.720892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 103/201] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:07 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:07.725070 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164c89a-274c-4cee-ac96-e3054d73bab3 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:07.790857 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d146e2f-b807-489e-af01-a12cc3486d2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:07.792930 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d146e2f-b807-489e-af01-a12cc3486d2d None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:07.834290 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164c89a-274c-4cee-ac96-e3054d73bab3 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:07.875767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27689a94-4ee0-4ff9-b99d-b9ef78a709ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:07.876435 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27689a94-4ee0-4ff9-b99d-b9ef78a709ea None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:07.876713 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27689a94-4ee0-4ff9-b99d-b9ef78a709ea None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:07.876997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27689a94-4ee0-4ff9-b99d-b9ef78a709ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:07.891057 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 99/202] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:07.892251 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d146e2f-b807-489e-af01-a12cc3486d2d None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:07.954741 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27689a94-4ee0-4ff9-b99d-b9ef78a709ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:07.956668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27689a94-4ee0-4ff9-b99d-b9ef78a709ea None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:08.007830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d146e2f-b807-489e-af01-a12cc3486d2d None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:08.046066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c355f-a6a1-4c80-8caf-73dc1c332ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:08.047113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c355f-a6a1-4c80-8caf-73dc1c332ec9 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:08.047595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c355f-a6a1-4c80-8caf-73dc1c332ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:08.048074 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c355f-a6a1-4c80-8caf-73dc1c332ec9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:08.049334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c355f-a6a1-4c80-8caf-73dc1c332ec9 None admin] RBAC: Adding query filter params (role.id=97d9563192e147dda2ea8cd2d201552c, scope.project.id=bd162913396140aca4b3f16233ad0c64, user.id=a01d312a58a44fd4a52ddd378f1ca51c) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:08.049642 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c355f-a6a1-4c80-8caf-73dc1c332ec9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:08.051064 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c355f-a6a1-4c80-8caf-73dc1c332ec9 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:08.057917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 100/203] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:07 2022] GET /identity/v3/role_assignments?user.id=a01d312a58a44fd4a52ddd378f1ca51c&scope.project.id=bd162913396140aca4b3f16233ad0c64&role.id=97d9563192e147dda2ea8cd2d201552c => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:08.058764 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c355f-a6a1-4c80-8caf-73dc1c332ec9 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:08.083178 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 104/204] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:08.089109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27689a94-4ee0-4ff9-b99d-b9ef78a709ea None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:08.256497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c355f-a6a1-4c80-8caf-73dc1c332ec9 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:08.273375 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27689a94-4ee0-4ff9-b99d-b9ef78a709ea None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:08.298907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5632f6-6d4e-4552-9084-5db01e1e31de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:08.300371 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5632f6-6d4e-4552-9084-5db01e1e31de None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:08.300652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5632f6-6d4e-4552-9084-5db01e1e31de None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:08.300922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5632f6-6d4e-4552-9084-5db01e1e31de None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:08.302673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5632f6-6d4e-4552-9084-5db01e1e31de None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:08.305675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5632f6-6d4e-4552-9084-5db01e1e31de None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:08.308512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 101/205] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:08 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:08.311214 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4f458-cb97-420b-9920-50ecafe41b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:08.312076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4f458-cb97-420b-9920-50ecafe41b65 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:08.312383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4f458-cb97-420b-9920-50ecafe41b65 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:08.312653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4f458-cb97-420b-9920-50ecafe41b65 None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:08.313841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4f458-cb97-420b-9920-50ecafe41b65 None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:08.314500 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5632f6-6d4e-4552-9084-5db01e1e31de None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:08.315303 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4f458-cb97-420b-9920-50ecafe41b65 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:08.317354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 105/206] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:08 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:08.325829 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4f458-cb97-420b-9920-50ecafe41b65 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:08.428786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5632f6-6d4e-4552-9084-5db01e1e31de None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:08.441919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4f458-cb97-420b-9920-50ecafe41b65 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:08.467160 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94861ec6-6c04-4578-86de-de1a1e4b4e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:08.467820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94861ec6-6c04-4578-86de-de1a1e4b4e00 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:08.468099 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94861ec6-6c04-4578-86de-de1a1e4b4e00 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:08.468405 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94861ec6-6c04-4578-86de-de1a1e4b4e00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:08.469236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94861ec6-6c04-4578-86de-de1a1e4b4e00 None admin] RBAC: Adding query filter params (role.id=c8015925658a407b9977b5b0a7f50f05, scope.project.id=e826a1db652e46829670062be316817a, user.id=263300ffe8144e3a915971914559b18c) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:08.469543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94861ec6-6c04-4578-86de-de1a1e4b4e00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:08.471086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94861ec6-6c04-4578-86de-de1a1e4b4e00 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:08.476605 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd72564-6058-453e-8dc6-5366769f52d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:08.477030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 102/207] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:08 2022] GET /identity/v3/role_assignments?user.id=263300ffe8144e3a915971914559b18c&scope.project.id=e826a1db652e46829670062be316817a&role.id=c8015925658a407b9977b5b0a7f50f05 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:08.477255 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd72564-6058-453e-8dc6-5366769f52d7 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:08.477531 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd72564-6058-453e-8dc6-5366769f52d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:08.477804 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd72564-6058-453e-8dc6-5366769f52d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:08.478633 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd72564-6058-453e-8dc6-5366769f52d7 None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=e826a1db652e46829670062be316817a, user.id=263300ffe8144e3a915971914559b18c) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:08.478945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd72564-6058-453e-8dc6-5366769f52d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:08.484260 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd72564-6058-453e-8dc6-5366769f52d7 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:08.487130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 106/208] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:08 2022] GET /identity/v3/role_assignments?user.id=263300ffe8144e3a915971914559b18c&scope.project.id=e826a1db652e46829670062be316817a&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:09.124991 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735c63a-7471-4d77-9653-b0b1105d0c05 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:09.125276 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735c63a-7471-4d77-9653-b0b1105d0c05 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:09.125777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735c63a-7471-4d77-9653-b0b1105d0c05 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:09.127364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 103/209] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:09.132859 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3502478-4e46-47fd-a7fa-978a1e058cb6 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:09.133215 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3502478-4e46-47fd-a7fa-978a1e058cb6 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:09.133574 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3502478-4e46-47fd-a7fa-978a1e058cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:09.150547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-b3502478-4e46-47fd-a7fa-978a1e058cb6 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:09.151707 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b3502478-4e46-47fd-a7fa-978a1e058cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:09.205919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbad15d-9d7d-408a-914d-d0c77f70f783 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:09.206193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbad15d-9d7d-408a-914d-d0c77f70f783 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:09.206472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbad15d-9d7d-408a-914d-d0c77f70f783 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:09.208773 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 104/210] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:09.215161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0136c-3e3c-4c31-aba8-26f035ca3cf7 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:09.215550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0136c-3e3c-4c31-aba8-26f035ca3cf7 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:09.215919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0136c-3e3c-4c31-aba8-26f035ca3cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:09.221481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 107/211] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:09.236726 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-dcc0136c-3e3c-4c31-aba8-26f035ca3cf7 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:09.237898 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-dcc0136c-3e3c-4c31-aba8-26f035ca3cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:09.244483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3502478-4e46-47fd-a7fa-978a1e058cb6 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:09.324928 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 105/212] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:09.345945 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0136c-3e3c-4c31-aba8-26f035ca3cf7 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:09.349578 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3502478-4e46-47fd-a7fa-978a1e058cb6 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:09.383863 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb78d77-1b6f-489e-91e7-ec5eb8c8254a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:09.384603 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb78d77-1b6f-489e-91e7-ec5eb8c8254a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:09.384882 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb78d77-1b6f-489e-91e7-ec5eb8c8254a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:09.385155 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb78d77-1b6f-489e-91e7-ec5eb8c8254a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:09.395419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb78d77-1b6f-489e-91e7-ec5eb8c8254a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:09.403662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-8fb78d77-1b6f-489e-91e7-ec5eb8c8254a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:09.403662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:09.403662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:09.403662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:09.403662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:09.403662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:09.403662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:09.403662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:09.403662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:09.403662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:09.403662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:09.403662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:09.403662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:09.403662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:09.403662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:09.403662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:09.404624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:09.404624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:09.404624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:09.404624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:09.404624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:09.404624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:09.404624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:09.404624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:09.404624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:09.404624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:09.404624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:09.404624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:09.404624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:09.404624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:09.404624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:09.404624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:09.405467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:09.405467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:09.405467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:09.405467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:09.405467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:09.405467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:09.405467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:09.405467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:09.405467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:09.405467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:09.405467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:09.405467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:09.405467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 108/213] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:09.410719 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb78d77-1b6f-489e-91e7-ec5eb8c8254a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:09.448332 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0136c-3e3c-4c31-aba8-26f035ca3cf7 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:09.487459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476cd1f-3845-4c5f-93cb-396c16d5facc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:09.488276 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476cd1f-3845-4c5f-93cb-396c16d5facc None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:09.488568 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476cd1f-3845-4c5f-93cb-396c16d5facc None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:09.488826 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476cd1f-3845-4c5f-93cb-396c16d5facc None admin] PATH_INFO: `/v3/domains/default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:09.490001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476cd1f-3845-4c5f-93cb-396c16d5facc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:09.491439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476cd1f-3845-4c5f-93cb-396c16d5facc None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:09.493118 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 106/214] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:09.498455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476cd1f-3845-4c5f-93cb-396c16d5facc None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:09.530775 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb78d77-1b6f-489e-91e7-ec5eb8c8254a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:09.567673 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbe3a0-5424-4045-966d-0038358efe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:09.568880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbe3a0-5424-4045-966d-0038358efe3d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:09.569501 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbe3a0-5424-4045-966d-0038358efe3d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:09.570738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbe3a0-5424-4045-966d-0038358efe3d None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:09.571934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbe3a0-5424-4045-966d-0038358efe3d None admin] RBAC: Adding query filter params (name=member) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:09.572437 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbe3a0-5424-4045-966d-0038358efe3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:09.574179 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbe3a0-5424-4045-966d-0038358efe3d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:09.589443 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 109/215] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:09.590141 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbe3a0-5424-4045-966d-0038358efe3d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:09.619468 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476cd1f-3845-4c5f-93cb-396c16d5facc None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:09.664509 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ecde4-d1da-4f27-9f30-531462fc5732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:09.665427 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ecde4-d1da-4f27-9f30-531462fc5732 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:09.665770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ecde4-d1da-4f27-9f30-531462fc5732 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:09.666104 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ecde4-d1da-4f27-9f30-531462fc5732 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:09.666896 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ecde4-d1da-4f27-9f30-531462fc5732 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:09.668500 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ecde4-d1da-4f27-9f30-531462fc5732 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:09.690106 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 107/216] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:46:09 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:46:09.698834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbe3a0-5424-4045-966d-0038358efe3d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:09.738534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccbaa8-27a5-4cdf-bcb9-e9087188c6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:09.739716 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccbaa8-27a5-4cdf-bcb9-e9087188c6b8 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:09.740197 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccbaa8-27a5-4cdf-bcb9-e9087188c6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:09.740676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccbaa8-27a5-4cdf-bcb9-e9087188c6b8 None admin] PATH_INFO: `/v3/users/d379fa150feb4d9197014ae64669a6b0` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:09.757743 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccbaa8-27a5-4cdf-bcb9-e9087188c6b8 None admin] RBAC: Authorizing `identity:get_user(user_id=d379fa150feb4d9197014ae64669a6b0)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:09.759693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccbaa8-27a5-4cdf-bcb9-e9087188c6b8 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:09.761747 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 110/217] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:09 2022] GET /identity/v3/users/d379fa150feb4d9197014ae64669a6b0 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:09.767449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ecde4-d1da-4f27-9f30-531462fc5732 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:09.878954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ecde4-d1da-4f27-9f30-531462fc5732 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:09.914319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaa762-0c6b-4662-b6b0-de0a0cade04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:09.915026 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaa762-0c6b-4662-b6b0-de0a0cade04e None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:09.915251 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaa762-0c6b-4662-b6b0-de0a0cade04e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:09.915526 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaa762-0c6b-4662-b6b0-de0a0cade04e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:09.981355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baaa762-0c6b-4662-b6b0-de0a0cade04e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:09.982800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baaa762-0c6b-4662-b6b0-de0a0cade04e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:10.079457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 108/218] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:10.086856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccbaa8-27a5-4cdf-bcb9-e9087188c6b8 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:10.192257 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccbaa8-27a5-4cdf-bcb9-e9087188c6b8 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:10.231734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eed264-08a2-49ac-ae68-ed61f9ab56d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:10.232626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eed264-08a2-49ac-ae68-ed61f9ab56d5 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:10.232905 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eed264-08a2-49ac-ae68-ed61f9ab56d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:10.233178 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eed264-08a2-49ac-ae68-ed61f9ab56d5 None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:10.236898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eed264-08a2-49ac-ae68-ed61f9ab56d5 None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:10.238360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eed264-08a2-49ac-ae68-ed61f9ab56d5 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:10.240124 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 111/219] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:10 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:10.246620 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaa762-0c6b-4662-b6b0-de0a0cade04e None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:10.371101 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaa762-0c6b-4662-b6b0-de0a0cade04e None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:10.423671 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0340d8-ed22-422b-b4ff-28f4d5beef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:10.424360 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0340d8-ed22-422b-b4ff-28f4d5beef1b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:10.424643 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0340d8-ed22-422b-b4ff-28f4d5beef1b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:10.424914 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0340d8-ed22-422b-b4ff-28f4d5beef1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:10.425751 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0340d8-ed22-422b-b4ff-28f4d5beef1b None admin] RBAC: Adding query filter params (role.id=15845f6e13b44ef7893159f660311b15, scope.project.id=e826a1db652e46829670062be316817a, user.id=d379fa150feb4d9197014ae64669a6b0) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:10.426056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0340d8-ed22-422b-b4ff-28f4d5beef1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:10.427482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0340d8-ed22-422b-b4ff-28f4d5beef1b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:10.435814 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 109/220] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:10 2022] GET /identity/v3/role_assignments?user.id=d379fa150feb4d9197014ae64669a6b0&scope.project.id=e826a1db652e46829670062be316817a&role.id=15845f6e13b44ef7893159f660311b15 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:10.823549 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72235da9-34d0-4151-8d5f-d4983d40051e None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:10.824065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72235da9-34d0-4151-8d5f-d4983d40051e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:10.824193 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72235da9-34d0-4151-8d5f-d4983d40051e None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:10.825786 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 112/221] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:10.831287 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e681059-83b9-49a6-8459-cbd56a7cc2ad None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:10.831581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e681059-83b9-49a6-8459-cbd56a7cc2ad None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:10.831857 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e681059-83b9-49a6-8459-cbd56a7cc2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:10.834218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac268e8-6227-45cc-a317-1df247443aa7 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:10.834499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac268e8-6227-45cc-a317-1df247443aa7 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:10.834774 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac268e8-6227-45cc-a317-1df247443aa7 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:10.836915 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 113/222] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:10.841575 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c55d7-0b8f-480f-81e4-2ce430d0ef5f None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:10.841857 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c55d7-0b8f-480f-81e4-2ce430d0ef5f None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:10.842134 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c55d7-0b8f-480f-81e4-2ce430d0ef5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:10.865994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-c73c55d7-0b8f-480f-81e4-2ce430d0ef5f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:10.867210 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-c73c55d7-0b8f-480f-81e4-2ce430d0ef5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:10.874673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-5e681059-83b9-49a6-8459-cbd56a7cc2ad None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:10.875861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-5e681059-83b9-49a6-8459-cbd56a7cc2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:10.953652 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 114/223] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:10.954291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 110/224] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:10.977056 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c55d7-0b8f-480f-81e4-2ce430d0ef5f None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:10.997581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e681059-83b9-49a6-8459-cbd56a7cc2ad None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:11.120450 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e681059-83b9-49a6-8459-cbd56a7cc2ad None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:11.138203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c55d7-0b8f-480f-81e4-2ce430d0ef5f None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:11.188236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3629977-701c-4a57-95a4-fdf917a0535e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:11.189326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3629977-701c-4a57-95a4-fdf917a0535e None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:11.189784 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3629977-701c-4a57-95a4-fdf917a0535e None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:11.190261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3629977-701c-4a57-95a4-fdf917a0535e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:11.200708 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3629977-701c-4a57-95a4-fdf917a0535e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:11.204854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df7c4d-1268-418b-a75d-89018aa19215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:11.205688 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df7c4d-1268-418b-a75d-89018aa19215 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:11.205972 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df7c4d-1268-418b-a75d-89018aa19215 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:11.206246 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df7c4d-1268-418b-a75d-89018aa19215 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:11.209576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-c3629977-701c-4a57-95a4-fdf917a0535e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:11.209576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:11.209576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:11.209576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:11.209576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:11.209576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:11.209576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:11.209576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:11.209576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:11.209576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:11.209576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:11.209576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:11.209576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:11.209576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:11.209576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:11.209576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:11.210481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:11.210481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:11.210481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:11.210481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:11.210481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:11.210481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:11.210481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:11.210481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:11.210481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:11.210481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:11.210481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:11.210481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:11.210481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:11.210481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:11.210481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:11.210481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:11.211877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:11.211877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:11.211877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:11.211877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:11.211877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:11.211877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:11.211877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:11.211877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:11.211877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:11.211877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:11.211877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:11.211877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:11.221282 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 115/225] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:46:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:11.227559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3629977-701c-4a57-95a4-fdf917a0535e None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:11.233056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df7c4d-1268-418b-a75d-89018aa19215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:11.249249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-86df7c4d-1268-418b-a75d-89018aa19215 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:11.249249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:11.249249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:11.249249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:11.249249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:11.249249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:11.249249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:11.249249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:11.249249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:11.249249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:11.249249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:11.249249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:11.249249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:11.249249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:11.249249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:11.249249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:11.250384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:11.250384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:11.250384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:11.250384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:11.250384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:11.250384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:11.250384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:11.250384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:11.250384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:11.250384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:11.250384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:11.250384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:11.250384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:11.250384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:11.250384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:11.250384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:11.251388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:11.251388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:11.251388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:11.251388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:11.251388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:11.251388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:11.251388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:11.251388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:11.251388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:11.251388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:11.251388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:11.251388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:11.251388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 111/226] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:46:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:11.256435 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df7c4d-1268-418b-a75d-89018aa19215 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:11.330283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3629977-701c-4a57-95a4-fdf917a0535e None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:11.364957 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298648a-9d7e-4b6c-89c6-926029fd85db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:11.365863 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298648a-9d7e-4b6c-89c6-926029fd85db None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:11.366292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298648a-9d7e-4b6c-89c6-926029fd85db None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:11.366711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298648a-9d7e-4b6c-89c6-926029fd85db None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:11.367649 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298648a-9d7e-4b6c-89c6-926029fd85db None admin] RBAC: Adding query filter params (name=admin) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:11.368101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298648a-9d7e-4b6c-89c6-926029fd85db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:11.369653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298648a-9d7e-4b6c-89c6-926029fd85db None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:11.393775 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 116/227] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:11.395750 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298648a-9d7e-4b6c-89c6-926029fd85db None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:11.467412 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df7c4d-1268-418b-a75d-89018aa19215 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:11.500532 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298648a-9d7e-4b6c-89c6-926029fd85db None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:11.528410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cb4ac-5255-4cf8-b566-0df00d219499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:11.529086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cb4ac-5255-4cf8-b566-0df00d219499 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:11.529360 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cb4ac-5255-4cf8-b566-0df00d219499 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:11.529626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cb4ac-5255-4cf8-b566-0df00d219499 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:11.530375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cb4ac-5255-4cf8-b566-0df00d219499 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:11.530680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cb4ac-5255-4cf8-b566-0df00d219499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:11.532336 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cb4ac-5255-4cf8-b566-0df00d219499 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:11.552904 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bb9c5-16aa-4325-a5e7-ddafafb6e664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:11.553785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bb9c5-16aa-4325-a5e7-ddafafb6e664 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:11.554065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bb9c5-16aa-4325-a5e7-ddafafb6e664 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:11.554341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bb9c5-16aa-4325-a5e7-ddafafb6e664 None admin] PATH_INFO: `/v3/users/263300ffe8144e3a915971914559b18c` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:11.555576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bb9c5-16aa-4325-a5e7-ddafafb6e664 None admin] RBAC: Authorizing `identity:get_user(user_id=263300ffe8144e3a915971914559b18c)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:11.557236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bb9c5-16aa-4325-a5e7-ddafafb6e664 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:11.558414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 112/228] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:11.558855 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 117/229] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:11 2022] GET /identity/v3/users/263300ffe8144e3a915971914559b18c => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:11.564255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cb4ac-5255-4cf8-b566-0df00d219499 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:11.565686 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bb9c5-16aa-4325-a5e7-ddafafb6e664 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:11.712612 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cb4ac-5255-4cf8-b566-0df00d219499 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:11.748646 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0baa3-6930-46a0-b72f-c26f35c8505c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:11.749652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0baa3-6930-46a0-b72f-c26f35c8505c None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:11.749941 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0baa3-6930-46a0-b72f-c26f35c8505c None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:11.750216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0baa3-6930-46a0-b72f-c26f35c8505c None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:11.751391 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0baa3-6930-46a0-b72f-c26f35c8505c None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:11.752871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0baa3-6930-46a0-b72f-c26f35c8505c None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:11.755256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 113/230] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:11 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:11.761366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0baa3-6930-46a0-b72f-c26f35c8505c None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:11.790046 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bb9c5-16aa-4325-a5e7-ddafafb6e664 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:11.861902 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ed6c0-b71f-4029-898c-0161422ee6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:11.862777 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ed6c0-b71f-4029-898c-0161422ee6d8 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:11.863057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ed6c0-b71f-4029-898c-0161422ee6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:11.863333 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ed6c0-b71f-4029-898c-0161422ee6d8 None admin] PATH_INFO: `/v3/users/263300ffe8144e3a915971914559b18c` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:11.868889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ed6c0-b71f-4029-898c-0161422ee6d8 None admin] RBAC: Authorizing `identity:get_user(user_id=263300ffe8144e3a915971914559b18c)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:11.869381 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0baa3-6930-46a0-b72f-c26f35c8505c None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:11.870356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ed6c0-b71f-4029-898c-0161422ee6d8 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:11.872007 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 118/231] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:11 2022] GET /identity/v3/users/263300ffe8144e3a915971914559b18c => generated 283 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:11.877426 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ed6c0-b71f-4029-898c-0161422ee6d8 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:11.905864 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fe1d6-3148-4d6d-9475-c2c36d205a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:11.907070 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fe1d6-3148-4d6d-9475-c2c36d205a41 None admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:11.907353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fe1d6-3148-4d6d-9475-c2c36d205a41 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:11.907630 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fe1d6-3148-4d6d-9475-c2c36d205a41 None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a/users/263300ffe8144e3a915971914559b18c/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:11.909890 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fe1d6-3148-4d6d-9475-c2c36d205a41 None admin] RBAC: Authorizing `identity:create_grant(project_id=e826a1db652e46829670062be316817a, user_id=263300ffe8144e3a915971914559b18c, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:11.911535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fe1d6-3148-4d6d-9475-c2c36d205a41 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:11.936546 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 114/232] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:46:11 2022] PUT /identity/v3/projects/e826a1db652e46829670062be316817a/users/263300ffe8144e3a915971914559b18c/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:12.042940 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ed6c0-b71f-4029-898c-0161422ee6d8 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:12.090420 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620fda9-4c32-47e9-a8a2-a2b3f9ed7af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:12.091358 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620fda9-4c32-47e9-a8a2-a2b3f9ed7af9 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:12.091642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620fda9-4c32-47e9-a8a2-a2b3f9ed7af9 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:12.091922 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620fda9-4c32-47e9-a8a2-a2b3f9ed7af9 None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:12.093230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620fda9-4c32-47e9-a8a2-a2b3f9ed7af9 None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:12.094685 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620fda9-4c32-47e9-a8a2-a2b3f9ed7af9 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:12.096647 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 119/233] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:11 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:12.103096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fe1d6-3148-4d6d-9475-c2c36d205a41 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:12.225438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fe1d6-3148-4d6d-9475-c2c36d205a41 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:12.260411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a010d1-7338-424c-b035-5de3a9b9ec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:12.261308 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a010d1-7338-424c-b035-5de3a9b9ec6a None admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:12.261586 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a010d1-7338-424c-b035-5de3a9b9ec6a None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:12.261859 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a010d1-7338-424c-b035-5de3a9b9ec6a None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a/users/263300ffe8144e3a915971914559b18c/roles/c8015925658a407b9977b5b0a7f50f05` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:12.264079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a010d1-7338-424c-b035-5de3a9b9ec6a None admin] RBAC: Authorizing `identity:create_grant(project_id=e826a1db652e46829670062be316817a, user_id=263300ffe8144e3a915971914559b18c, role_id=c8015925658a407b9977b5b0a7f50f05)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:12.265730 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a010d1-7338-424c-b035-5de3a9b9ec6a None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:12.284252 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 115/234] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:46:12 2022] PUT /identity/v3/projects/e826a1db652e46829670062be316817a/users/263300ffe8144e3a915971914559b18c/roles/c8015925658a407b9977b5b0a7f50f05 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:12.659536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b416d-d1b2-4660-8fea-1bc2e66ae1cc None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:12.659879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b416d-d1b2-4660-8fea-1bc2e66ae1cc None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:12.660049 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b416d-d1b2-4660-8fea-1bc2e66ae1cc None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:12.661610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 120/235] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:12.668796 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42377-9f28-44c1-b620-3536a21f3400 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:12.669374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42377-9f28-44c1-b620-3536a21f3400 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:12.669374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42377-9f28-44c1-b620-3536a21f3400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:12.691223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-e7a42377-9f28-44c1-b620-3536a21f3400 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:12.692449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e7a42377-9f28-44c1-b620-3536a21f3400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:12.732705 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bd265-6936-41cf-8bdf-944a56818085 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:12.733036 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bd265-6936-41cf-8bdf-944a56818085 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:12.733251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bd265-6936-41cf-8bdf-944a56818085 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:12.734766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 121/236] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:12.739711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bfc83-c439-47e3-9499-9ed62b1ad31b None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:12.739996 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bfc83-c439-47e3-9499-9ed62b1ad31b None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:12.740302 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bfc83-c439-47e3-9499-9ed62b1ad31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:12.756591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-e54bfc83-c439-47e3-9499-9ed62b1ad31b None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:12.757948 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-e54bfc83-c439-47e3-9499-9ed62b1ad31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:12.776480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 116/237] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:12.805954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a42377-9f28-44c1-b620-3536a21f3400 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:12.883092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 122/238] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:12.912918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a42377-9f28-44c1-b620-3536a21f3400 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:12.919151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bfc83-c439-47e3-9499-9ed62b1ad31b None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:12.946748 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad45ed-1983-4bbd-80e5-7eb0183e82b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:12.947548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad45ed-1983-4bbd-80e5-7eb0183e82b1 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:12.947827 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad45ed-1983-4bbd-80e5-7eb0183e82b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:12.948101 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad45ed-1983-4bbd-80e5-7eb0183e82b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:12.949299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad45ed-1983-4bbd-80e5-7eb0183e82b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:12.950740 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad45ed-1983-4bbd-80e5-7eb0183e82b1 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:12.952551 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 117/239] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:12.978198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad45ed-1983-4bbd-80e5-7eb0183e82b1 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:13.041704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bfc83-c439-47e3-9499-9ed62b1ad31b None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:13.086789 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cd916-3f23-4084-b51b-5f6a1214b7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:13.087593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cd916-3f23-4084-b51b-5f6a1214b7b1 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:13.087869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cd916-3f23-4084-b51b-5f6a1214b7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:13.088140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cd916-3f23-4084-b51b-5f6a1214b7b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:13.109336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cd916-3f23-4084-b51b-5f6a1214b7b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:13.113462 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad45ed-1983-4bbd-80e5-7eb0183e82b1 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:13.125276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-724cd916-3f23-4084-b51b-5f6a1214b7b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:13.125276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:13.125276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:13.125276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:13.125276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:13.125276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:13.125276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:13.125276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:13.125276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:13.125276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:13.125276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:13.125276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:13.125276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:13.125276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:13.125276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:13.125276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:13.127439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:13.127439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:13.127439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:13.127439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:13.127439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:13.127439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:13.127439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:13.127439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:13.127439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:13.127439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:13.127439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:13.127439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:13.127439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:13.127439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:13.127439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:13.127439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:13.129534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:13.129534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:13.129534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:13.129534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:13.129534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:13.129534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:13.129534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:13.129534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:13.129534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:13.129534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:13.129534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:13.129534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:13.129534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 123/240] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:13.136205 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cd916-3f23-4084-b51b-5f6a1214b7b1 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:13.149844 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82a382-6ac5-4445-b27d-bd197f0f6ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:13.150527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82a382-6ac5-4445-b27d-bd197f0f6ac1 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:13.150804 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82a382-6ac5-4445-b27d-bd197f0f6ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:13.151077 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82a382-6ac5-4445-b27d-bd197f0f6ac1 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:13.151789 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82a382-6ac5-4445-b27d-bd197f0f6ac1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:13.153246 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82a382-6ac5-4445-b27d-bd197f0f6ac1 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:13.181727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 118/241] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:46:12 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:46:13.187787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3a228-3038-46ac-8232-ca3d38fe2d11 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:13.188111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3a228-3038-46ac-8232-ca3d38fe2d11 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:13.188403 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3a228-3038-46ac-8232-ca3d38fe2d11 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:13.189962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 119/242] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:13.198352 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab474d4-0bc8-47fb-a279-30a91cadc78e None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:13.198352 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab474d4-0bc8-47fb-a279-30a91cadc78e None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:13.198352 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab474d4-0bc8-47fb-a279-30a91cadc78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:13.218109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-dab474d4-0bc8-47fb-a279-30a91cadc78e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:13.220703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-dab474d4-0bc8-47fb-a279-30a91cadc78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:13.269398 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cd916-3f23-4084-b51b-5f6a1214b7b1 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:13.325493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6375cbb-c68c-4ed9-9710-82817500f29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:13.326169 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6375cbb-c68c-4ed9-9710-82817500f29d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:13.326453 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6375cbb-c68c-4ed9-9710-82817500f29d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:13.326724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6375cbb-c68c-4ed9-9710-82817500f29d None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:13.327506 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6375cbb-c68c-4ed9-9710-82817500f29d None admin] RBAC: Adding query filter params (name=reader) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:13.327790 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6375cbb-c68c-4ed9-9710-82817500f29d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:13.329242 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6375cbb-c68c-4ed9-9710-82817500f29d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:13.342754 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 120/243] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:13.355152 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 124/244] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:13.360634 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab474d4-0bc8-47fb-a279-30a91cadc78e None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:13.367216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6375cbb-c68c-4ed9-9710-82817500f29d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:13.509896 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab474d4-0bc8-47fb-a279-30a91cadc78e None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:13.514609 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6375cbb-c68c-4ed9-9710-82817500f29d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:13.553363 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2087ea9-7fe1-4f28-ad1d-13ea20ab1c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:13.555970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2087ea9-7fe1-4f28-ad1d-13ea20ab1c4d None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:13.556512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2087ea9-7fe1-4f28-ad1d-13ea20ab1c4d None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:13.556987 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2087ea9-7fe1-4f28-ad1d-13ea20ab1c4d None admin] PATH_INFO: `/v3/users/5410532f28d44208b5a9bf06ce7824e5` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:13.558704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a65b5-cf6c-447a-85cd-1cdd2e256742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:13.559494 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a65b5-cf6c-447a-85cd-1cdd2e256742 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:13.559784 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a65b5-cf6c-447a-85cd-1cdd2e256742 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:13.560114 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a65b5-cf6c-447a-85cd-1cdd2e256742 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:13.574405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a65b5-cf6c-447a-85cd-1cdd2e256742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:13.575224 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2087ea9-7fe1-4f28-ad1d-13ea20ab1c4d None admin] RBAC: Authorizing `identity:get_user(user_id=5410532f28d44208b5a9bf06ce7824e5)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:13.576940 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2087ea9-7fe1-4f28-ad1d-13ea20ab1c4d None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:13.579168 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 121/245] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:13 2022] GET /identity/v3/users/5410532f28d44208b5a9bf06ce7824e5 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:13.586237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2087ea9-7fe1-4f28-ad1d-13ea20ab1c4d None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:13.587396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-334a65b5-cf6c-447a-85cd-1cdd2e256742 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:13.587396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:13.587396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:13.587396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:13.587396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:13.587396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:13.587396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:13.587396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:13.587396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:13.587396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:13.587396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:13.587396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:13.587396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:13.587396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:13.587396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:13.587396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:13.588310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:13.588310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:13.588310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:13.588310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:13.588310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:13.588310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:13.588310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:13.588310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:13.588310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:13.588310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:13.588310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:13.588310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:13.588310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:13.588310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:13.588310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:13.588310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:13.589140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:13.589140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:13.589140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:13.589140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:13.589140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:13.589140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:13.589140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:13.589140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:13.589140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:13.589140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:13.589140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:13.589140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:13.589140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 125/246] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:13.594528 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a65b5-cf6c-447a-85cd-1cdd2e256742 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:13.701319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a65b5-cf6c-447a-85cd-1cdd2e256742 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:13.712549 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2087ea9-7fe1-4f28-ad1d-13ea20ab1c4d None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:13.744528 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f95522-8c09-4a77-a418-df7076db553a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:13.745482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f95522-8c09-4a77-a418-df7076db553a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:13.745868 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f95522-8c09-4a77-a418-df7076db553a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:13.746404 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f95522-8c09-4a77-a418-df7076db553a None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:13.747563 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f95522-8c09-4a77-a418-df7076db553a None admin] RBAC: Adding query filter params (name=member) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:13.748119 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f95522-8c09-4a77-a418-df7076db553a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:13.750009 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f95522-8c09-4a77-a418-df7076db553a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:13.752301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235da889-dcba-481b-91be-a8be0e647576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:13.753202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235da889-dcba-481b-91be-a8be0e647576 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:13.753674 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235da889-dcba-481b-91be-a8be0e647576 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:13.754138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235da889-dcba-481b-91be-a8be0e647576 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:13.760817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 126/247] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:13.771740 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f95522-8c09-4a77-a418-df7076db553a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:13.840377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235da889-dcba-481b-91be-a8be0e647576 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:13.842555 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235da889-dcba-481b-91be-a8be0e647576 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:13.890260 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f95522-8c09-4a77-a418-df7076db553a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:13.940626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041c4bc-807b-4b71-b5cc-e95467e9df0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:13.941851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041c4bc-807b-4b71-b5cc-e95467e9df0c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:13.942354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041c4bc-807b-4b71-b5cc-e95467e9df0c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:13.942818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041c4bc-807b-4b71-b5cc-e95467e9df0c None admin] PATH_INFO: `/v3/users/d379fa150feb4d9197014ae64669a6b0` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:13.944262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041c4bc-807b-4b71-b5cc-e95467e9df0c None admin] RBAC: Authorizing `identity:get_user(user_id=d379fa150feb4d9197014ae64669a6b0)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:13.945941 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041c4bc-807b-4b71-b5cc-e95467e9df0c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:13.948077 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 127/248] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:13 2022] GET /identity/v3/users/d379fa150feb4d9197014ae64669a6b0 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:13.953543 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041c4bc-807b-4b71-b5cc-e95467e9df0c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:13.976690 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 122/249] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:13.985038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235da889-dcba-481b-91be-a8be0e647576 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:14.066023 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041c4bc-807b-4b71-b5cc-e95467e9df0c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:14.091396 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235da889-dcba-481b-91be-a8be0e647576 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:14.099793 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a369706-5034-431f-b3ef-e6555e4fac75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:14.101027 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a369706-5034-431f-b3ef-e6555e4fac75 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:14.102070 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a369706-5034-431f-b3ef-e6555e4fac75 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:14.102561 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a369706-5034-431f-b3ef-e6555e4fac75 None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:14.103953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a369706-5034-431f-b3ef-e6555e4fac75 None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:14.105631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a369706-5034-431f-b3ef-e6555e4fac75 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:14.107556 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 128/250] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:13 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:14.113110 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a369706-5034-431f-b3ef-e6555e4fac75 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:14.127553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e524705-467a-47ec-b6de-07e79d220c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:14.128589 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e524705-467a-47ec-b6de-07e79d220c06 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:14.128871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e524705-467a-47ec-b6de-07e79d220c06 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:14.129149 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e524705-467a-47ec-b6de-07e79d220c06 None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:14.130404 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e524705-467a-47ec-b6de-07e79d220c06 None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:14.132128 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e524705-467a-47ec-b6de-07e79d220c06 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:14.134015 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 123/251] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:13 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:14.157671 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e524705-467a-47ec-b6de-07e79d220c06 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:14.222237 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a369706-5034-431f-b3ef-e6555e4fac75 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:14.266175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722268f-2f51-4050-9f7d-7d64f03e2e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:14.268122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722268f-2f51-4050-9f7d-7d64f03e2e07 None admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:14.270868 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722268f-2f51-4050-9f7d-7d64f03e2e07 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:14.271387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722268f-2f51-4050-9f7d-7d64f03e2e07 None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a/users/d379fa150feb4d9197014ae64669a6b0/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:14.275065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722268f-2f51-4050-9f7d-7d64f03e2e07 None admin] RBAC: Authorizing `identity:create_grant(project_id=e826a1db652e46829670062be316817a, user_id=d379fa150feb4d9197014ae64669a6b0, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:14.277837 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722268f-2f51-4050-9f7d-7d64f03e2e07 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:14.314507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 129/252] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:46:14 2022] PUT /identity/v3/projects/e826a1db652e46829670062be316817a/users/d379fa150feb4d9197014ae64669a6b0/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:14.350718 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e524705-467a-47ec-b6de-07e79d220c06 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:14.410810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4fda4-bb6d-4f3e-9587-fd8bafaca2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:14.411841 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4fda4-bb6d-4f3e-9587-fd8bafaca2b9 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:14.412363 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4fda4-bb6d-4f3e-9587-fd8bafaca2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:14.412864 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4fda4-bb6d-4f3e-9587-fd8bafaca2b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:14.414456 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4fda4-bb6d-4f3e-9587-fd8bafaca2b9 None admin] RBAC: Adding query filter params (role.id=97d9563192e147dda2ea8cd2d201552c, scope.project.id=e826a1db652e46829670062be316817a, user.id=5410532f28d44208b5a9bf06ce7824e5) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:14.414964 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4fda4-bb6d-4f3e-9587-fd8bafaca2b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:14.416812 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4fda4-bb6d-4f3e-9587-fd8bafaca2b9 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:14.427302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 124/253] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:14 2022] GET /identity/v3/role_assignments?user.id=5410532f28d44208b5a9bf06ce7824e5&scope.project.id=e826a1db652e46829670062be316817a&role.id=97d9563192e147dda2ea8cd2d201552c => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:14.873995 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe0232-d6cc-4f58-8900-37aae61ec68d None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:14.874680 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe0232-d6cc-4f58-8900-37aae61ec68d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:14.875165 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe0232-d6cc-4f58-8900-37aae61ec68d None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:14.876836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 130/254] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:14.887643 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967b8e9-ddf4-4863-989a-02ab0b940dcd None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:14.888607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967b8e9-ddf4-4863-989a-02ab0b940dcd None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:14.889083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967b8e9-ddf4-4863-989a-02ab0b940dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:14.913139 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-1967b8e9-ddf4-4863-989a-02ab0b940dcd None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:14.914693 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-1967b8e9-ddf4-4863-989a-02ab0b940dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:14.990218 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 125/255] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:15.022834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe0232-d6cc-4f58-8900-37aae61ec68d None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:15.153125 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe0232-d6cc-4f58-8900-37aae61ec68d None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:15.196291 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56f0b0-274b-4a2c-9120-d2214f293eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:15.197117 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56f0b0-274b-4a2c-9120-d2214f293eec None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:15.197399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56f0b0-274b-4a2c-9120-d2214f293eec None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:15.197674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56f0b0-274b-4a2c-9120-d2214f293eec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:15.214488 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56f0b0-274b-4a2c-9120-d2214f293eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:15.222442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-0d56f0b0-274b-4a2c-9120-d2214f293eec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:15.222442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:15.222442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:15.222442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:15.222442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:15.222442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:15.222442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:15.222442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:15.222442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:15.222442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:15.222442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:15.222442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:15.222442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:15.222442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:15.222442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:15.222442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:15.223499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:15.223499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:15.223499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:15.223499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:15.223499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:15.223499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:15.223499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:15.223499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:15.223499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:15.223499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:15.223499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:15.223499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:15.223499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:15.223499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:15.223499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:15.223499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:15.224337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:15.224337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:15.224337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:15.224337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:15.224337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:15.224337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:15.224337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:15.224337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:15.224337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:15.224337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:15.224337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:15.224337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:15.224337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 131/256] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:46:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:15.229781 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967b8e9-ddf4-4863-989a-02ab0b940dcd None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:15.338903 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967b8e9-ddf4-4863-989a-02ab0b940dcd None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:15.376672 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143d5a3-1168-4c4d-9f08-01a84447acda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:15.377342 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143d5a3-1168-4c4d-9f08-01a84447acda None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:15.377619 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143d5a3-1168-4c4d-9f08-01a84447acda None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:15.377894 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143d5a3-1168-4c4d-9f08-01a84447acda None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:15.378656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143d5a3-1168-4c4d-9f08-01a84447acda None admin] RBAC: Adding query filter params (name=admin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:15.378960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143d5a3-1168-4c4d-9f08-01a84447acda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:15.380357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143d5a3-1168-4c4d-9f08-01a84447acda None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:15.402485 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 126/257] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:15.408243 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56f0b0-274b-4a2c-9120-d2214f293eec None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:15.521597 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56f0b0-274b-4a2c-9120-d2214f293eec None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:15.523572 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0b1ab-65c1-4d19-8b8b-67e508b0e258 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:15.523856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0b1ab-65c1-4d19-8b8b-67e508b0e258 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:15.524130 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0b1ab-65c1-4d19-8b8b-67e508b0e258 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:15.525645 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 127/258] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:15.532621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2173cc-e28e-4c2a-beb2-bb9ef1ff5529 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:15.532905 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2173cc-e28e-4c2a-beb2-bb9ef1ff5529 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:15.533185 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2173cc-e28e-4c2a-beb2-bb9ef1ff5529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:15.560134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-cf2173cc-e28e-4c2a-beb2-bb9ef1ff5529 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:15.561357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cf2173cc-e28e-4c2a-beb2-bb9ef1ff5529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:15.602102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b9c6f-20ae-48e7-b33b-9091e0ea57ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:15.602972 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b9c6f-20ae-48e7-b33b-9091e0ea57ad None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:15.603252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b9c6f-20ae-48e7-b33b-9091e0ea57ad None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:15.603523 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b9c6f-20ae-48e7-b33b-9091e0ea57ad None admin] PATH_INFO: `/v3/users/263300ffe8144e3a915971914559b18c` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:15.608195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b9c6f-20ae-48e7-b33b-9091e0ea57ad None admin] RBAC: Authorizing `identity:get_user(user_id=263300ffe8144e3a915971914559b18c)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:15.608195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b9c6f-20ae-48e7-b33b-9091e0ea57ad None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:15.608521 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 132/259] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:15 2022] GET /identity/v3/users/263300ffe8144e3a915971914559b18c => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:15.615168 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b9c6f-20ae-48e7-b33b-9091e0ea57ad None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:15.680666 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 128/260] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:15.718270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2173cc-e28e-4c2a-beb2-bb9ef1ff5529 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:15.838846 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b9c6f-20ae-48e7-b33b-9091e0ea57ad None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:15.900261 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2173cc-e28e-4c2a-beb2-bb9ef1ff5529 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:15.925769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e53154-9242-4278-a8d3-15a32038ce7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:15.926430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e53154-9242-4278-a8d3-15a32038ce7c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:15.926710 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e53154-9242-4278-a8d3-15a32038ce7c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:15.926986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e53154-9242-4278-a8d3-15a32038ce7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:15.961453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737bf5a5-0675-4f6f-88f4-10d573cd07e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:15.962599 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bf5a5-0675-4f6f-88f4-10d573cd07e6 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:15.963109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bf5a5-0675-4f6f-88f4-10d573cd07e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:15.963582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bf5a5-0675-4f6f-88f4-10d573cd07e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:15.981631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737bf5a5-0675-4f6f-88f4-10d573cd07e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:15.991376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-737bf5a5-0675-4f6f-88f4-10d573cd07e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:15.991376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:15.991376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:15.991376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:15.991376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:15.991376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:15.991376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:15.991376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:15.991376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:15.991376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:15.991376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:15.991376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:15.991376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:15.991376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:15.991376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:15.991376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:15.992992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:15.992992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:15.992992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:15.992992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:15.992992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:15.992992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:15.992992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:15.992992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:15.992992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:15.992992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:15.992992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:15.992992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:15.992992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:15.992992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:15.992992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:15.992992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:15.993806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:15.993806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:15.993806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:15.993806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:15.993806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:15.993806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:15.993806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:15.993806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:15.993806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:15.993806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:15.993806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:15.993806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:15.996494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 129/261] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:46:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:16.001710 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737bf5a5-0675-4f6f-88f4-10d573cd07e6 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:16.034323 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e53154-9242-4278-a8d3-15a32038ce7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:16.035780 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e53154-9242-4278-a8d3-15a32038ce7c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:16.142190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 133/262] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 13:46:16.147568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e53154-9242-4278-a8d3-15a32038ce7c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:16.161382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737bf5a5-0675-4f6f-88f4-10d573cd07e6 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:16.205802 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1856a3-beb5-461e-b67e-2b64bd7ffd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:16.206493 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1856a3-beb5-461e-b67e-2b64bd7ffd35 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:16.206775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1856a3-beb5-461e-b67e-2b64bd7ffd35 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:16.207050 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1856a3-beb5-461e-b67e-2b64bd7ffd35 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:16.207806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1856a3-beb5-461e-b67e-2b64bd7ffd35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:16.208116 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1856a3-beb5-461e-b67e-2b64bd7ffd35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:16.209574 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1856a3-beb5-461e-b67e-2b64bd7ffd35 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:16.224319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 130/263] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:16.230216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1856a3-beb5-461e-b67e-2b64bd7ffd35 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:16.262164 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e53154-9242-4278-a8d3-15a32038ce7c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:16.330602 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d41b2-5a7a-499f-be13-5d0af97f6308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:16.331460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d41b2-5a7a-499f-be13-5d0af97f6308 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:16.331738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d41b2-5a7a-499f-be13-5d0af97f6308 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:16.332008 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d41b2-5a7a-499f-be13-5d0af97f6308 None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:16.333325 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d41b2-5a7a-499f-be13-5d0af97f6308 None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:16.334779 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d41b2-5a7a-499f-be13-5d0af97f6308 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:16.336560 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 134/264] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:16 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:16.342833 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d41b2-5a7a-499f-be13-5d0af97f6308 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:16.439692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1856a3-beb5-461e-b67e-2b64bd7ffd35 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:16.508205 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154af81-a835-4e1f-bf6f-aa87e5ff5442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:16.509443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154af81-a835-4e1f-bf6f-aa87e5ff5442 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:16.509937 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154af81-a835-4e1f-bf6f-aa87e5ff5442 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:16.510443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154af81-a835-4e1f-bf6f-aa87e5ff5442 None admin] PATH_INFO: `/v3/users/263300ffe8144e3a915971914559b18c` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:16.512086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154af81-a835-4e1f-bf6f-aa87e5ff5442 None admin] RBAC: Authorizing `identity:get_user(user_id=263300ffe8144e3a915971914559b18c)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:16.514299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154af81-a835-4e1f-bf6f-aa87e5ff5442 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:16.518395 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 131/265] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:16 2022] GET /identity/v3/users/263300ffe8144e3a915971914559b18c => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:16.525698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154af81-a835-4e1f-bf6f-aa87e5ff5442 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:16.553022 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d41b2-5a7a-499f-be13-5d0af97f6308 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:16.630893 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e2c68-f87b-447d-874b-214b62bea762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:16.631548 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2c68-f87b-447d-874b-214b62bea762 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:16.631827 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2c68-f87b-447d-874b-214b62bea762 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:16.632099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2c68-f87b-447d-874b-214b62bea762 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:16.632998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e2c68-f87b-447d-874b-214b62bea762 None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=e826a1db652e46829670062be316817a, user.id=263300ffe8144e3a915971914559b18c) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:16.633306 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e2c68-f87b-447d-874b-214b62bea762 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:16.634742 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e2c68-f87b-447d-874b-214b62bea762 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:16.643523 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 135/266] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:16 2022] GET /identity/v3/role_assignments?user.id=263300ffe8144e3a915971914559b18c&scope.project.id=e826a1db652e46829670062be316817a&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:16.695581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154af81-a835-4e1f-bf6f-aa87e5ff5442 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:16.744912 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938b240-b8da-45eb-8f4a-6fcf1a482b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:16.745571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938b240-b8da-45eb-8f4a-6fcf1a482b0b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:16.745850 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938b240-b8da-45eb-8f4a-6fcf1a482b0b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:16.746122 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938b240-b8da-45eb-8f4a-6fcf1a482b0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:16.841266 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938b240-b8da-45eb-8f4a-6fcf1a482b0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:16.842713 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938b240-b8da-45eb-8f4a-6fcf1a482b0b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:16.972687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 132/267] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:16.978478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e2c68-f87b-447d-874b-214b62bea762 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:17.064467 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256296b4-a368-4279-a483-1f92f3ab4dca None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:17.065129 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256296b4-a368-4279-a483-1f92f3ab4dca None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:17.065644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256296b4-a368-4279-a483-1f92f3ab4dca None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:17.067242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 133/268] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:17.073071 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc5f7-1f7b-4f5b-a2cf-a72cb00c169b None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:17.073619 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc5f7-1f7b-4f5b-a2cf-a72cb00c169b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:17.074126 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc5f7-1f7b-4f5b-a2cf-a72cb00c169b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:17.098916 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e2c68-f87b-447d-874b-214b62bea762 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:17.105323 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-2a0dc5f7-1f7b-4f5b-a2cf-a72cb00c169b None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:17.106883 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-2a0dc5f7-1f7b-4f5b-a2cf-a72cb00c169b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:17.160815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08ff66-f71d-4dbe-8679-0c627199db8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:17.161674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08ff66-f71d-4dbe-8679-0c627199db8f None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:17.161950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08ff66-f71d-4dbe-8679-0c627199db8f None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:17.162215 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08ff66-f71d-4dbe-8679-0c627199db8f None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:17.163976 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08ff66-f71d-4dbe-8679-0c627199db8f None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:17.166526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08ff66-f71d-4dbe-8679-0c627199db8f None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:17.168251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 136/269] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:16 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:17.174708 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08ff66-f71d-4dbe-8679-0c627199db8f None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:17.215003 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 134/270] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:17.261407 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dc5f7-1f7b-4f5b-a2cf-a72cb00c169b None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:17.301670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08ff66-f71d-4dbe-8679-0c627199db8f None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:17.346240 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a7aef-164c-4266-a188-955ba96e9330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:17.346902 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a7aef-164c-4266-a188-955ba96e9330 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:17.347181 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a7aef-164c-4266-a188-955ba96e9330 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:17.347453 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a7aef-164c-4266-a188-955ba96e9330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:17.348309 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a7aef-164c-4266-a188-955ba96e9330 None admin] RBAC: Adding query filter params (role.id=c8015925658a407b9977b5b0a7f50f05, scope.project.id=e826a1db652e46829670062be316817a, user.id=263300ffe8144e3a915971914559b18c) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:17.348614 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a7aef-164c-4266-a188-955ba96e9330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:17.350097 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a7aef-164c-4266-a188-955ba96e9330 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:17.360232 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 137/271] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:17 2022] GET /identity/v3/role_assignments?user.id=263300ffe8144e3a915971914559b18c&scope.project.id=e826a1db652e46829670062be316817a&role.id=c8015925658a407b9977b5b0a7f50f05 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:17.409616 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b6611-daf3-4234-9612-7ef3a4961416 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:17.409947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b6611-daf3-4234-9612-7ef3a4961416 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:17.410169 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b6611-daf3-4234-9612-7ef3a4961416 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:17.411721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 138/272] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:17.426176 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636dd33-4698-4b60-b33d-f47f0be1edfa None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:17.426484 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636dd33-4698-4b60-b33d-f47f0be1edfa None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:17.426724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636dd33-4698-4b60-b33d-f47f0be1edfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:17.452910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-9636dd33-4698-4b60-b33d-f47f0be1edfa None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:17.454135 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-9636dd33-4698-4b60-b33d-f47f0be1edfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:17.460222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dc5f7-1f7b-4f5b-a2cf-a72cb00c169b None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:17.514643 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb5999-225e-4607-9d91-3939b0f788b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:17.515475 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb5999-225e-4607-9d91-3939b0f788b8 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:17.515752 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb5999-225e-4607-9d91-3939b0f788b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:17.516142 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb5999-225e-4607-9d91-3939b0f788b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:17.517562 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb5999-225e-4607-9d91-3939b0f788b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:17.519175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb5999-225e-4607-9d91-3939b0f788b8 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:17.521176 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 135/273] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:17.529192 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb5999-225e-4607-9d91-3939b0f788b8 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:17.587719 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 139/274] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:17.611661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636dd33-4698-4b60-b33d-f47f0be1edfa None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:17.644646 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb5999-225e-4607-9d91-3939b0f788b8 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:17.688019 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093d96d-15ed-4464-92a9-313d94f78334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:17.688745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093d96d-15ed-4464-92a9-313d94f78334 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:17.689022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093d96d-15ed-4464-92a9-313d94f78334 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:17.689293 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093d96d-15ed-4464-92a9-313d94f78334 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:17.689999 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093d96d-15ed-4464-92a9-313d94f78334 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:17.691592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093d96d-15ed-4464-92a9-313d94f78334 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:17.724236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 136/275] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:46:17 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:46:17.724236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a93f5-0ff2-4826-82c8-7e6454f42c4c None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:17.724236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a93f5-0ff2-4826-82c8-7e6454f42c4c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:17.724236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a93f5-0ff2-4826-82c8-7e6454f42c4c None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:17.724236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 137/276] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:17.731092 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b44130-c0fc-4f6b-9051-c197b08ee398 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:17.731422 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b44130-c0fc-4f6b-9051-c197b08ee398 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:17.731650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b44130-c0fc-4f6b-9051-c197b08ee398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:17.738621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636dd33-4698-4b60-b33d-f47f0be1edfa None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:17.753505 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-13b44130-c0fc-4f6b-9051-c197b08ee398 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:17.754721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-13b44130-c0fc-4f6b-9051-c197b08ee398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:17.787826 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f6377-2f83-4912-8e68-35ffb7b4dde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:17.789374 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f6377-2f83-4912-8e68-35ffb7b4dde4 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:17.789653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f6377-2f83-4912-8e68-35ffb7b4dde4 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:17.790323 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f6377-2f83-4912-8e68-35ffb7b4dde4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:17.808295 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f6377-2f83-4912-8e68-35ffb7b4dde4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:17.818122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-a45f6377-2f83-4912-8e68-35ffb7b4dde4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:17.818122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:17.818122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:17.818122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:17.818122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:17.818122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:17.818122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:17.818122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:17.818122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:17.818122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:17.818122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:17.818122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:17.818122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:17.818122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:17.818122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:17.818122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:17.819158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:17.819158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:17.819158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:17.819158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:17.819158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:17.819158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:17.819158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:17.819158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:17.819158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:17.819158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:17.819158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:17.819158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:17.819158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:17.819158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:17.819158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:17.819158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:17.820781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:17.820781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:17.820781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:17.820781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:17.820781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:17.820781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:17.820781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:17.820781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:17.820781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:17.820781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:17.820781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:17.820781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:17.825479 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 140/277] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:17.829287 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f6377-2f83-4912-8e68-35ffb7b4dde4 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:17.848781 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 138/278] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:17.872111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b44130-c0fc-4f6b-9051-c197b08ee398 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:17.945987 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f6377-2f83-4912-8e68-35ffb7b4dde4 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:17.979806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b44130-c0fc-4f6b-9051-c197b08ee398 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:17.981672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5758e-7170-4033-b64b-fbf2e028160c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:17.982644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5758e-7170-4033-b64b-fbf2e028160c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:17.982644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5758e-7170-4033-b64b-fbf2e028160c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:17.982944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5758e-7170-4033-b64b-fbf2e028160c None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:17.983574 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5758e-7170-4033-b64b-fbf2e028160c None admin] RBAC: Adding query filter params (name=member) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:17.983873 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5758e-7170-4033-b64b-fbf2e028160c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:17.985282 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5758e-7170-4033-b64b-fbf2e028160c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:17.994881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 141/279] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:17.999896 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5758e-7170-4033-b64b-fbf2e028160c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:18.019641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909eda41-92f0-4fc0-b9d8-854a85d090b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:18.020840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909eda41-92f0-4fc0-b9d8-854a85d090b3 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:18.021188 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909eda41-92f0-4fc0-b9d8-854a85d090b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:18.021537 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909eda41-92f0-4fc0-b9d8-854a85d090b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:18.034548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909eda41-92f0-4fc0-b9d8-854a85d090b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:18.042543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-909eda41-92f0-4fc0-b9d8-854a85d090b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:18.042543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:18.042543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:18.042543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:18.042543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:18.042543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:18.042543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:18.042543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:18.042543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:18.042543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:18.042543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:18.042543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:18.042543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:18.042543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:18.042543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:18.042543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:18.043466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:18.043466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:18.043466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:18.043466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:18.043466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:18.043466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:18.043466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:18.043466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:18.043466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:18.043466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:18.043466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:18.043466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:18.043466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:18.043466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:18.043466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:18.043466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:18.044321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:18.044321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:18.044321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:18.044321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:18.044321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:18.044321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:18.044321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:18.044321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:18.044321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:18.044321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:18.044321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:18.044321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:18.044321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 139/280] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:18.045514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c01cb-8f81-49e3-9c16-f161ed5cfe92 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:18.045675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c01cb-8f81-49e3-9c16-f161ed5cfe92 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:18.045920 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c01cb-8f81-49e3-9c16-f161ed5cfe92 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:18.047335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 140/281] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:18.050729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c01cb-8f81-49e3-9c16-f161ed5cfe92 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:18.107859 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5758e-7170-4033-b64b-fbf2e028160c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:18.142654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c4238-84f4-4544-adc3-830a59e88ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:18.143470 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c4238-84f4-4544-adc3-830a59e88ec1 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:18.143738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c4238-84f4-4544-adc3-830a59e88ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:18.144018 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c4238-84f4-4544-adc3-830a59e88ec1 None admin] PATH_INFO: `/v3/users/ce022755e2b1435fb63c03eca4ac36f5` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:18.158621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c4238-84f4-4544-adc3-830a59e88ec1 None admin] RBAC: Authorizing `identity:get_user(user_id=ce022755e2b1435fb63c03eca4ac36f5)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:18.160104 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c4238-84f4-4544-adc3-830a59e88ec1 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:18.161854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 142/282] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:17 2022] GET /identity/v3/users/ce022755e2b1435fb63c03eca4ac36f5 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:18.163102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f36e39-5969-408b-b663-851d4a387c59 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:18.163395 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f36e39-5969-408b-b663-851d4a387c59 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:18.163708 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f36e39-5969-408b-b663-851d4a387c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:18.172849 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c01cb-8f81-49e3-9c16-f161ed5cfe92 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:18.189091 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-31f36e39-5969-408b-b663-851d4a387c59 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:18.190371 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-31f36e39-5969-408b-b663-851d4a387c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:18.212320 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd68cd-d478-466f-b46f-df717911396b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:18.213345 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd68cd-d478-466f-b46f-df717911396b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:18.213824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd68cd-d478-466f-b46f-df717911396b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:18.214292 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd68cd-d478-466f-b46f-df717911396b None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:18.215276 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd68cd-d478-466f-b46f-df717911396b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:18.215893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd68cd-d478-466f-b46f-df717911396b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:18.217538 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd68cd-d478-466f-b46f-df717911396b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:18.226948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 141/283] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:18.228241 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd68cd-d478-466f-b46f-df717911396b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:18.272157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 143/284] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:18.277017 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f36e39-5969-408b-b663-851d4a387c59 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:18.349048 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd68cd-d478-466f-b46f-df717911396b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:18.396254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69516d27-ef0c-48d9-a3bc-ea8452a89650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:18.396869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f36e39-5969-408b-b663-851d4a387c59 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:18.397504 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69516d27-ef0c-48d9-a3bc-ea8452a89650 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:18.398101 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69516d27-ef0c-48d9-a3bc-ea8452a89650 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:18.398573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69516d27-ef0c-48d9-a3bc-ea8452a89650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:18.399607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69516d27-ef0c-48d9-a3bc-ea8452a89650 None admin] RBAC: Adding query filter params (role.id=15845f6e13b44ef7893159f660311b15, user.id=ce022755e2b1435fb63c03eca4ac36f5, scope.system=all) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:18.400133 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69516d27-ef0c-48d9-a3bc-ea8452a89650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:18.401804 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69516d27-ef0c-48d9-a3bc-ea8452a89650 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:18.407722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 142/285] 10.222.0.49 () {56 vars in 1308 bytes} [Tue May 10 13:46:18 2022] GET /identity/v3/role_assignments?user.id=ce022755e2b1435fb63c03eca4ac36f5&scope.system=all&role.id=15845f6e13b44ef7893159f660311b15 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:18.408773 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69516d27-ef0c-48d9-a3bc-ea8452a89650 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:18.434326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba2fac-467f-437a-841e-75d483d63dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:18.435198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba2fac-467f-437a-841e-75d483d63dea None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:18.435491 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba2fac-467f-437a-841e-75d483d63dea None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:18.435749 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba2fac-467f-437a-841e-75d483d63dea None admin] PATH_INFO: `/v3/users/5410532f28d44208b5a9bf06ce7824e5` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:18.437121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba2fac-467f-437a-841e-75d483d63dea None admin] RBAC: Authorizing `identity:get_user(user_id=5410532f28d44208b5a9bf06ce7824e5)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:18.438629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba2fac-467f-437a-841e-75d483d63dea None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:18.440436 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 144/286] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:18 2022] GET /identity/v3/users/5410532f28d44208b5a9bf06ce7824e5 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:18.446031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba2fac-467f-437a-841e-75d483d63dea None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:18.589287 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba2fac-467f-437a-841e-75d483d63dea None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:18.604665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69516d27-ef0c-48d9-a3bc-ea8452a89650 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:18.648563 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dacd36-2fc0-445c-b71a-4a026956df45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:18.649636 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dacd36-2fc0-445c-b71a-4a026956df45 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:18.650060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dacd36-2fc0-445c-b71a-4a026956df45 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:18.650339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dacd36-2fc0-445c-b71a-4a026956df45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:18.661786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dacd36-2fc0-445c-b71a-4a026956df45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:18.669993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-e7dacd36-2fc0-445c-b71a-4a026956df45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:18.669993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:18.669993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:18.669993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:18.669993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:18.669993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:18.669993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:18.669993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:18.669993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:18.669993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:18.669993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:18.669993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:18.669993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:18.669993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:18.669993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:18.669993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:18.670907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:18.670907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:18.670907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:18.670907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:18.670907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:18.670907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:18.670907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:18.670907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:18.670907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:18.670907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:18.670907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:18.670907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:18.670907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:18.670907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:18.670907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:18.670907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:18.671722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:18.671722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:18.671722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:18.671722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:18.671722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:18.671722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:18.671722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:18.671722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:18.671722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:18.671722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:18.671722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:18.671722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:18.672393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0de7fe-19b9-4891-972e-ff0752572c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:18.672393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de7fe-19b9-4891-972e-ff0752572c6d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:18.672537 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 143/287] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:18.672602 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de7fe-19b9-4891-972e-ff0752572c6d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:18.672602 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de7fe-19b9-4891-972e-ff0752572c6d None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:18.673155 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0de7fe-19b9-4891-972e-ff0752572c6d None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:18.674658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0de7fe-19b9-4891-972e-ff0752572c6d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:18.676674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 145/288] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:18 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:18.682322 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dacd36-2fc0-445c-b71a-4a026956df45 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:18.685449 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0de7fe-19b9-4891-972e-ff0752572c6d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:18.843677 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dacd36-2fc0-445c-b71a-4a026956df45 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:18.870473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0de7fe-19b9-4891-972e-ff0752572c6d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:18.893168 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a9f06-572a-4039-bb77-614a6b2a2a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:18.894244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a9f06-572a-4039-bb77-614a6b2a2a7b None admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:18.894523 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a9f06-572a-4039-bb77-614a6b2a2a7b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:18.894797 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a9f06-572a-4039-bb77-614a6b2a2a7b None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a/users/5410532f28d44208b5a9bf06ce7824e5/roles/97d9563192e147dda2ea8cd2d201552c` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:18.898721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a9f06-572a-4039-bb77-614a6b2a2a7b None admin] RBAC: Authorizing `identity:create_grant(project_id=e826a1db652e46829670062be316817a, user_id=5410532f28d44208b5a9bf06ce7824e5, role_id=97d9563192e147dda2ea8cd2d201552c)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:18.900100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a9f06-572a-4039-bb77-614a6b2a2a7b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:18.924270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 144/289] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:46:18 2022] PUT /identity/v3/projects/e826a1db652e46829670062be316817a/users/5410532f28d44208b5a9bf06ce7824e5/roles/97d9563192e147dda2ea8cd2d201552c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 13:46:18.929227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa049fc1-5175-42ad-861d-d5c22f623aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:18.929904 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049fc1-5175-42ad-861d-d5c22f623aac None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:18.930184 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049fc1-5175-42ad-861d-d5c22f623aac None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:18.930456 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049fc1-5175-42ad-861d-d5c22f623aac None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:18.931208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa049fc1-5175-42ad-861d-d5c22f623aac None admin] RBAC: Adding query filter params (name=member) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:18.931558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa049fc1-5175-42ad-861d-d5c22f623aac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:18.933029 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa049fc1-5175-42ad-861d-d5c22f623aac None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:18.945786 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 146/290] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:18.951649 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a9f06-572a-4039-bb77-614a6b2a2a7b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:19.060734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a9f06-572a-4039-bb77-614a6b2a2a7b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:19.097661 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc1d00-da43-4a6c-af76-ae38b78b3230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:19.098552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc1d00-da43-4a6c-af76-ae38b78b3230 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:19.098838 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc1d00-da43-4a6c-af76-ae38b78b3230 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:19.099109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc1d00-da43-4a6c-af76-ae38b78b3230 None admin] PATH_INFO: `/v3/users/d379fa150feb4d9197014ae64669a6b0` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:19.100368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc1d00-da43-4a6c-af76-ae38b78b3230 None admin] RBAC: Authorizing `identity:get_user(user_id=d379fa150feb4d9197014ae64669a6b0)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:19.102114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc1d00-da43-4a6c-af76-ae38b78b3230 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:19.108548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 145/291] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:18 2022] GET /identity/v3/users/d379fa150feb4d9197014ae64669a6b0 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:19.111579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa049fc1-5175-42ad-861d-d5c22f623aac None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:19.212785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa049fc1-5175-42ad-861d-d5c22f623aac None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:19.246375 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfae723-2d0e-4beb-b166-2a08214e2dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:19.247030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfae723-2d0e-4beb-b166-2a08214e2dea None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:19.247310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfae723-2d0e-4beb-b166-2a08214e2dea None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:19.247582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfae723-2d0e-4beb-b166-2a08214e2dea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:19.319541 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfae723-2d0e-4beb-b166-2a08214e2dea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:19.321575 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfae723-2d0e-4beb-b166-2a08214e2dea None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:19.424976 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 147/292] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:19.427394 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc1d00-da43-4a6c-af76-ae38b78b3230 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:19.526460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc1d00-da43-4a6c-af76-ae38b78b3230 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:19.559746 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb46127-4e88-410d-bbb9-03daa1f3c0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:19.560646 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb46127-4e88-410d-bbb9-03daa1f3c0c2 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:19.560918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb46127-4e88-410d-bbb9-03daa1f3c0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:19.561192 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb46127-4e88-410d-bbb9-03daa1f3c0c2 None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:19.562370 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb46127-4e88-410d-bbb9-03daa1f3c0c2 None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:19.563794 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb46127-4e88-410d-bbb9-03daa1f3c0c2 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:19.570890 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 146/293] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:19 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:19.572249 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfae723-2d0e-4beb-b166-2a08214e2dea None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:19.711789 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfae723-2d0e-4beb-b166-2a08214e2dea None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:19.755195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae0d1f-131d-429a-a99a-a84de3cdf59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:19.755907 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae0d1f-131d-429a-a99a-a84de3cdf59e None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:19.756210 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae0d1f-131d-429a-a99a-a84de3cdf59e None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:19.756496 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae0d1f-131d-429a-a99a-a84de3cdf59e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:19.757966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae0d1f-131d-429a-a99a-a84de3cdf59e None admin] RBAC: Adding query filter params (role.id=15845f6e13b44ef7893159f660311b15, scope.project.id=e826a1db652e46829670062be316817a, user.id=d379fa150feb4d9197014ae64669a6b0) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:19.758279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae0d1f-131d-429a-a99a-a84de3cdf59e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:19.759726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae0d1f-131d-429a-a99a-a84de3cdf59e None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:19.768896 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 148/294] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:19 2022] GET /identity/v3/role_assignments?user.id=d379fa150feb4d9197014ae64669a6b0&scope.project.id=e826a1db652e46829670062be316817a&role.id=15845f6e13b44ef7893159f660311b15 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:20.502507 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271469e5-0706-4f8e-aa86-434f3d9ee5c1 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:20.503524 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271469e5-0706-4f8e-aa86-434f3d9ee5c1 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:20.504003 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271469e5-0706-4f8e-aa86-434f3d9ee5c1 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:20.505870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 147/295] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:20.511809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd98485-581d-4ab5-aa81-9b5b9496931d None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:20.512657 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd98485-581d-4ab5-aa81-9b5b9496931d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:20.513124 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd98485-581d-4ab5-aa81-9b5b9496931d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:20.516464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ce74e-f541-454c-816e-24ff3c9ac5f0 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:20.516756 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ce74e-f541-454c-816e-24ff3c9ac5f0 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:20.517039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ce74e-f541-454c-816e-24ff3c9ac5f0 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:20.518368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 148/296] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:20.524814 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244d158-2f7e-4690-ac46-6fb7fda67b7d None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:20.525295 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244d158-2f7e-4690-ac46-6fb7fda67b7d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:20.525562 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244d158-2f7e-4690-ac46-6fb7fda67b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:20.535789 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-8cd98485-581d-4ab5-aa81-9b5b9496931d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:20.537256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8cd98485-581d-4ab5-aa81-9b5b9496931d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:20.543695 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-c244d158-2f7e-4690-ac46-6fb7fda67b7d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:20.544913 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c244d158-2f7e-4690-ac46-6fb7fda67b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:20.622676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 149/297] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:20.636318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 149/298] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:20.649220 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd98485-581d-4ab5-aa81-9b5b9496931d None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:20.660885 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244d158-2f7e-4690-ac46-6fb7fda67b7d None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:20.760966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd98485-581d-4ab5-aa81-9b5b9496931d None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:20.789526 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244d158-2f7e-4690-ac46-6fb7fda67b7d None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:20.796836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a7e0c-e6f3-4075-8f77-471e700c3eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:20.797863 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a7e0c-e6f3-4075-8f77-471e700c3eac None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:20.798341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a7e0c-e6f3-4075-8f77-471e700c3eac None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:20.798809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a7e0c-e6f3-4075-8f77-471e700c3eac None admin] PATH_INFO: `/v3/domains/default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:20.800216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a7e0c-e6f3-4075-8f77-471e700c3eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:20.801849 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a7e0c-e6f3-4075-8f77-471e700c3eac None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:20.803675 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 150/299] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:20.810033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a7e0c-e6f3-4075-8f77-471e700c3eac None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:20.830004 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6127eda-f7dc-4db0-8158-850a6f109e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:20.831050 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6127eda-f7dc-4db0-8158-850a6f109e46 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:20.831335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6127eda-f7dc-4db0-8158-850a6f109e46 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:20.831611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6127eda-f7dc-4db0-8158-850a6f109e46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:20.847858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6127eda-f7dc-4db0-8158-850a6f109e46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:20.856297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-c6127eda-f7dc-4db0-8158-850a6f109e46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:20.856297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:20.856297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:20.856297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:20.856297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:20.856297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:20.856297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:20.856297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:20.856297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:20.856297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:20.856297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:20.856297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:20.856297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:20.856297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:20.856297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:20.856297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:20.857232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:20.857232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:20.857232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:20.857232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:20.857232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:20.857232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:20.857232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:20.857232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:20.857232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:20.857232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:20.857232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:20.857232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:20.857232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:20.857232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:20.857232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:20.857232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:20.858472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:20.858472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:20.858472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:20.858472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:20.858472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:20.858472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:20.858472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:20.858472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:20.858472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:20.858472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:20.858472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:20.858472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:20.858472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 150/300] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:20.863218 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6127eda-f7dc-4db0-8158-850a6f109e46 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:20.942109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a7e0c-e6f3-4075-8f77-471e700c3eac None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:20.971508 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6127eda-f7dc-4db0-8158-850a6f109e46 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:20.975114 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e3645-3c10-4702-a34f-4210bd9518dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:20.976045 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e3645-3c10-4702-a34f-4210bd9518dc None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:20.976508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e3645-3c10-4702-a34f-4210bd9518dc None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:20.976926 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e3645-3c10-4702-a34f-4210bd9518dc None admin] PATH_INFO: `/v3/groups` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:20.977756 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e3645-3c10-4702-a34f-4210bd9518dc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:20.979355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e3645-3c10-4702-a34f-4210bd9518dc None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:21.000508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 151/301] 10.222.0.49 () {60 vars in 1134 bytes} [Tue May 10 13:46:20 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:46:21.009867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b583ee-06c7-4707-bf29-eaf5c50a98d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:21.010718 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b583ee-06c7-4707-bf29-eaf5c50a98d5 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:21.011109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b583ee-06c7-4707-bf29-eaf5c50a98d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:21.011455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b583ee-06c7-4707-bf29-eaf5c50a98d5 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:21.012470 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b583ee-06c7-4707-bf29-eaf5c50a98d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:21.013123 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b583ee-06c7-4707-bf29-eaf5c50a98d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:21.014368 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549ada3-4044-42df-8b41-643ed7f910c7 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:21.014587 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b583ee-06c7-4707-bf29-eaf5c50a98d5 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:21.014705 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549ada3-4044-42df-8b41-643ed7f910c7 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:21.014926 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549ada3-4044-42df-8b41-643ed7f910c7 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:21.016809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 152/302] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:21.022724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8844133-3d2c-4998-b197-497c59677efa None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:21.023088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8844133-3d2c-4998-b197-497c59677efa None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:21.023316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8844133-3d2c-4998-b197-497c59677efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:21.024909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 151/303] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:21.033690 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b583ee-06c7-4707-bf29-eaf5c50a98d5 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:21.043480 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-c8844133-3d2c-4998-b197-497c59677efa None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:21.044871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-c8844133-3d2c-4998-b197-497c59677efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:21.149101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 153/304] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:21.172826 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b583ee-06c7-4707-bf29-eaf5c50a98d5 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:21.175010 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8844133-3d2c-4998-b197-497c59677efa None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:21.209884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100accb5-4d6c-456d-8559-b979237cebd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:21.211207 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100accb5-4d6c-456d-8559-b979237cebd7 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:21.211717 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100accb5-4d6c-456d-8559-b979237cebd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:21.212142 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100accb5-4d6c-456d-8559-b979237cebd7 None admin] PATH_INFO: `/v3/users/acc73ffad6d54142b8d47b615d1a3862` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:21.227844 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100accb5-4d6c-456d-8559-b979237cebd7 None admin] RBAC: Authorizing `identity:get_user(user_id=acc73ffad6d54142b8d47b615d1a3862)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:21.229988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100accb5-4d6c-456d-8559-b979237cebd7 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:21.232514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 152/305] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:21 2022] GET /identity/v3/users/acc73ffad6d54142b8d47b615d1a3862 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:21.238697 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100accb5-4d6c-456d-8559-b979237cebd7 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:21.303814 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8844133-3d2c-4998-b197-497c59677efa None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:21.342630 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100accb5-4d6c-456d-8559-b979237cebd7 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:21.347243 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aeda5-c890-4606-aef7-13ccdc260dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:21.348044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aeda5-c890-4606-aef7-13ccdc260dd1 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:21.348372 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aeda5-c890-4606-aef7-13ccdc260dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:21.348646 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aeda5-c890-4606-aef7-13ccdc260dd1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:21.362252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9aeda5-c890-4606-aef7-13ccdc260dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:21.372247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-ed9aeda5-c890-4606-aef7-13ccdc260dd1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:21.372247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:21.372247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:21.372247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:21.372247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:21.372247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:21.372247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:21.372247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:21.372247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:21.372247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:21.372247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:21.372247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:21.372247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:21.372247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:21.372247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:21.372247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:21.373201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:21.373201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:21.373201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:21.373201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:21.373201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:21.373201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:21.373201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:21.373201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:21.373201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:21.373201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:21.373201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:21.373201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:21.373201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:21.373201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:21.373201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:21.373201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:21.374593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:21.374593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:21.374593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:21.374593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:21.374593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:21.374593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:21.374593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:21.374593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:21.374593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:21.374593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:21.374593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:21.374593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:21.374593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 154/306] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:21.379402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aeda5-c890-4606-aef7-13ccdc260dd1 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:21.384917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4772ac6-1699-48be-921d-379f9112d2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:21.385683 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4772ac6-1699-48be-921d-379f9112d2f0 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:21.386101 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4772ac6-1699-48be-921d-379f9112d2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:21.386496 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4772ac6-1699-48be-921d-379f9112d2f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:21.387455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4772ac6-1699-48be-921d-379f9112d2f0 None admin] RBAC: Adding query filter params (role.id=97d9563192e147dda2ea8cd2d201552c, user.id=acc73ffad6d54142b8d47b615d1a3862, scope.system=all) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:21.387848 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4772ac6-1699-48be-921d-379f9112d2f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:21.389377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4772ac6-1699-48be-921d-379f9112d2f0 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:21.402858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 153/307] 10.222.0.49 () {56 vars in 1308 bytes} [Tue May 10 13:46:21 2022] GET /identity/v3/role_assignments?user.id=acc73ffad6d54142b8d47b615d1a3862&scope.system=all&role.id=97d9563192e147dda2ea8cd2d201552c => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:21.502048 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aeda5-c890-4606-aef7-13ccdc260dd1 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:21.540405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f714965-3fa1-4e8e-9de6-a96cb4a74a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:21.541194 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f714965-3fa1-4e8e-9de6-a96cb4a74a07 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:21.541430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f714965-3fa1-4e8e-9de6-a96cb4a74a07 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:21.541710 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f714965-3fa1-4e8e-9de6-a96cb4a74a07 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:21.542492 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f714965-3fa1-4e8e-9de6-a96cb4a74a07 None admin] RBAC: Adding query filter params (name=member) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:21.542798 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f714965-3fa1-4e8e-9de6-a96cb4a74a07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:21.544308 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f714965-3fa1-4e8e-9de6-a96cb4a74a07 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:21.555357 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 155/308] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:21.565393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4772ac6-1699-48be-921d-379f9112d2f0 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:21.669992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4772ac6-1699-48be-921d-379f9112d2f0 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:21.703965 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384e662-1057-4d06-944b-ac9d71b985d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:21.705260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384e662-1057-4d06-944b-ac9d71b985d7 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:21.705765 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384e662-1057-4d06-944b-ac9d71b985d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:21.706325 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384e662-1057-4d06-944b-ac9d71b985d7 None admin] PATH_INFO: `/v3/users/ce022755e2b1435fb63c03eca4ac36f5` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:21.707745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7384e662-1057-4d06-944b-ac9d71b985d7 None admin] RBAC: Authorizing `identity:get_user(user_id=ce022755e2b1435fb63c03eca4ac36f5)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:21.709404 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7384e662-1057-4d06-944b-ac9d71b985d7 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:21.712067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 154/309] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:21 2022] GET /identity/v3/users/ce022755e2b1435fb63c03eca4ac36f5 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:21.717840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f714965-3fa1-4e8e-9de6-a96cb4a74a07 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:21.728055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ee670-b8fb-47c1-a84d-8e46b279f63d None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:21.728055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ee670-b8fb-47c1-a84d-8e46b279f63d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:21.728296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ee670-b8fb-47c1-a84d-8e46b279f63d None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:21.729624 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 155/310] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:21.734513 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b61dc-90e2-4a1a-bafc-d1e8c3d445c2 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:21.734795 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b61dc-90e2-4a1a-bafc-d1e8c3d445c2 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:21.735157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b61dc-90e2-4a1a-bafc-d1e8c3d445c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:21.752399 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-a95b61dc-90e2-4a1a-bafc-d1e8c3d445c2 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:21.754060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a95b61dc-90e2-4a1a-bafc-d1e8c3d445c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:21.828524 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 156/311] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:21.832071 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f714965-3fa1-4e8e-9de6-a96cb4a74a07 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:21.846948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b61dc-90e2-4a1a-bafc-d1e8c3d445c2 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:21.872564 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7363b-bc30-4296-9e83-17d1561706e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:21.873959 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7363b-bc30-4296-9e83-17d1561706e7 None admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:21.874547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7363b-bc30-4296-9e83-17d1561706e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:21.875342 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7363b-bc30-4296-9e83-17d1561706e7 None admin] PATH_INFO: `/v3/system/users/ce022755e2b1435fb63c03eca4ac36f5/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:21.877505 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7363b-bc30-4296-9e83-17d1561706e7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ce022755e2b1435fb63c03eca4ac36f5, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:21.879617 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7363b-bc30-4296-9e83-17d1561706e7 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:21.894625 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 156/312] 10.222.0.49 () {58 vars in 1334 bytes} [Tue May 10 13:46:21 2022] PUT /identity/v3/system/users/ce022755e2b1435fb63c03eca4ac36f5/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:21.961208 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b61dc-90e2-4a1a-bafc-d1e8c3d445c2 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:21.997555 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb170ecb-be46-4702-a530-97551cc90787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:21.998368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170ecb-be46-4702-a530-97551cc90787 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:21.998644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170ecb-be46-4702-a530-97551cc90787 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:21.998915 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170ecb-be46-4702-a530-97551cc90787 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:22.011012 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb170ecb-be46-4702-a530-97551cc90787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:22.019025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-cb170ecb-be46-4702-a530-97551cc90787 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:22.019025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:22.019025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:22.019025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:22.019025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:22.019025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:22.019025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:22.019025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:22.019025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:22.019025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:22.019025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:22.019025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:22.019025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:22.019025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:22.019025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:22.019025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:22.019997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:22.019997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:22.019997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:22.019997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:22.019997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:22.019997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:22.019997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:22.019997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:22.019997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:22.019997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:22.019997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:22.019997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:22.019997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:22.019997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:22.019997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:22.019997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:22.020873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:22.020873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:22.020873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:22.020873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:22.020873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:22.020873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:22.020873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:22.020873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:22.020873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:22.020873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:22.020873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:22.020873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:22.020873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 157/313] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:22.026728 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7363b-bc30-4296-9e83-17d1561706e7 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:22.130022 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7363b-bc30-4296-9e83-17d1561706e7 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:22.162617 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd093d9-b9d6-4947-bebf-e3dd556f0be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:22.163278 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd093d9-b9d6-4947-bebf-e3dd556f0be3 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:22.164097 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd093d9-b9d6-4947-bebf-e3dd556f0be3 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:22.164403 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd093d9-b9d6-4947-bebf-e3dd556f0be3 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:22.165144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd093d9-b9d6-4947-bebf-e3dd556f0be3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:22.165444 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd093d9-b9d6-4947-bebf-e3dd556f0be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:22.166893 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd093d9-b9d6-4947-bebf-e3dd556f0be3 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:22.175338 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 157/314] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:22.181461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb170ecb-be46-4702-a530-97551cc90787 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:22.284666 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb170ecb-be46-4702-a530-97551cc90787 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:22.319878 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94514bd8-a73e-4988-825f-e78e1562d6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:22.321218 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94514bd8-a73e-4988-825f-e78e1562d6e4 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:22.321716 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94514bd8-a73e-4988-825f-e78e1562d6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:22.322187 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94514bd8-a73e-4988-825f-e78e1562d6e4 None admin] PATH_INFO: `/v3/users/5410532f28d44208b5a9bf06ce7824e5` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:22.323626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94514bd8-a73e-4988-825f-e78e1562d6e4 None admin] RBAC: Authorizing `identity:get_user(user_id=5410532f28d44208b5a9bf06ce7824e5)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:22.325296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94514bd8-a73e-4988-825f-e78e1562d6e4 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:22.327134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 158/315] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:22 2022] GET /identity/v3/users/5410532f28d44208b5a9bf06ce7824e5 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:22.333483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd093d9-b9d6-4947-bebf-e3dd556f0be3 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:22.445547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd093d9-b9d6-4947-bebf-e3dd556f0be3 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:22.483555 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8035e0e-9e8f-4006-9d0e-9c8d7aede5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:22.484230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8035e0e-9e8f-4006-9d0e-9c8d7aede5a9 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:22.484519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8035e0e-9e8f-4006-9d0e-9c8d7aede5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:22.484790 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8035e0e-9e8f-4006-9d0e-9c8d7aede5a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:22.550803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8035e0e-9e8f-4006-9d0e-9c8d7aede5a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:22.552190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8035e0e-9e8f-4006-9d0e-9c8d7aede5a9 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:22.652969 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 158/316] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:22.658478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94514bd8-a73e-4988-825f-e78e1562d6e4 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:22.759133 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94514bd8-a73e-4988-825f-e78e1562d6e4 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:22.793153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df3b71-8f00-412d-b401-1e579446b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:22.794011 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df3b71-8f00-412d-b401-1e579446b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:22.794286 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df3b71-8f00-412d-b401-1e579446b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:22.794563 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df3b71-8f00-412d-b401-1e579446b4e4 None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:22.795730 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df3b71-8f00-412d-b401-1e579446b4e4 None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:22.797179 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df3b71-8f00-412d-b401-1e579446b4e4 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:22.799153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 159/317] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:22 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:22.805324 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8035e0e-9e8f-4006-9d0e-9c8d7aede5a9 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:22.904163 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8035e0e-9e8f-4006-9d0e-9c8d7aede5a9 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:22.941607 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b82291-9b9e-4b6a-836a-d571ec5b45da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:22.942255 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b82291-9b9e-4b6a-836a-d571ec5b45da None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:22.942529 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b82291-9b9e-4b6a-836a-d571ec5b45da None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:22.942797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b82291-9b9e-4b6a-836a-d571ec5b45da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:22.943610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b82291-9b9e-4b6a-836a-d571ec5b45da None admin] RBAC: Adding query filter params (role.id=97d9563192e147dda2ea8cd2d201552c, scope.project.id=e826a1db652e46829670062be316817a, user.id=5410532f28d44208b5a9bf06ce7824e5) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:22.943913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b82291-9b9e-4b6a-836a-d571ec5b45da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:22.945888 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b82291-9b9e-4b6a-836a-d571ec5b45da None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:22.951895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 159/318] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:22 2022] GET /identity/v3/role_assignments?user.id=5410532f28d44208b5a9bf06ce7824e5&scope.project.id=e826a1db652e46829670062be316817a&role.id=97d9563192e147dda2ea8cd2d201552c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:23.371781 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86ae47-b7d2-4a8b-8dfd-cfd84b612131 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:23.372153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86ae47-b7d2-4a8b-8dfd-cfd84b612131 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:23.372380 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86ae47-b7d2-4a8b-8dfd-cfd84b612131 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:23.373783 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 160/319] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:23.380357 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cea36-e9db-4234-9131-beae765717ff None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:23.380357 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cea36-e9db-4234-9131-beae765717ff None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:23.380357 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cea36-e9db-4234-9131-beae765717ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:23.396991 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-5f2cea36-e9db-4234-9131-beae765717ff None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:23.398215 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-5f2cea36-e9db-4234-9131-beae765717ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:23.461285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 160/320] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:23.485812 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86ae47-b7d2-4a8b-8dfd-cfd84b612131 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:23.594523 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86ae47-b7d2-4a8b-8dfd-cfd84b612131 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:23.627042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a6732-c4f9-4df4-aabc-252627837931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:23.627768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a6732-c4f9-4df4-aabc-252627837931 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:23.628046 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a6732-c4f9-4df4-aabc-252627837931 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:23.628347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a6732-c4f9-4df4-aabc-252627837931 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:23.629502 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a6732-c4f9-4df4-aabc-252627837931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:23.630918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a6732-c4f9-4df4-aabc-252627837931 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:23.632749 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 161/321] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:23.638306 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cea36-e9db-4234-9131-beae765717ff None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:23.697212 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51818655-fc7e-4330-890e-6c764bb25881 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:23.697724 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51818655-fc7e-4330-890e-6c764bb25881 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:23.697827 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51818655-fc7e-4330-890e-6c764bb25881 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:23.699227 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 162/322] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:23.703919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f526de-1519-4ab4-94ba-68c061d17056 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:23.704226 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f526de-1519-4ab4-94ba-68c061d17056 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:23.704509 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f526de-1519-4ab4-94ba-68c061d17056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:23.720607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-28f526de-1519-4ab4-94ba-68c061d17056 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:23.721764 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-28f526de-1519-4ab4-94ba-68c061d17056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:23.736247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cea36-e9db-4234-9131-beae765717ff None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:23.770462 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec3f03-8c8d-4629-a7b8-006578905899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:23.771120 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec3f03-8c8d-4629-a7b8-006578905899 None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:23.771403 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec3f03-8c8d-4629-a7b8-006578905899 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:23.771679 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec3f03-8c8d-4629-a7b8-006578905899 None admin] PATH_INFO: `/v3/groups` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:23.772407 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec3f03-8c8d-4629-a7b8-006578905899 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:23.773868 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec3f03-8c8d-4629-a7b8-006578905899 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:23.787518 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 163/323] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:23.789081 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 161/324] 10.222.0.49 () {60 vars in 1134 bytes} [Tue May 10 13:46:23 2022] POST /identity/v3/groups => generated 226 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:46:23.813548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f526de-1519-4ab4-94ba-68c061d17056 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:23.920906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f526de-1519-4ab4-94ba-68c061d17056 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:23.957526 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e840e3-2363-4bbf-8fe2-a9ef615f3018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:23.958342 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e840e3-2363-4bbf-8fe2-a9ef615f3018 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:23.958617 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e840e3-2363-4bbf-8fe2-a9ef615f3018 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:23.958886 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e840e3-2363-4bbf-8fe2-a9ef615f3018 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:23.970656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e840e3-2363-4bbf-8fe2-a9ef615f3018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:23.978374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-02e840e3-2363-4bbf-8fe2-a9ef615f3018 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:23.978374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:23.978374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:23.978374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:23.978374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:23.978374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:23.978374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:23.978374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:23.978374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:23.978374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:23.978374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:23.978374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:23.978374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:23.978374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:23.978374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:23.978374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:23.979262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:23.979262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:23.979262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:23.979262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:23.979262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:23.979262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:23.979262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:23.979262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:23.979262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:23.979262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:23.979262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:23.979262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:23.979262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:23.979262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:23.979262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:23.979262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:23.980075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:23.980075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:23.980075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:23.980075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:23.980075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:23.980075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:23.980075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:23.980075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:23.980075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:23.980075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:23.980075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:23.980075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:23.980075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 164/325] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:23.985545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec3f03-8c8d-4629-a7b8-006578905899 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:24.085810 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec3f03-8c8d-4629-a7b8-006578905899 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:24.122897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9750e-da39-4e6d-a191-7719461a7768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:24.123582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9750e-da39-4e6d-a191-7719461a7768 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:24.123862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9750e-da39-4e6d-a191-7719461a7768 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:24.124135 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9750e-da39-4e6d-a191-7719461a7768 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:24.124935 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9750e-da39-4e6d-a191-7719461a7768 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:24.125238 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9750e-da39-4e6d-a191-7719461a7768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:24.126713 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9750e-da39-4e6d-a191-7719461a7768 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:24.137148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 162/326] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:24.142591 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e840e3-2363-4bbf-8fe2-a9ef615f3018 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:24.252512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e840e3-2363-4bbf-8fe2-a9ef615f3018 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:24.287552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fde4fd-b1d0-457a-8155-d56a2c1ee9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:24.288654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fde4fd-b1d0-457a-8155-d56a2c1ee9bd None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:24.288934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fde4fd-b1d0-457a-8155-d56a2c1ee9bd None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:24.289251 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fde4fd-b1d0-457a-8155-d56a2c1ee9bd None admin] PATH_INFO: `/v3/users/acc73ffad6d54142b8d47b615d1a3862` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:24.289617 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73618e-1228-4b00-885b-861c382d2cf5 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:24.289902 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73618e-1228-4b00-885b-861c382d2cf5 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:24.290178 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73618e-1228-4b00-885b-861c382d2cf5 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:24.290537 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fde4fd-b1d0-457a-8155-d56a2c1ee9bd None admin] RBAC: Authorizing `identity:get_user(user_id=acc73ffad6d54142b8d47b615d1a3862)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:24.291538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 163/327] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:24.292027 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fde4fd-b1d0-457a-8155-d56a2c1ee9bd None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:24.294073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 165/328] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:24 2022] GET /identity/v3/users/acc73ffad6d54142b8d47b615d1a3862 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:24.296829 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ace8a-1c39-441a-a203-572f2bb0e0f0 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:24.297115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ace8a-1c39-441a-a203-572f2bb0e0f0 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:24.297391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ace8a-1c39-441a-a203-572f2bb0e0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:24.299007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fde4fd-b1d0-457a-8155-d56a2c1ee9bd None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:24.317812 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-9b6ace8a-1c39-441a-a203-572f2bb0e0f0 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:24.318983 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-9b6ace8a-1c39-441a-a203-572f2bb0e0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:24.404226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 164/329] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:24.431513 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fde4fd-b1d0-457a-8155-d56a2c1ee9bd None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:24.434499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ace8a-1c39-441a-a203-572f2bb0e0f0 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:24.471366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9142d-a9f6-4997-8cba-3a0025a69a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:24.472845 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9142d-a9f6-4997-8cba-3a0025a69a62 None admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:24.472845 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9142d-a9f6-4997-8cba-3a0025a69a62 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:24.472845 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9142d-a9f6-4997-8cba-3a0025a69a62 None admin] PATH_INFO: `/v3/system/users/acc73ffad6d54142b8d47b615d1a3862/roles/97d9563192e147dda2ea8cd2d201552c` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:24.476380 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9142d-a9f6-4997-8cba-3a0025a69a62 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=acc73ffad6d54142b8d47b615d1a3862, role_id=97d9563192e147dda2ea8cd2d201552c)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:24.476380 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9142d-a9f6-4997-8cba-3a0025a69a62 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:24.487869 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 166/330] 10.222.0.49 () {58 vars in 1334 bytes} [Tue May 10 13:46:24 2022] PUT /identity/v3/system/users/acc73ffad6d54142b8d47b615d1a3862/roles/97d9563192e147dda2ea8cd2d201552c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 13:46:24.580378 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ace8a-1c39-441a-a203-572f2bb0e0f0 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:24.622364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cd33d-65f9-43ae-a34e-d3cfda0f86a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:24.623524 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cd33d-65f9-43ae-a34e-d3cfda0f86a4 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:24.624011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cd33d-65f9-43ae-a34e-d3cfda0f86a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:24.624553 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cd33d-65f9-43ae-a34e-d3cfda0f86a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:24.637521 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cd33d-65f9-43ae-a34e-d3cfda0f86a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:24.645867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-b09cd33d-65f9-43ae-a34e-d3cfda0f86a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:24.645867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:24.645867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:24.645867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:24.645867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:24.645867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:24.645867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:24.645867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:24.645867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:24.645867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:24.645867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:24.645867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:24.645867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:24.645867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:24.645867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:24.645867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:24.647370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:24.647370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:24.647370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:24.647370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:24.647370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:24.647370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:24.647370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:24.647370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:24.647370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:24.647370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:24.647370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:24.647370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:24.647370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:24.647370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:24.647370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:24.647370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:24.648262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:24.648262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:24.648262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:24.648262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:24.648262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:24.648262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:24.648262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:24.648262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:24.648262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:24.648262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:24.648262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:24.648262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:24.651125 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 165/331] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:24.658797 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9142d-a9f6-4997-8cba-3a0025a69a62 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:24.791709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9142d-a9f6-4997-8cba-3a0025a69a62 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:24.825255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d390b-4a45-4ba1-8422-9aab11f9c636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:24.825931 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d390b-4a45-4ba1-8422-9aab11f9c636 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:24.826212 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d390b-4a45-4ba1-8422-9aab11f9c636 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:24.826486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d390b-4a45-4ba1-8422-9aab11f9c636 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:24.827241 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d390b-4a45-4ba1-8422-9aab11f9c636 None admin] RBAC: Adding query filter params (name=member) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:24.827544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d390b-4a45-4ba1-8422-9aab11f9c636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:24.828943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d390b-4a45-4ba1-8422-9aab11f9c636 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:24.838667 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 167/332] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:24.843711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cd33d-65f9-43ae-a34e-d3cfda0f86a4 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:24.969553 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cd33d-65f9-43ae-a34e-d3cfda0f86a4 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:25.009181 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fb077-80d2-402c-af59-21eb2b27f401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:25.010326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fb077-80d2-402c-af59-21eb2b27f401 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:25.010777 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fb077-80d2-402c-af59-21eb2b27f401 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:25.011215 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fb077-80d2-402c-af59-21eb2b27f401 None admin] PATH_INFO: `/v3/users/ce022755e2b1435fb63c03eca4ac36f5` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:25.016905 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fb077-80d2-402c-af59-21eb2b27f401 None admin] RBAC: Authorizing `identity:get_user(user_id=ce022755e2b1435fb63c03eca4ac36f5)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:25.018529 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fb077-80d2-402c-af59-21eb2b27f401 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:25.020370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 166/333] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:24 2022] GET /identity/v3/users/ce022755e2b1435fb63c03eca4ac36f5 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:25.026653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d390b-4a45-4ba1-8422-9aab11f9c636 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:25.163208 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d390b-4a45-4ba1-8422-9aab11f9c636 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:25.199653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75000e8f-86f4-4554-af09-6fc07a662954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:25.200362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75000e8f-86f4-4554-af09-6fc07a662954 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:25.200647 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75000e8f-86f4-4554-af09-6fc07a662954 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:25.200924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75000e8f-86f4-4554-af09-6fc07a662954 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:25.201755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75000e8f-86f4-4554-af09-6fc07a662954 None admin] RBAC: Adding query filter params (role.id=15845f6e13b44ef7893159f660311b15, user.id=ce022755e2b1435fb63c03eca4ac36f5, scope.system=all) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:25.202069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75000e8f-86f4-4554-af09-6fc07a662954 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:25.203497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75000e8f-86f4-4554-af09-6fc07a662954 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:25.216551 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 168/334] 10.222.0.49 () {56 vars in 1308 bytes} [Tue May 10 13:46:25 2022] GET /identity/v3/role_assignments?user.id=ce022755e2b1435fb63c03eca4ac36f5&scope.system=all&role.id=15845f6e13b44ef7893159f660311b15 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:26.650003 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ebcf-6a77-4eeb-b71a-606c7168718a None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:26.650986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ebcf-6a77-4eeb-b71a-606c7168718a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:26.651497 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ebcf-6a77-4eeb-b71a-606c7168718a None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:26.653365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 167/335] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:26.665602 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f983c-2965-4bd4-ab60-0506dbac1358 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:26.666503 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f983c-2965-4bd4-ab60-0506dbac1358 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:26.666983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f983c-2965-4bd4-ab60-0506dbac1358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:26.697166 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-218f983c-2965-4bd4-ab60-0506dbac1358 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:26.698690 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-218f983c-2965-4bd4-ab60-0506dbac1358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:26.775267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 169/336] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:26.814658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402ebcf-6a77-4eeb-b71a-606c7168718a None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:26.941919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402ebcf-6a77-4eeb-b71a-606c7168718a None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:26.979775 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc09b56-766f-49a5-985d-3e3bb0620c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:26.980955 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc09b56-766f-49a5-985d-3e3bb0620c1f None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:26.981465 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc09b56-766f-49a5-985d-3e3bb0620c1f None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:26.981938 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc09b56-766f-49a5-985d-3e3bb0620c1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:26.997182 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc09b56-766f-49a5-985d-3e3bb0620c1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:27.005222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-6bc09b56-766f-49a5-985d-3e3bb0620c1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:27.005222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:27.005222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:27.005222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:27.005222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:27.005222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:27.005222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:27.005222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:27.005222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:27.005222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:27.005222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:27.005222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:27.005222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:27.005222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:27.005222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:27.005222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:27.006128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:27.006128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:27.006128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:27.006128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:27.006128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:27.006128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:27.006128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:27.006128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:27.006128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:27.006128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:27.006128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:27.006128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:27.006128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:27.006128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:27.006128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:27.006128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:27.007515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:27.007515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:27.007515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:27.007515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:27.007515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:27.007515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:27.007515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:27.007515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:27.007515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:27.007515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:27.007515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:27.007515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:27.010216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 168/337] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:27.016127 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f983c-2965-4bd4-ab60-0506dbac1358 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:27.123604 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f983c-2965-4bd4-ab60-0506dbac1358 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:27.162446 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262ea90-ef0e-4e02-8041-116fb81d33cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:27.163536 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262ea90-ef0e-4e02-8041-116fb81d33cc None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:27.164041 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262ea90-ef0e-4e02-8041-116fb81d33cc None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:27.164542 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262ea90-ef0e-4e02-8041-116fb81d33cc None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:27.165494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262ea90-ef0e-4e02-8041-116fb81d33cc None admin] RBAC: Adding query filter params (name=member) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:27.165999 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262ea90-ef0e-4e02-8041-116fb81d33cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:27.167573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262ea90-ef0e-4e02-8041-116fb81d33cc None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:27.177611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 170/338] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:27.183323 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc09b56-766f-49a5-985d-3e3bb0620c1f None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:27.266472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff8d9d-e80e-4de8-9e89-d0772f014fbb None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:27.267077 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff8d9d-e80e-4de8-9e89-d0772f014fbb None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:27.267559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff8d9d-e80e-4de8-9e89-d0772f014fbb None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:27.269984 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 171/339] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:27.275578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc667b-2552-49ce-a959-0dffc3242f09 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:27.275849 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc667b-2552-49ce-a959-0dffc3242f09 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:27.276476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc667b-2552-49ce-a959-0dffc3242f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:27.310652 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc09b56-766f-49a5-985d-3e3bb0620c1f None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:27.317169 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-ccfc667b-2552-49ce-a959-0dffc3242f09 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:27.318336 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ccfc667b-2552-49ce-a959-0dffc3242f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:27.366931 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4c0c9-71d0-4f08-8668-a24ab70a264c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:27.367631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4c0c9-71d0-4f08-8668-a24ab70a264c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:27.368081 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4c0c9-71d0-4f08-8668-a24ab70a264c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:27.368387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4c0c9-71d0-4f08-8668-a24ab70a264c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:27.477787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 172/340] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:27.509336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4c0c9-71d0-4f08-8668-a24ab70a264c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:27.510806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4c0c9-71d0-4f08-8668-a24ab70a264c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:27.517387 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc667b-2552-49ce-a959-0dffc3242f09 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:27.661516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 169/341] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:27.667824 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4c0c9-71d0-4f08-8668-a24ab70a264c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:27.693549 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc667b-2552-49ce-a959-0dffc3242f09 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:27.730709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2168a2-3ffa-449c-ad2c-0a975bd5994a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:27.731539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2168a2-3ffa-449c-ad2c-0a975bd5994a None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:27.731820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2168a2-3ffa-449c-ad2c-0a975bd5994a None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:27.732091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2168a2-3ffa-449c-ad2c-0a975bd5994a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:27.751491 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2168a2-3ffa-449c-ad2c-0a975bd5994a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:27.763921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-0a2168a2-3ffa-449c-ad2c-0a975bd5994a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:27.763921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:27.763921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:27.763921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:27.763921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:27.763921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:27.763921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:27.763921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:27.763921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:27.763921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:27.763921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:27.763921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:27.763921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:27.763921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:27.763921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:27.763921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:27.764948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:27.764948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:27.764948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:27.764948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:27.764948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:27.764948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:27.764948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:27.764948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:27.764948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:27.764948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:27.764948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:27.764948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:27.764948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:27.764948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:27.764948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:27.764948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:27.765803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:27.765803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:27.765803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:27.765803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:27.765803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:27.765803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:27.765803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:27.765803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:27.765803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:27.765803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:27.765803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:27.765803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:27.765803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 173/342] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:46:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:27.767529 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31be66e-6301-435d-a37d-404dba548560 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:27.767529 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31be66e-6301-435d-a37d-404dba548560 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:27.767529 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31be66e-6301-435d-a37d-404dba548560 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:27.769925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 174/343] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:27.775007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31be66e-6301-435d-a37d-404dba548560 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:27.783738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4c0c9-71d0-4f08-8668-a24ab70a264c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:27.826063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ed34d-1e98-48ed-bbb5-7d516bed6f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:27.826939 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ed34d-1e98-48ed-bbb5-7d516bed6f8a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:27.827276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ed34d-1e98-48ed-bbb5-7d516bed6f8a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:27.827548 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ed34d-1e98-48ed-bbb5-7d516bed6f8a None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:27.832949 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ed34d-1e98-48ed-bbb5-7d516bed6f8a None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:27.834478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ed34d-1e98-48ed-bbb5-7d516bed6f8a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:27.836694 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 170/344] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:27 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:27.837964 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54737596-6f19-4016-88b3-09cf503ef29f None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:27.838241 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54737596-6f19-4016-88b3-09cf503ef29f None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:27.838520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54737596-6f19-4016-88b3-09cf503ef29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:27.865384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-54737596-6f19-4016-88b3-09cf503ef29f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:27.867330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-54737596-6f19-4016-88b3-09cf503ef29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:27.894747 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31be66e-6301-435d-a37d-404dba548560 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:27.935616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b48f6d-41d9-447e-ac78-01a495554e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:27.936340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b48f6d-41d9-447e-ac78-01a495554e0f None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:27.936615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b48f6d-41d9-447e-ac78-01a495554e0f None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:27.936882 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b48f6d-41d9-447e-ac78-01a495554e0f None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:27.937630 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b48f6d-41d9-447e-ac78-01a495554e0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:27.937932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b48f6d-41d9-447e-ac78-01a495554e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:27.939294 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b48f6d-41d9-447e-ac78-01a495554e0f None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:27.956485 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 175/345] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:27.957153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b48f6d-41d9-447e-ac78-01a495554e0f None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:27.985705 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 171/346] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:27.986556 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54737596-6f19-4016-88b3-09cf503ef29f None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:28.116466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54737596-6f19-4016-88b3-09cf503ef29f None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:28.124741 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b48f6d-41d9-447e-ac78-01a495554e0f None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:28.160906 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50863c-0d86-4942-9c72-e4eb79a2dc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:28.161572 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50863c-0d86-4942-9c72-e4eb79a2dc59 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:28.161855 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50863c-0d86-4942-9c72-e4eb79a2dc59 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:28.162183 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50863c-0d86-4942-9c72-e4eb79a2dc59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:28.172617 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830b437-18a8-4d09-9527-a35de638438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:28.173821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830b437-18a8-4d09-9527-a35de638438b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:28.174329 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830b437-18a8-4d09-9527-a35de638438b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:28.174816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830b437-18a8-4d09-9527-a35de638438b None admin] PATH_INFO: `/v3/groups/ae662303008b423aacfe57515fbf1c46` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:28.181480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830b437-18a8-4d09-9527-a35de638438b None admin] RBAC: Authorizing `identity:get_group(group_id=ae662303008b423aacfe57515fbf1c46)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:28.183203 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830b437-18a8-4d09-9527-a35de638438b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:28.185184 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 176/347] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 13:46:27 2022] GET /identity/v3/groups/ae662303008b423aacfe57515fbf1c46 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:28.186192 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830b437-18a8-4d09-9527-a35de638438b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:28.294122 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830b437-18a8-4d09-9527-a35de638438b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:28.329238 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71ef82-5742-4860-baf6-75ba606e2b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:28.329440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50863c-0d86-4942-9c72-e4eb79a2dc59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:28.330606 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71ef82-5742-4860-baf6-75ba606e2b56 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:28.330864 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50863c-0d86-4942-9c72-e4eb79a2dc59 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:28.331325 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71ef82-5742-4860-baf6-75ba606e2b56 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:28.331816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71ef82-5742-4860-baf6-75ba606e2b56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:28.357806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71ef82-5742-4860-baf6-75ba606e2b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:28.370386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-4b71ef82-5742-4860-baf6-75ba606e2b56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:28.370386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:28.370386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:28.370386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:28.370386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:28.370386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:28.370386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:28.370386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:28.370386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:28.370386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:28.370386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:28.370386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:28.370386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:28.370386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:28.370386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:28.370386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:28.371383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:28.371383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:28.371383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:28.371383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:28.371383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:28.371383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:28.371383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:28.371383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:28.371383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:28.371383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:28.371383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:28.371383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:28.371383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:28.371383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:28.371383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:28.371383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:28.372254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:28.372254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:28.372254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:28.372254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:28.372254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:28.372254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:28.372254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:28.372254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:28.372254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:28.372254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:28.372254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:28.372254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:28.395171 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 177/348] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:28.398863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71ef82-5742-4860-baf6-75ba606e2b56 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:28.502272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 172/349] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:28.505003 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50863c-0d86-4942-9c72-e4eb79a2dc59 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:28.521072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71ef82-5742-4860-baf6-75ba606e2b56 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:28.558395 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c55124-6256-4732-902d-c1761807ed85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:28.559439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c55124-6256-4732-902d-c1761807ed85 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:28.559943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c55124-6256-4732-902d-c1761807ed85 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:28.560465 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c55124-6256-4732-902d-c1761807ed85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:28.561605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c55124-6256-4732-902d-c1761807ed85 None admin] RBAC: Adding query filter params (group.id=ae662303008b423aacfe57515fbf1c46, role.id=15845f6e13b44ef7893159f660311b15, scope.project.id=bd162913396140aca4b3f16233ad0c64) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:28.562137 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c55124-6256-4732-902d-c1761807ed85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:28.563778 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c55124-6256-4732-902d-c1761807ed85 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:28.570407 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 178/350] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 13:46:28 2022] GET /identity/v3/role_assignments?group.id=ae662303008b423aacfe57515fbf1c46&scope.project.id=bd162913396140aca4b3f16233ad0c64&role.id=15845f6e13b44ef7893159f660311b15 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:28.571889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406c264-158c-44ae-b8b4-10020819284d None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:28.572429 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406c264-158c-44ae-b8b4-10020819284d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:28.572917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406c264-158c-44ae-b8b4-10020819284d None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:28.574764 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 179/351] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:28.575812 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406c264-158c-44ae-b8b4-10020819284d None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:28.613549 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50863c-0d86-4942-9c72-e4eb79a2dc59 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:28.652875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9fc0c-ee3a-4451-b2e0-5f9a089ab1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:28.653808 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9fc0c-ee3a-4451-b2e0-5f9a089ab1b6 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:28.654416 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9fc0c-ee3a-4451-b2e0-5f9a089ab1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:28.654841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9fc0c-ee3a-4451-b2e0-5f9a089ab1b6 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:28.655761 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9fc0c-ee3a-4451-b2e0-5f9a089ab1b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:28.656497 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9fc0c-ee3a-4451-b2e0-5f9a089ab1b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:28.658237 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9fc0c-ee3a-4451-b2e0-5f9a089ab1b6 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:28.668048 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 173/352] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:28.674670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c78bc-9b18-46ab-a364-03f75b69c200 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:28.675227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c78bc-9b18-46ab-a364-03f75b69c200 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:28.675695 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c78bc-9b18-46ab-a364-03f75b69c200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:28.693021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406c264-158c-44ae-b8b4-10020819284d None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:28.697899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-375c78bc-9b18-46ab-a364-03f75b69c200 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:28.700220 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-375c78bc-9b18-46ab-a364-03f75b69c200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:28.733815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69520e34-9a4d-4b08-ba0c-bc93e55cc50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:28.734955 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69520e34-9a4d-4b08-ba0c-bc93e55cc50f None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:28.735331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69520e34-9a4d-4b08-ba0c-bc93e55cc50f None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:28.735680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69520e34-9a4d-4b08-ba0c-bc93e55cc50f None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:28.737649 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69520e34-9a4d-4b08-ba0c-bc93e55cc50f None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:28.739163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69520e34-9a4d-4b08-ba0c-bc93e55cc50f None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:28.741050 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 180/353] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:28 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:28.742851 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef31b67-b6c9-46b4-bce9-7e0ea611bb95 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:28.742851 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef31b67-b6c9-46b4-bce9-7e0ea611bb95 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:28.743691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef31b67-b6c9-46b4-bce9-7e0ea611bb95 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:28.744591 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 181/354] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:28.745689 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef31b67-b6c9-46b4-bce9-7e0ea611bb95 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:28.785080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 174/355] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:28.788586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c78bc-9b18-46ab-a364-03f75b69c200 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:28.879491 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef31b67-b6c9-46b4-bce9-7e0ea611bb95 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:28.917846 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c78bc-9b18-46ab-a364-03f75b69c200 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:28.937602 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8948c-75c4-4d76-b7b9-d25b444111ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:28.938860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8948c-75c4-4d76-b7b9-d25b444111ce None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:28.938860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8948c-75c4-4d76-b7b9-d25b444111ce None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:28.938860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8948c-75c4-4d76-b7b9-d25b444111ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:28.958135 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d1a42-305b-4532-817b-64b8f1d20448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:28.959634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d1a42-305b-4532-817b-64b8f1d20448 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:28.960537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d1a42-305b-4532-817b-64b8f1d20448 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:28.960895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d1a42-305b-4532-817b-64b8f1d20448 None admin] PATH_INFO: `/v3/groups/ae662303008b423aacfe57515fbf1c46` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:28.962340 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d1a42-305b-4532-817b-64b8f1d20448 None admin] RBAC: Authorizing `identity:get_group(group_id=ae662303008b423aacfe57515fbf1c46)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:28.964108 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d1a42-305b-4532-817b-64b8f1d20448 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:28.966352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 175/356] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 13:46:28 2022] GET /identity/v3/groups/ae662303008b423aacfe57515fbf1c46 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:28.971012 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09d27e-dfdb-4fce-8de7-b30a283cc472 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:28.971012 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09d27e-dfdb-4fce-8de7-b30a283cc472 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:28.971012 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09d27e-dfdb-4fce-8de7-b30a283cc472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:28.988863 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-bb09d27e-dfdb-4fce-8de7-b30a283cc472 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:28.990038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-bb09d27e-dfdb-4fce-8de7-b30a283cc472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:29.025515 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8948c-75c4-4d76-b7b9-d25b444111ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:29.025515 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8948c-75c4-4d76-b7b9-d25b444111ce None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:29.075224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 176/357] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:29.076239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09d27e-dfdb-4fce-8de7-b30a283cc472 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:29.155093 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 182/358] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:29.157052 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe43c9-63ff-4693-8fb3-4621aba7f7c2 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:29.157570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe43c9-63ff-4693-8fb3-4621aba7f7c2 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:29.158052 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe43c9-63ff-4693-8fb3-4621aba7f7c2 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:29.160828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 183/359] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:29.161795 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe43c9-63ff-4693-8fb3-4621aba7f7c2 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:29.201329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09d27e-dfdb-4fce-8de7-b30a283cc472 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:29.237283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf796c-5b41-49a8-81d2-901e02795a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:29.238141 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf796c-5b41-49a8-81d2-901e02795a94 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:29.238422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf796c-5b41-49a8-81d2-901e02795a94 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:29.238698 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf796c-5b41-49a8-81d2-901e02795a94 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:29.249720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf796c-5b41-49a8-81d2-901e02795a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:29.257797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-1fdf796c-5b41-49a8-81d2-901e02795a94 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:29.257797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:29.257797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:29.257797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:29.257797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:29.257797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:29.257797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:29.257797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:29.257797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:29.257797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:29.257797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:29.257797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:29.257797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:29.257797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:29.257797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:29.257797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:29.258734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:29.258734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:29.258734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:29.258734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:29.258734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:29.258734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:29.258734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:29.258734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:29.258734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:29.258734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:29.258734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:29.258734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:29.258734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:29.258734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:29.258734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:29.258734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:29.259559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:29.259559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:29.259559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:29.259559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:29.259559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:29.259559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:29.259559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:29.259559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:29.259559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:29.259559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:29.259559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 13:46:29.259559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:29.259559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 177/360] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:29.260267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf796c-5b41-49a8-81d2-901e02795a94 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:29.296083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe43c9-63ff-4693-8fb3-4621aba7f7c2 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:29.337349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d48d36-559e-44bf-9a68-b2aad48025cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:29.338016 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d48d36-559e-44bf-9a68-b2aad48025cd None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:29.338325 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d48d36-559e-44bf-9a68-b2aad48025cd None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:29.338570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d48d36-559e-44bf-9a68-b2aad48025cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:29.339401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d48d36-559e-44bf-9a68-b2aad48025cd None admin] RBAC: Adding query filter params (group.id=ae662303008b423aacfe57515fbf1c46, role.id=c8015925658a407b9977b5b0a7f50f05, scope.project.id=bd162913396140aca4b3f16233ad0c64) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:29.339708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d48d36-559e-44bf-9a68-b2aad48025cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:29.341211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d48d36-559e-44bf-9a68-b2aad48025cd None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:29.348509 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 184/361] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 13:46:29 2022] GET /identity/v3/role_assignments?group.id=ae662303008b423aacfe57515fbf1c46&scope.project.id=bd162913396140aca4b3f16233ad0c64&role.id=c8015925658a407b9977b5b0a7f50f05 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:29.349289 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d48d36-559e-44bf-9a68-b2aad48025cd None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:29.383881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf796c-5b41-49a8-81d2-901e02795a94 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:29.436618 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098a0c0-ba91-415c-bea5-e666165fd983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:29.437645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098a0c0-ba91-415c-bea5-e666165fd983 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:29.437925 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098a0c0-ba91-415c-bea5-e666165fd983 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:29.438791 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098a0c0-ba91-415c-bea5-e666165fd983 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:29.456262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098a0c0-ba91-415c-bea5-e666165fd983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:29.465365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-8098a0c0-ba91-415c-bea5-e666165fd983 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:29.465365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:29.465365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:29.465365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:29.465365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:29.465365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:29.465365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:29.465365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:29.465365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:29.465365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:29.465365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:29.465365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:29.465365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:29.465365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:29.465365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:29.465365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:29.466355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:29.466355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:29.466355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:29.466355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:29.466355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:29.466355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:29.466355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:29.466355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:29.466355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:29.466355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:29.466355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:29.466355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:29.466355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:29.466355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:29.466355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:29.466355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:29.467174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:29.467174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:29.467174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:29.467174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:29.467174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:29.467174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:29.467174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:29.467174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:29.467174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:29.467174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:29.467174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:29.467174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:29.467174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 178/362] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:46:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:29.468632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9364b-24da-4c5a-a52c-8d9d27f9821a None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:29.468632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9364b-24da-4c5a-a52c-8d9d27f9821a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:29.468632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9364b-24da-4c5a-a52c-8d9d27f9821a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:29.475100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d48d36-559e-44bf-9a68-b2aad48025cd None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:29.493396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-c8c9364b-24da-4c5a-a52c-8d9d27f9821a None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:29.494965 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-c8c9364b-24da-4c5a-a52c-8d9d27f9821a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:29.512775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5a25d-cccb-471d-9f28-7a345088a8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:29.515430 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5a25d-cccb-471d-9f28-7a345088a8f2 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:29.515430 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5a25d-cccb-471d-9f28-7a345088a8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:29.515430 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5a25d-cccb-471d-9f28-7a345088a8f2 None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:29.515793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5a25d-cccb-471d-9f28-7a345088a8f2 None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:29.517352 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5a25d-cccb-471d-9f28-7a345088a8f2 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:29.520007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 185/363] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:29 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:29.520895 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5a25d-cccb-471d-9f28-7a345088a8f2 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:29.588937 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 179/364] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:29.589521 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9364b-24da-4c5a-a52c-8d9d27f9821a None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:29.647159 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5a25d-cccb-471d-9f28-7a345088a8f2 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:29.684990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91dbbc-767c-440f-b6dc-ed689bf2158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:29.686014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91dbbc-767c-440f-b6dc-ed689bf2158e None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:29.686497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91dbbc-767c-440f-b6dc-ed689bf2158e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:29.686999 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91dbbc-767c-440f-b6dc-ed689bf2158e None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:29.687946 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91dbbc-767c-440f-b6dc-ed689bf2158e None admin] RBAC: Adding query filter params (name=reader) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:29.688481 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91dbbc-767c-440f-b6dc-ed689bf2158e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:29.690046 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91dbbc-767c-440f-b6dc-ed689bf2158e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:29.691589 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9364b-24da-4c5a-a52c-8d9d27f9821a None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:29.699600 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 186/365] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:29.700739 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91dbbc-767c-440f-b6dc-ed689bf2158e None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:29.731328 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7226d-c0a2-4c7f-b049-3ecee0f60636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:29.731972 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7226d-c0a2-4c7f-b049-3ecee0f60636 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:29.732333 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7226d-c0a2-4c7f-b049-3ecee0f60636 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:29.732646 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7226d-c0a2-4c7f-b049-3ecee0f60636 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:29.733390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7226d-c0a2-4c7f-b049-3ecee0f60636 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:29.733695 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7226d-c0a2-4c7f-b049-3ecee0f60636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:29.735121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7226d-c0a2-4c7f-b049-3ecee0f60636 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:29.743860 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 180/366] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:29.748190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7226d-c0a2-4c7f-b049-3ecee0f60636 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:29.811288 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91dbbc-767c-440f-b6dc-ed689bf2158e None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:29.851890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7226d-c0a2-4c7f-b049-3ecee0f60636 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:29.857686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ecf34-0756-428e-b083-42d1e7276e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:29.858826 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ecf34-0756-428e-b083-42d1e7276e59 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:29.859313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ecf34-0756-428e-b083-42d1e7276e59 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:29.859801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ecf34-0756-428e-b083-42d1e7276e59 None admin] PATH_INFO: `/v3/groups/ae662303008b423aacfe57515fbf1c46` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:29.861221 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ecf34-0756-428e-b083-42d1e7276e59 None admin] RBAC: Authorizing `identity:get_group(group_id=ae662303008b423aacfe57515fbf1c46)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:29.862864 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ecf34-0756-428e-b083-42d1e7276e59 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:29.864726 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 187/367] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 13:46:29 2022] GET /identity/v3/groups/ae662303008b423aacfe57515fbf1c46 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:29.865674 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ecf34-0756-428e-b083-42d1e7276e59 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:29.889443 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baaab2-eb12-4d73-b127-99789b1bc96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:29.890289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baaab2-eb12-4d73-b127-99789b1bc96b None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:29.890573 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baaab2-eb12-4d73-b127-99789b1bc96b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:29.890845 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baaab2-eb12-4d73-b127-99789b1bc96b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:29.902171 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86baaab2-eb12-4d73-b127-99789b1bc96b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:29.910227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-86baaab2-eb12-4d73-b127-99789b1bc96b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:29.910227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:29.910227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:29.910227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:29.910227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:29.910227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:29.910227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:29.910227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:29.910227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:29.910227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:29.910227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:29.910227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:29.910227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:29.910227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:29.910227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:29.910227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:29.911154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:29.911154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:29.911154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:29.911154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:29.911154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:29.911154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:29.911154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:29.911154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:29.911154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:29.911154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:29.911154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:29.911154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:29.911154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:29.911154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:29.911154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:29.911154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:29.911977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:29.911977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:29.911977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:29.911977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:29.911977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:29.911977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:29.911977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:29.911977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:29.911977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:29.911977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:29.911977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:29.911977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:29.911977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 181/368] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:46:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:29.913943 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baaab2-eb12-4d73-b127-99789b1bc96b None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:29.987394 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ecf34-0756-428e-b083-42d1e7276e59 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:30.015680 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baaab2-eb12-4d73-b127-99789b1bc96b None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:30.021818 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8a1b2-8463-4b32-8b79-934ff9bbb91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:30.023009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8a1b2-8463-4b32-8b79-934ff9bbb91b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:30.023604 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8a1b2-8463-4b32-8b79-934ff9bbb91b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:30.024103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8a1b2-8463-4b32-8b79-934ff9bbb91b None admin] PATH_INFO: `/v3/users/acc73ffad6d54142b8d47b615d1a3862` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:30.025574 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8a1b2-8463-4b32-8b79-934ff9bbb91b None admin] RBAC: Authorizing `identity:get_user(user_id=acc73ffad6d54142b8d47b615d1a3862)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:30.027222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8a1b2-8463-4b32-8b79-934ff9bbb91b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:30.029112 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 188/369] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:46:29 2022] GET /identity/v3/users/acc73ffad6d54142b8d47b615d1a3862 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:30.030073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8a1b2-8463-4b32-8b79-934ff9bbb91b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:30.055325 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137fc9b-1300-4076-83bf-456eac019e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:30.055982 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137fc9b-1300-4076-83bf-456eac019e0c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:30.056306 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137fc9b-1300-4076-83bf-456eac019e0c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:30.056886 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137fc9b-1300-4076-83bf-456eac019e0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:30.137621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137fc9b-1300-4076-83bf-456eac019e0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:30.139434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137fc9b-1300-4076-83bf-456eac019e0c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:30.144625 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8a1b2-8463-4b32-8b79-934ff9bbb91b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:30.191885 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978bb95-e3e6-44dc-b09f-4323c5582404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:30.192662 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978bb95-e3e6-44dc-b09f-4323c5582404 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:30.192946 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978bb95-e3e6-44dc-b09f-4323c5582404 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:30.193217 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978bb95-e3e6-44dc-b09f-4323c5582404 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:30.194048 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978bb95-e3e6-44dc-b09f-4323c5582404 None admin] RBAC: Adding query filter params (group.id=ae662303008b423aacfe57515fbf1c46, role.id=15845f6e13b44ef7893159f660311b15, scope.project.id=e826a1db652e46829670062be316817a) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:30.194382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978bb95-e3e6-44dc-b09f-4323c5582404 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:30.195803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978bb95-e3e6-44dc-b09f-4323c5582404 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:30.203639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 189/370] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 13:46:30 2022] GET /identity/v3/role_assignments?group.id=ae662303008b423aacfe57515fbf1c46&scope.project.id=e826a1db652e46829670062be316817a&role.id=15845f6e13b44ef7893159f660311b15 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:30.204517 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978bb95-e3e6-44dc-b09f-4323c5582404 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:30.251665 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 182/371] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:30.252839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137fc9b-1300-4076-83bf-456eac019e0c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:30.313942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978bb95-e3e6-44dc-b09f-4323c5582404 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:30.355368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c969b7c-d944-44ee-a9a0-a1b62c4153b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:30.356060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c969b7c-d944-44ee-a9a0-a1b62c4153b1 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:30.356393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c969b7c-d944-44ee-a9a0-a1b62c4153b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:30.356669 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c969b7c-d944-44ee-a9a0-a1b62c4153b1 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:30.357431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c969b7c-d944-44ee-a9a0-a1b62c4153b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:30.357761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c969b7c-d944-44ee-a9a0-a1b62c4153b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:30.359118 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c969b7c-d944-44ee-a9a0-a1b62c4153b1 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:30.359973 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137fc9b-1300-4076-83bf-456eac019e0c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:30.369697 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 190/372] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:30.370375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c969b7c-d944-44ee-a9a0-a1b62c4153b1 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:30.425086 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ac245-d0fa-432c-8fe6-4a8e9cfaca7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:30.426179 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ac245-d0fa-432c-8fe6-4a8e9cfaca7d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:30.426655 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ac245-d0fa-432c-8fe6-4a8e9cfaca7d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:30.427141 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ac245-d0fa-432c-8fe6-4a8e9cfaca7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:30.428294 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ac245-d0fa-432c-8fe6-4a8e9cfaca7d None admin] RBAC: Adding query filter params (role.id=97d9563192e147dda2ea8cd2d201552c, user.id=acc73ffad6d54142b8d47b615d1a3862, scope.system=all) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:30.428843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ac245-d0fa-432c-8fe6-4a8e9cfaca7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:30.430509 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ac245-d0fa-432c-8fe6-4a8e9cfaca7d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:30.445269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 183/373] 10.222.0.49 () {56 vars in 1308 bytes} [Tue May 10 13:46:30 2022] GET /identity/v3/role_assignments?user.id=acc73ffad6d54142b8d47b615d1a3862&scope.system=all&role.id=97d9563192e147dda2ea8cd2d201552c => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:30.446807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ac245-d0fa-432c-8fe6-4a8e9cfaca7d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:30.576157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c969b7c-d944-44ee-a9a0-a1b62c4153b1 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:30.587013 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ac245-d0fa-432c-8fe6-4a8e9cfaca7d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:30.659979 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd512891-7038-4087-8567-901efec6519a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:30.660682 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd512891-7038-4087-8567-901efec6519a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:30.660966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd512891-7038-4087-8567-901efec6519a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:30.661245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd512891-7038-4087-8567-901efec6519a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:30.661521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea538a86-a95c-4f9a-9565-52d979a63f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:30.662417 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea538a86-a95c-4f9a-9565-52d979a63f78 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:30.662700 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea538a86-a95c-4f9a-9565-52d979a63f78 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:30.662973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea538a86-a95c-4f9a-9565-52d979a63f78 None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:30.664804 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea538a86-a95c-4f9a-9565-52d979a63f78 None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:30.666251 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea538a86-a95c-4f9a-9565-52d979a63f78 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:30.668185 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 191/374] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:30 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:30.682392 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea538a86-a95c-4f9a-9565-52d979a63f78 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:30.814191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd512891-7038-4087-8567-901efec6519a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:30.817119 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd512891-7038-4087-8567-901efec6519a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:30.841597 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea538a86-a95c-4f9a-9565-52d979a63f78 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:30.908852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b329f9-9fa6-4e1a-8c06-79a9f29d4d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:30.910071 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b329f9-9fa6-4e1a-8c06-79a9f29d4d1e None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:30.910356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b329f9-9fa6-4e1a-8c06-79a9f29d4d1e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:30.910630 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b329f9-9fa6-4e1a-8c06-79a9f29d4d1e None admin] PATH_INFO: `/v3/groups/ae662303008b423aacfe57515fbf1c46` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:30.912128 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b329f9-9fa6-4e1a-8c06-79a9f29d4d1e None admin] RBAC: Authorizing `identity:get_group(group_id=ae662303008b423aacfe57515fbf1c46)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:30.914360 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b329f9-9fa6-4e1a-8c06-79a9f29d4d1e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:30.916585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 192/375] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 13:46:30 2022] GET /identity/v3/groups/ae662303008b423aacfe57515fbf1c46 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:30.923116 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b329f9-9fa6-4e1a-8c06-79a9f29d4d1e None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:30.990867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 184/376] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:30.997825 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd512891-7038-4087-8567-901efec6519a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:31.086255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b329f9-9fa6-4e1a-8c06-79a9f29d4d1e None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:31.135013 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13038c0-3fc2-43f2-a296-fdfcfce58490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:31.136093 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13038c0-3fc2-43f2-a296-fdfcfce58490 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:31.137515 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13038c0-3fc2-43f2-a296-fdfcfce58490 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:31.138660 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13038c0-3fc2-43f2-a296-fdfcfce58490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:31.139917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13038c0-3fc2-43f2-a296-fdfcfce58490 None admin] RBAC: Adding query filter params (group.id=ae662303008b423aacfe57515fbf1c46, role.id=c8015925658a407b9977b5b0a7f50f05, scope.project.id=e826a1db652e46829670062be316817a) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:31.143223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13038c0-3fc2-43f2-a296-fdfcfce58490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:31.146710 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13038c0-3fc2-43f2-a296-fdfcfce58490 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:31.159581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 193/377] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 13:46:30 2022] GET /identity/v3/role_assignments?group.id=ae662303008b423aacfe57515fbf1c46&scope.project.id=e826a1db652e46829670062be316817a&role.id=c8015925658a407b9977b5b0a7f50f05 => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:31.195149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd512891-7038-4087-8567-901efec6519a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:31.267100 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc356f7e-8229-4ea8-8c07-be3ec0532a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:31.268427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc356f7e-8229-4ea8-8c07-be3ec0532a9e None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:31.268910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc356f7e-8229-4ea8-8c07-be3ec0532a9e None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:31.269380 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc356f7e-8229-4ea8-8c07-be3ec0532a9e None admin] PATH_INFO: `/v3/projects/71179eb4635448dd8ef63856db24457f` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:31.275421 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc356f7e-8229-4ea8-8c07-be3ec0532a9e None admin] RBAC: Authorizing `identity:get_project(project_id=71179eb4635448dd8ef63856db24457f)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:31.277281 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc356f7e-8229-4ea8-8c07-be3ec0532a9e None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:31.279298 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 185/378] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:30 2022] GET /identity/v3/projects/71179eb4635448dd8ef63856db24457f => generated 344 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:31.285403 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13038c0-3fc2-43f2-a296-fdfcfce58490 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:31.327663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91d15e-ae87-42fd-8840-a99ab3232b01 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:31.327976 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91d15e-ae87-42fd-8840-a99ab3232b01 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:31.328233 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91d15e-ae87-42fd-8840-a99ab3232b01 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:31.329813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 186/379] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:31.335495 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca657a1b-4d50-4887-a970-c845959d23a1 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:31.335863 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca657a1b-4d50-4887-a970-c845959d23a1 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:31.336247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca657a1b-4d50-4887-a970-c845959d23a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:31.356124 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-ca657a1b-4d50-4887-a970-c845959d23a1 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:31.358983 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ca657a1b-4d50-4887-a970-c845959d23a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:31.426756 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13038c0-3fc2-43f2-a296-fdfcfce58490 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:31.466610 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133d9b3-7977-4377-8e7a-8a00733996f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:31.467491 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133d9b3-7977-4377-8e7a-8a00733996f7 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:31.467772 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133d9b3-7977-4377-8e7a-8a00733996f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:31.468047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133d9b3-7977-4377-8e7a-8a00733996f7 None admin] PATH_INFO: `/v3/groups/58b864e1cf844a3491c971d5c6156caf` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:31.480568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 187/380] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:31.483255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133d9b3-7977-4377-8e7a-8a00733996f7 None admin] RBAC: Authorizing `identity:get_group(group_id=58b864e1cf844a3491c971d5c6156caf)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:31.484764 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133d9b3-7977-4377-8e7a-8a00733996f7 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:31.486579 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 194/381] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 13:46:31 2022] GET /identity/v3/groups/58b864e1cf844a3491c971d5c6156caf => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:31.493311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca657a1b-4d50-4887-a970-c845959d23a1 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:31.545826 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133d9b3-7977-4377-8e7a-8a00733996f7 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:31.631030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca657a1b-4d50-4887-a970-c845959d23a1 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:31.672564 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2329b-45b0-4320-9f07-bc72907f1d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:31.673220 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2329b-45b0-4320-9f07-bc72907f1d5d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:31.673659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2329b-45b0-4320-9f07-bc72907f1d5d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:31.673940 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2329b-45b0-4320-9f07-bc72907f1d5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:31.674780 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2329b-45b0-4320-9f07-bc72907f1d5d None admin] RBAC: Adding query filter params (group.id=58b864e1cf844a3491c971d5c6156caf, role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=71179eb4635448dd8ef63856db24457f) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:31.675087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2329b-45b0-4320-9f07-bc72907f1d5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:31.676643 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2329b-45b0-4320-9f07-bc72907f1d5d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:31.684513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 188/382] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 13:46:31 2022] GET /identity/v3/role_assignments?group.id=58b864e1cf844a3491c971d5c6156caf&scope.project.id=71179eb4635448dd8ef63856db24457f&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:31.735630 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133d9b3-7977-4377-8e7a-8a00733996f7 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:31.779736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98b7a3-6820-40b3-bc4c-31ed9fc032c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:31.780622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98b7a3-6820-40b3-bc4c-31ed9fc032c9 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:31.781168 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98b7a3-6820-40b3-bc4c-31ed9fc032c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:31.781446 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98b7a3-6820-40b3-bc4c-31ed9fc032c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:31.796375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98b7a3-6820-40b3-bc4c-31ed9fc032c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:31.804383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-8f98b7a3-6820-40b3-bc4c-31ed9fc032c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:31.804383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:31.804383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:31.804383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:31.804383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:31.804383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:31.804383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:31.804383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:31.804383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:31.804383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:31.804383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:31.804383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:31.804383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:31.804383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:31.804383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:31.804383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:31.805296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:31.805296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:31.805296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:31.805296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:31.805296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:31.805296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:31.805296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:31.805296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:31.805296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:31.805296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:31.805296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:31.805296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:31.805296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:31.805296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:31.805296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:31.805296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:31.806109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:31.806109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:31.806109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:31.806109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:31.806109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:31.806109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:31.806109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:31.806109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:31.806109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:31.806109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:31.806109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:31.806109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:31.806109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 195/383] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:31.812957 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2329b-45b0-4320-9f07-bc72907f1d5d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:31.927582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2329b-45b0-4320-9f07-bc72907f1d5d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:31.971653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56b37f-fa8e-47b5-95e1-1f1e29f87f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:31.972343 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56b37f-fa8e-47b5-95e1-1f1e29f87f80 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:31.972626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56b37f-fa8e-47b5-95e1-1f1e29f87f80 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:31.972902 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56b37f-fa8e-47b5-95e1-1f1e29f87f80 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:31.973660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56b37f-fa8e-47b5-95e1-1f1e29f87f80 None admin] RBAC: Adding query filter params (name=member) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:31.973965 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56b37f-fa8e-47b5-95e1-1f1e29f87f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:31.975391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56b37f-fa8e-47b5-95e1-1f1e29f87f80 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:31.984683 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 189/384] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:31.993275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98b7a3-6820-40b3-bc4c-31ed9fc032c9 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:32.110731 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98b7a3-6820-40b3-bc4c-31ed9fc032c9 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:32.148009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cea50-eb6b-41b9-a695-b794d13ae952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:32.148909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cea50-eb6b-41b9-a695-b794d13ae952 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:32.149189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cea50-eb6b-41b9-a695-b794d13ae952 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:32.149462 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cea50-eb6b-41b9-a695-b794d13ae952 None admin] PATH_INFO: `/v3/groups/ae662303008b423aacfe57515fbf1c46` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:32.150648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94cea50-eb6b-41b9-a695-b794d13ae952 None admin] RBAC: Authorizing `identity:get_group(group_id=ae662303008b423aacfe57515fbf1c46)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:32.152123 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94cea50-eb6b-41b9-a695-b794d13ae952 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:32.154120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 196/385] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 13:46:31 2022] GET /identity/v3/groups/ae662303008b423aacfe57515fbf1c46 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:32.161260 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56b37f-fa8e-47b5-95e1-1f1e29f87f80 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:32.277962 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56b37f-fa8e-47b5-95e1-1f1e29f87f80 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:32.314573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd4bf1-440e-4254-9614-e6ecb71bb2c7 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:32.314908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd4bf1-440e-4254-9614-e6ecb71bb2c7 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:32.315132 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd4bf1-440e-4254-9614-e6ecb71bb2c7 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:32.316792 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 197/386] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:32.321836 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a84b67-ae84-47c9-8de1-4586f50a0102 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:32.322123 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a84b67-ae84-47c9-8de1-4586f50a0102 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:32.322401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a84b67-ae84-47c9-8de1-4586f50a0102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:32.343802 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-34a84b67-ae84-47c9-8de1-4586f50a0102 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:32.348896 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3eccd-5466-4d99-b48b-b6b27d2245a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:32.349763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3eccd-5466-4d99-b48b-b6b27d2245a0 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:32.350043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3eccd-5466-4d99-b48b-b6b27d2245a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:32.350313 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3eccd-5466-4d99-b48b-b6b27d2245a0 None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:32.351401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-34a84b67-ae84-47c9-8de1-4586f50a0102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:32.353268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3eccd-5466-4d99-b48b-b6b27d2245a0 None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:32.354824 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3eccd-5466-4d99-b48b-b6b27d2245a0 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:32.356757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 190/387] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:32 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:32.362471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3eccd-5466-4d99-b48b-b6b27d2245a0 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:32.485282 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 198/388] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:32.521571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a84b67-ae84-47c9-8de1-4586f50a0102 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:32.533911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3eccd-5466-4d99-b48b-b6b27d2245a0 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:32.587633 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb02184-b69e-4490-8f84-f5ee90c1f12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:32.588607 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb02184-b69e-4490-8f84-f5ee90c1f12d None admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:32.588893 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb02184-b69e-4490-8f84-f5ee90c1f12d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:32.589174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb02184-b69e-4490-8f84-f5ee90c1f12d None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64/groups/ae662303008b423aacfe57515fbf1c46/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:32.598030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb02184-b69e-4490-8f84-f5ee90c1f12d None admin] RBAC: Authorizing `identity:create_grant(project_id=bd162913396140aca4b3f16233ad0c64, group_id=ae662303008b423aacfe57515fbf1c46, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:32.599503 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb02184-b69e-4490-8f84-f5ee90c1f12d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:32.625161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 191/389] 10.222.0.49 () {58 vars in 1442 bytes} [Tue May 10 13:46:32 2022] PUT /identity/v3/projects/bd162913396140aca4b3f16233ad0c64/groups/ae662303008b423aacfe57515fbf1c46/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:32.679684 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a84b67-ae84-47c9-8de1-4586f50a0102 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:32.726685 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906ee29-e47e-43e5-92fa-eecbfd7c509f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:32.727863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906ee29-e47e-43e5-92fa-eecbfd7c509f None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:32.728394 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906ee29-e47e-43e5-92fa-eecbfd7c509f None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:32.728870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906ee29-e47e-43e5-92fa-eecbfd7c509f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:32.742497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906ee29-e47e-43e5-92fa-eecbfd7c509f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:32.751020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-c906ee29-e47e-43e5-92fa-eecbfd7c509f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:32.751020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:32.751020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:32.751020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:32.751020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:32.751020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:32.751020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:32.751020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:32.751020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:32.751020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:32.751020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:32.751020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:32.751020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:32.751020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:32.751020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:32.751020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:32.751919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:32.751919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:32.751919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:32.751919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:32.751919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:32.751919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:32.751919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:32.751919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:32.751919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:32.751919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:32.751919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:32.751919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:32.751919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:32.751919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:32.751919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:32.751919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:32.752776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:32.752776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:32.752776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:32.752776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:32.752776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:32.752776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:32.752776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:32.752776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:32.752776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:32.752776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:32.752776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:32.752776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:32.756735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 199/390] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:46:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:32.762469 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb02184-b69e-4490-8f84-f5ee90c1f12d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:32.901298 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb02184-b69e-4490-8f84-f5ee90c1f12d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:32.938278 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b4f0e-eac2-43bf-9b67-60b8b7b702ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:32.938957 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b4f0e-eac2-43bf-9b67-60b8b7b702ee None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:32.939236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b4f0e-eac2-43bf-9b67-60b8b7b702ee None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:32.939513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b4f0e-eac2-43bf-9b67-60b8b7b702ee None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:32.940339 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b4f0e-eac2-43bf-9b67-60b8b7b702ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:32.940652 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b4f0e-eac2-43bf-9b67-60b8b7b702ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:32.942080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b4f0e-eac2-43bf-9b67-60b8b7b702ee None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:32.956207 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 192/391] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:32.957745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906ee29-e47e-43e5-92fa-eecbfd7c509f None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:33.073506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906ee29-e47e-43e5-92fa-eecbfd7c509f None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:33.109089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643fa2d-bf3b-4a0b-9a93-5ab68f46c214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:33.109997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643fa2d-bf3b-4a0b-9a93-5ab68f46c214 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:33.110279 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643fa2d-bf3b-4a0b-9a93-5ab68f46c214 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:33.110556 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643fa2d-bf3b-4a0b-9a93-5ab68f46c214 None admin] PATH_INFO: `/v3/groups/ae662303008b423aacfe57515fbf1c46` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:33.116935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643fa2d-bf3b-4a0b-9a93-5ab68f46c214 None admin] RBAC: Authorizing `identity:get_group(group_id=ae662303008b423aacfe57515fbf1c46)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:33.118448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643fa2d-bf3b-4a0b-9a93-5ab68f46c214 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:33.120299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 200/392] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 13:46:32 2022] GET /identity/v3/groups/ae662303008b423aacfe57515fbf1c46 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:33.125935 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b4f0e-eac2-43bf-9b67-60b8b7b702ee None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:33.217116 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b566808-6560-4dfa-8ff8-985de67db1d9 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:33.217809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b566808-6560-4dfa-8ff8-985de67db1d9 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:33.218342 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b566808-6560-4dfa-8ff8-985de67db1d9 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:33.223921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 201/393] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:33.225740 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b3a55-c83d-4e9d-826f-2be1d7bdc0ef None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:33.226234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b3a55-c83d-4e9d-826f-2be1d7bdc0ef None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:33.226726 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b3a55-c83d-4e9d-826f-2be1d7bdc0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:33.241509 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b4f0e-eac2-43bf-9b67-60b8b7b702ee None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:33.244586 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-5b0b3a55-c83d-4e9d-826f-2be1d7bdc0ef None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:33.246784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-5b0b3a55-c83d-4e9d-826f-2be1d7bdc0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:33.283164 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fea0c-1ed0-4039-a5d8-e3024d675c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:33.284022 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fea0c-1ed0-4039-a5d8-e3024d675c03 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:33.284327 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fea0c-1ed0-4039-a5d8-e3024d675c03 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:33.284599 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fea0c-1ed0-4039-a5d8-e3024d675c03 None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:33.286477 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fea0c-1ed0-4039-a5d8-e3024d675c03 None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:33.287940 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fea0c-1ed0-4039-a5d8-e3024d675c03 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:33.292701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 193/394] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:33 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:33.301282 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fea0c-1ed0-4039-a5d8-e3024d675c03 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:33.402000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 202/395] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:33.407934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fea0c-1ed0-4039-a5d8-e3024d675c03 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:33.440457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b3a55-c83d-4e9d-826f-2be1d7bdc0ef None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:33.447870 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecea5a-830f-47eb-a21b-c82c5c338edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:33.448797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecea5a-830f-47eb-a21b-c82c5c338edd None admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:33.449078 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecea5a-830f-47eb-a21b-c82c5c338edd None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:33.449359 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecea5a-830f-47eb-a21b-c82c5c338edd None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64/groups/ae662303008b423aacfe57515fbf1c46/roles/c8015925658a407b9977b5b0a7f50f05` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:33.454036 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ecea5a-830f-47eb-a21b-c82c5c338edd None admin] RBAC: Authorizing `identity:create_grant(project_id=bd162913396140aca4b3f16233ad0c64, group_id=ae662303008b423aacfe57515fbf1c46, role_id=c8015925658a407b9977b5b0a7f50f05)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:33.455483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ecea5a-830f-47eb-a21b-c82c5c338edd None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:33.486514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 194/396] 10.222.0.49 () {58 vars in 1442 bytes} [Tue May 10 13:46:33 2022] PUT /identity/v3/projects/bd162913396140aca4b3f16233ad0c64/groups/ae662303008b423aacfe57515fbf1c46/roles/c8015925658a407b9977b5b0a7f50f05 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:33.561015 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b3a55-c83d-4e9d-826f-2be1d7bdc0ef None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:33.605279 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05b52c-2a81-4b57-961e-1afea3535769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:33.606105 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05b52c-2a81-4b57-961e-1afea3535769 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:33.606386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05b52c-2a81-4b57-961e-1afea3535769 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:33.606655 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05b52c-2a81-4b57-961e-1afea3535769 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:33.622531 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05b52c-2a81-4b57-961e-1afea3535769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:33.634908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-ca05b52c-2a81-4b57-961e-1afea3535769 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:33.634908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:33.634908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:33.634908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:33.634908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:33.634908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:33.634908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:33.634908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:33.634908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:33.634908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:33.634908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:33.634908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:33.634908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:33.634908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:33.634908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:33.634908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:33.635901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:33.635901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:33.635901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:33.635901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:33.635901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:33.635901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:33.635901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:33.635901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:33.635901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:33.635901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:33.635901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:33.635901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:33.635901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:33.635901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:33.635901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:33.635901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:33.637420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:33.637420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:33.637420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:33.637420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:33.637420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:33.637420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:33.637420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:33.637420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:33.637420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:33.637420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:33.637420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:33.637420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:33.637420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 203/397] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:33.644663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecea5a-830f-47eb-a21b-c82c5c338edd None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:33.785395 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecea5a-830f-47eb-a21b-c82c5c338edd None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:33.825675 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eebf07-576f-4c20-8de2-02c9ed00a1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:33.826674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eebf07-576f-4c20-8de2-02c9ed00a1fb None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:33.827141 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eebf07-576f-4c20-8de2-02c9ed00a1fb None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:33.827589 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eebf07-576f-4c20-8de2-02c9ed00a1fb None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:33.828543 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eebf07-576f-4c20-8de2-02c9ed00a1fb None admin] RBAC: Adding query filter params (name=member) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:33.829025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eebf07-576f-4c20-8de2-02c9ed00a1fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:33.830677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eebf07-576f-4c20-8de2-02c9ed00a1fb None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:33.842220 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 195/398] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:33.847943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05b52c-2a81-4b57-961e-1afea3535769 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:33.987152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05b52c-2a81-4b57-961e-1afea3535769 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:34.030269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb003-4ddc-4c39-84d8-24c4a0f40ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:34.031397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb003-4ddc-4c39-84d8-24c4a0f40ab7 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:34.031678 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb003-4ddc-4c39-84d8-24c4a0f40ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:34.031952 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb003-4ddc-4c39-84d8-24c4a0f40ab7 None admin] PATH_INFO: `/v3/groups/ae662303008b423aacfe57515fbf1c46` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:34.033183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdb003-4ddc-4c39-84d8-24c4a0f40ab7 None admin] RBAC: Authorizing `identity:get_group(group_id=ae662303008b423aacfe57515fbf1c46)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:34.034609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdb003-4ddc-4c39-84d8-24c4a0f40ab7 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:34.036300 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 204/399] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 13:46:33 2022] GET /identity/v3/groups/ae662303008b423aacfe57515fbf1c46 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:34.042693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eebf07-576f-4c20-8de2-02c9ed00a1fb None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:34.189895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eebf07-576f-4c20-8de2-02c9ed00a1fb None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:34.238554 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d600d-ca30-433e-9542-993d1059d7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:34.239831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d600d-ca30-433e-9542-993d1059d7d6 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:34.240523 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d600d-ca30-433e-9542-993d1059d7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:34.241014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d600d-ca30-433e-9542-993d1059d7d6 None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:34.242475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d600d-ca30-433e-9542-993d1059d7d6 None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:34.244391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d600d-ca30-433e-9542-993d1059d7d6 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:34.246617 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 196/400] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:34 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:34.253026 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb003-4ddc-4c39-84d8-24c4a0f40ab7 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:34.287573 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38d629-322f-447c-9e32-c684628d265c None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:34.288741 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38d629-322f-447c-9e32-c684628d265c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:34.289214 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38d629-322f-447c-9e32-c684628d265c None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:34.291024 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 197/401] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:34.295951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c8afa-6e34-423f-84f2-5a833312af69 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:34.296507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c8afa-6e34-423f-84f2-5a833312af69 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:34.296998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c8afa-6e34-423f-84f2-5a833312af69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:34.333201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-b85c8afa-6e34-423f-84f2-5a833312af69 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:34.335409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b85c8afa-6e34-423f-84f2-5a833312af69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:34.378856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb003-4ddc-4c39-84d8-24c4a0f40ab7 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:34.417327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aac66d-321e-4cfb-a42a-beaf8d80474b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:34.418595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aac66d-321e-4cfb-a42a-beaf8d80474b None admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:34.419206 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aac66d-321e-4cfb-a42a-beaf8d80474b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:34.419687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aac66d-321e-4cfb-a42a-beaf8d80474b None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a/groups/ae662303008b423aacfe57515fbf1c46/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:34.421884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aac66d-321e-4cfb-a42a-beaf8d80474b None admin] RBAC: Authorizing `identity:create_grant(project_id=e826a1db652e46829670062be316817a, group_id=ae662303008b423aacfe57515fbf1c46, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:34.423521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aac66d-321e-4cfb-a42a-beaf8d80474b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:34.454165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 205/402] 10.222.0.49 () {58 vars in 1442 bytes} [Tue May 10 13:46:34 2022] PUT /identity/v3/projects/e826a1db652e46829670062be316817a/groups/ae662303008b423aacfe57515fbf1c46/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:34.467323 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 198/403] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:34.503036 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aac66d-321e-4cfb-a42a-beaf8d80474b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:34.670808 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aac66d-321e-4cfb-a42a-beaf8d80474b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:34.715490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45abf53-6bdf-4135-8340-0b6037276850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:34.716720 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45abf53-6bdf-4135-8340-0b6037276850 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:34.717228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45abf53-6bdf-4135-8340-0b6037276850 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:34.717715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45abf53-6bdf-4135-8340-0b6037276850 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:34.730463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45abf53-6bdf-4135-8340-0b6037276850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:34.740183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-c45abf53-6bdf-4135-8340-0b6037276850 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:34.740183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:34.740183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:34.740183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:34.740183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:34.740183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:34.740183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:34.740183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:34.740183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:34.740183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:34.740183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:34.740183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:34.740183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:34.740183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:34.740183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:34.740183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:34.743044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:34.743044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:34.743044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:34.743044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:34.743044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:34.743044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:34.743044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:34.743044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:34.743044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:34.743044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:34.743044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:34.743044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:34.743044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:34.743044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:34.743044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:34.743044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:34.743871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:34.743871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:34.743871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:34.743871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:34.743871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:34.743871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:34.743871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:34.743871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:34.743871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:34.743871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:34.743871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:34.743871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:34.746728 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 206/404] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:46:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:34.752302 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c8afa-6e34-423f-84f2-5a833312af69 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:34.798260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08065d54-4153-4cee-ae76-f5f202941913 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:34.799752 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08065d54-4153-4cee-ae76-f5f202941913 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:34.800272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08065d54-4153-4cee-ae76-f5f202941913 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:34.803342 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 207/405] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:34.814125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390ad85-8268-4e7e-ae47-cd43486bc8be None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:34.814770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390ad85-8268-4e7e-ae47-cd43486bc8be None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:34.815253 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390ad85-8268-4e7e-ae47-cd43486bc8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:34.845632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-7390ad85-8268-4e7e-ae47-cd43486bc8be None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:34.846838 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-7390ad85-8268-4e7e-ae47-cd43486bc8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:34.912435 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c8afa-6e34-423f-84f2-5a833312af69 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:34.968257 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1861fe4-bc6f-4320-8ad0-4c8b029fb3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:34.968820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 208/406] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:34.968932 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1861fe4-bc6f-4320-8ad0-4c8b029fb3b2 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:34.969199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1861fe4-bc6f-4320-8ad0-4c8b029fb3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:34.969475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1861fe4-bc6f-4320-8ad0-4c8b029fb3b2 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:34.970284 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1861fe4-bc6f-4320-8ad0-4c8b029fb3b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:34.970591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1861fe4-bc6f-4320-8ad0-4c8b029fb3b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:34.971963 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1861fe4-bc6f-4320-8ad0-4c8b029fb3b2 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:34.984269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 199/407] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:34.986588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390ad85-8268-4e7e-ae47-cd43486bc8be None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:34.993821 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1861fe4-bc6f-4320-8ad0-4c8b029fb3b2 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:35.095500 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1861fe4-bc6f-4320-8ad0-4c8b029fb3b2 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:35.134102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568482-83de-4756-9439-1e987aa15e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:35.135464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568482-83de-4756-9439-1e987aa15e82 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.136587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568482-83de-4756-9439-1e987aa15e82 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.136877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568482-83de-4756-9439-1e987aa15e82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.148102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3568482-83de-4756-9439-1e987aa15e82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:35.156517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-e3568482-83de-4756-9439-1e987aa15e82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:35.156517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:35.156517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:35.156517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:35.156517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:35.156517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:35.156517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:35.156517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:35.156517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:35.156517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:35.156517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:35.156517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:35.156517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:35.156517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:35.156517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:35.156517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:35.157611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:35.157611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:35.157611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:35.157611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:35.157611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:35.157611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:35.157611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:35.157611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:35.157611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:35.157611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:35.157611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:35.157611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:35.157611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:35.157611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:35.157611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:35.157611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:35.158626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:35.158626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:35.158626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:35.158626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:35.158626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:35.158626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:35.158626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:35.158626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:35.158626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:35.158626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:35.158626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:35.158626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:35.161215 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 200/408] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:46:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:35.168136 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568482-83de-4756-9439-1e987aa15e82 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:35.189548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390ad85-8268-4e7e-ae47-cd43486bc8be None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:35.262482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1efd2-b1a0-4960-b070-69beffeee163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:35.263260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1efd2-b1a0-4960-b070-69beffeee163 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.263537 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1efd2-b1a0-4960-b070-69beffeee163 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.263810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1efd2-b1a0-4960-b070-69beffeee163 None admin] PATH_INFO: `/v3/groups/ae662303008b423aacfe57515fbf1c46` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.265018 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1efd2-b1a0-4960-b070-69beffeee163 None admin] RBAC: Authorizing `identity:get_group(group_id=ae662303008b423aacfe57515fbf1c46)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:35.266606 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1efd2-b1a0-4960-b070-69beffeee163 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:35.272839 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 209/409] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 13:46:34 2022] GET /identity/v3/groups/ae662303008b423aacfe57515fbf1c46 => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:35.274186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1efd2-b1a0-4960-b070-69beffeee163 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:35.364591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568482-83de-4756-9439-1e987aa15e82 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:35.441326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62661b90-04c0-47dd-b912-1cf75d131f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:35.441991 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62661b90-04c0-47dd-b912-1cf75d131f1e None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.442268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62661b90-04c0-47dd-b912-1cf75d131f1e None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.442535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62661b90-04c0-47dd-b912-1cf75d131f1e None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.443271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62661b90-04c0-47dd-b912-1cf75d131f1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:35.443567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62661b90-04c0-47dd-b912-1cf75d131f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:35.445506 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62661b90-04c0-47dd-b912-1cf75d131f1e None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:35.459417 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 201/410] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:35.462717 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1efd2-b1a0-4960-b070-69beffeee163 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:35.466986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62661b90-04c0-47dd-b912-1cf75d131f1e None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:35.525505 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551758a9-ee03-45ab-9461-92d45e6dd2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:35.526554 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551758a9-ee03-45ab-9461-92d45e6dd2ee None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.526830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551758a9-ee03-45ab-9461-92d45e6dd2ee None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.527097 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551758a9-ee03-45ab-9461-92d45e6dd2ee None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.528463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551758a9-ee03-45ab-9461-92d45e6dd2ee None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:35.530690 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551758a9-ee03-45ab-9461-92d45e6dd2ee None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:35.533014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 210/411] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:35 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:35.538661 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551758a9-ee03-45ab-9461-92d45e6dd2ee None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:35.657741 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62661b90-04c0-47dd-b912-1cf75d131f1e None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:35.707590 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551758a9-ee03-45ab-9461-92d45e6dd2ee None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:35.723915 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823075c-5873-4f77-8ed3-4f9a3050e0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:35.724798 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823075c-5873-4f77-8ed3-4f9a3050e0af None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.725076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823075c-5873-4f77-8ed3-4f9a3050e0af None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.725381 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823075c-5873-4f77-8ed3-4f9a3050e0af None admin] PATH_INFO: `/v3/groups/58b864e1cf844a3491c971d5c6156caf` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.727131 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823075c-5873-4f77-8ed3-4f9a3050e0af None admin] RBAC: Authorizing `identity:get_group(group_id=58b864e1cf844a3491c971d5c6156caf)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:35.728588 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823075c-5873-4f77-8ed3-4f9a3050e0af None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:35.732918 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 202/412] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 13:46:35 2022] GET /identity/v3/groups/58b864e1cf844a3491c971d5c6156caf => generated 229 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:35.736782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823075c-5873-4f77-8ed3-4f9a3050e0af None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:35.775332 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac960e4d-4bc5-4f1e-bbbd-a49f43249f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:35.776286 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac960e4d-4bc5-4f1e-bbbd-a49f43249f92 None admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.776506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac960e4d-4bc5-4f1e-bbbd-a49f43249f92 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.776771 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac960e4d-4bc5-4f1e-bbbd-a49f43249f92 None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a/groups/ae662303008b423aacfe57515fbf1c46/roles/c8015925658a407b9977b5b0a7f50f05` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.778983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac960e4d-4bc5-4f1e-bbbd-a49f43249f92 None admin] RBAC: Authorizing `identity:create_grant(project_id=e826a1db652e46829670062be316817a, group_id=ae662303008b423aacfe57515fbf1c46, role_id=c8015925658a407b9977b5b0a7f50f05)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:35.780572 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac960e4d-4bc5-4f1e-bbbd-a49f43249f92 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:35.811102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 211/413] 10.222.0.49 () {58 vars in 1442 bytes} [Tue May 10 13:46:35 2022] PUT /identity/v3/projects/e826a1db652e46829670062be316817a/groups/ae662303008b423aacfe57515fbf1c46/roles/c8015925658a407b9977b5b0a7f50f05 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:35.871143 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823075c-5873-4f77-8ed3-4f9a3050e0af None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:35.879679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97c020-6627-42aa-b35e-4f4d26309612 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.880365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97c020-6627-42aa-b35e-4f4d26309612 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.880841 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97c020-6627-42aa-b35e-4f4d26309612 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.886784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 212/414] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:35.888390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a3c3f-a5f8-42b0-86e6-d9c2dc9dc945 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.888879 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a3c3f-a5f8-42b0-86e6-d9c2dc9dc945 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.889349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a3c3f-a5f8-42b0-86e6-d9c2dc9dc945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.908683 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46c8ed-dda7-4c91-862c-4c7be644f14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:35.909675 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46c8ed-dda7-4c91-862c-4c7be644f14e None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:35.909956 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46c8ed-dda7-4c91-862c-4c7be644f14e None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:35.910231 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46c8ed-dda7-4c91-862c-4c7be644f14e None admin] PATH_INFO: `/v3/projects/71179eb4635448dd8ef63856db24457f` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:35.911626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46c8ed-dda7-4c91-862c-4c7be644f14e None admin] RBAC: Authorizing `identity:get_project(project_id=71179eb4635448dd8ef63856db24457f)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:35.915451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46c8ed-dda7-4c91-862c-4c7be644f14e None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:35.915451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 203/415] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:35 2022] GET /identity/v3/projects/71179eb4635448dd8ef63856db24457f => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:35.926342 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f46a3c3f-a5f8-42b0-86e6-d9c2dc9dc945 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:35.928041 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f46a3c3f-a5f8-42b0-86e6-d9c2dc9dc945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:35.929724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46c8ed-dda7-4c91-862c-4c7be644f14e None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:36.049303 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46c8ed-dda7-4c91-862c-4c7be644f14e None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:36.061736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 213/416] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:36.088395 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a3c3f-a5f8-42b0-86e6-d9c2dc9dc945 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:36.088676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c7b9b-daed-40e1-9673-eaa5e1f1a9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:36.089829 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c7b9b-daed-40e1-9673-eaa5e1f1a9fe None admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:36.090257 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c7b9b-daed-40e1-9673-eaa5e1f1a9fe None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:36.090699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c7b9b-daed-40e1-9673-eaa5e1f1a9fe None admin] PATH_INFO: `/v3/projects/71179eb4635448dd8ef63856db24457f/groups/58b864e1cf844a3491c971d5c6156caf/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:36.094307 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c7b9b-daed-40e1-9673-eaa5e1f1a9fe None admin] RBAC: Authorizing `identity:create_grant(project_id=71179eb4635448dd8ef63856db24457f, group_id=58b864e1cf844a3491c971d5c6156caf, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:36.095911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c7b9b-daed-40e1-9673-eaa5e1f1a9fe None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:36.133493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 204/417] 10.222.0.49 () {58 vars in 1442 bytes} [Tue May 10 13:46:35 2022] PUT /identity/v3/projects/71179eb4635448dd8ef63856db24457f/groups/58b864e1cf844a3491c971d5c6156caf/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:36.194804 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a3c3f-a5f8-42b0-86e6-d9c2dc9dc945 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:36.234585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f52fc-fa7c-4fb4-9d8e-710a2197c93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:36.235415 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f52fc-fa7c-4fb4-9d8e-710a2197c93b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:36.235692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f52fc-fa7c-4fb4-9d8e-710a2197c93b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:36.235958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f52fc-fa7c-4fb4-9d8e-710a2197c93b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:36.259442 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f52fc-fa7c-4fb4-9d8e-710a2197c93b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:36.268023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-213f52fc-fa7c-4fb4-9d8e-710a2197c93b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:36.268023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:36.268023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:36.268023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:36.268023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:36.268023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:36.268023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:36.268023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:36.268023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:36.268023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:36.268023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:36.268023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:36.268023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:36.268023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:36.268023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:36.268023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:36.269486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:36.269486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:36.269486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:36.269486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:36.269486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:36.269486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:36.269486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:36.269486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:36.269486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:36.269486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:36.269486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:36.269486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:36.269486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:36.269486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:36.269486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:36.269486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:36.270959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:36.270959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:36.270959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:36.270959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:36.270959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:36.270959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:36.270959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:36.270959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:36.270959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:36.270959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:36.270959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:36.270959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:36.276203 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 214/418] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:36.279775 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c7b9b-daed-40e1-9673-eaa5e1f1a9fe None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:36.427272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c7b9b-daed-40e1-9673-eaa5e1f1a9fe None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:36.463921 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962d35f-6dd2-4bdb-a78b-5d52a3776181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:36.464657 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962d35f-6dd2-4bdb-a78b-5d52a3776181 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:36.465081 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962d35f-6dd2-4bdb-a78b-5d52a3776181 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:36.465534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962d35f-6dd2-4bdb-a78b-5d52a3776181 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:36.466781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962d35f-6dd2-4bdb-a78b-5d52a3776181 None admin] RBAC: Adding query filter params (name=member) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:36.467258 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962d35f-6dd2-4bdb-a78b-5d52a3776181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:36.468849 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962d35f-6dd2-4bdb-a78b-5d52a3776181 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:36.469449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3810f-91bc-4ba5-954c-614d49ce3667 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:36.469901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3810f-91bc-4ba5-954c-614d49ce3667 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:36.470378 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3810f-91bc-4ba5-954c-614d49ce3667 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:36.471952 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 215/419] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:36.477427 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce9df8-8f4c-4b1b-a9dd-5b3da1bbfd01 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:36.477715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce9df8-8f4c-4b1b-a9dd-5b3da1bbfd01 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:36.478002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce9df8-8f4c-4b1b-a9dd-5b3da1bbfd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:36.478190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 205/420] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:36.489126 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962d35f-6dd2-4bdb-a78b-5d52a3776181 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:36.500491 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-94ce9df8-8f4c-4b1b-a9dd-5b3da1bbfd01 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:36.501667 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-94ce9df8-8f4c-4b1b-a9dd-5b3da1bbfd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:36.594077 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962d35f-6dd2-4bdb-a78b-5d52a3776181 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:36.634478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0ae7d-4d63-44c5-ae78-52f50752b7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:36.636019 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0ae7d-4d63-44c5-ae78-52f50752b7f6 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:36.636851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0ae7d-4d63-44c5-ae78-52f50752b7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:36.637604 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0ae7d-4d63-44c5-ae78-52f50752b7f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:36.650697 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 216/421] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:36.670965 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce9df8-8f4c-4b1b-a9dd-5b3da1bbfd01 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:36.772143 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce9df8-8f4c-4b1b-a9dd-5b3da1bbfd01 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:36.777265 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0ae7d-4d63-44c5-ae78-52f50752b7f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:36.778735 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0ae7d-4d63-44c5-ae78-52f50752b7f6 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:36.808603 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96605fc2-b63b-462d-a70f-1b9bbf8ed8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:36.809411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96605fc2-b63b-462d-a70f-1b9bbf8ed8cd None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:36.809691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96605fc2-b63b-462d-a70f-1b9bbf8ed8cd None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:36.809964 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96605fc2-b63b-462d-a70f-1b9bbf8ed8cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:36.820335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96605fc2-b63b-462d-a70f-1b9bbf8ed8cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:36.828356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-96605fc2-b63b-462d-a70f-1b9bbf8ed8cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:36.828356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:36.828356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:36.828356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:36.828356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:36.828356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:36.828356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:36.828356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:36.828356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:36.828356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:36.828356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:36.828356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:36.828356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:36.828356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:36.828356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:36.828356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:36.829267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:36.829267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:36.829267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:36.829267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:36.829267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:36.829267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:36.829267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:36.829267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:36.829267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:36.829267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:36.829267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:36.829267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:36.829267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:36.829267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:36.829267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:36.829267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:36.830490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:36.830490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:36.830490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:36.830490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:36.830490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:36.830490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:36.830490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:36.830490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:36.830490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:36.830490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:36.830490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:36.830490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:36.830490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 217/422] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:46:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:36.835375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96605fc2-b63b-462d-a70f-1b9bbf8ed8cd None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:36.936877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96605fc2-b63b-462d-a70f-1b9bbf8ed8cd None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:36.974581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581ad6a-76fc-43bb-90ab-3d6f4c968486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:36.975773 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581ad6a-76fc-43bb-90ab-3d6f4c968486 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:36.976065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581ad6a-76fc-43bb-90ab-3d6f4c968486 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:36.976361 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581ad6a-76fc-43bb-90ab-3d6f4c968486 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:36.977116 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581ad6a-76fc-43bb-90ab-3d6f4c968486 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:36.977416 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581ad6a-76fc-43bb-90ab-3d6f4c968486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:36.978788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581ad6a-76fc-43bb-90ab-3d6f4c968486 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:36.996120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 218/423] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:37.003036 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581ad6a-76fc-43bb-90ab-3d6f4c968486 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:37.019765 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 206/424] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 13:46:37.025007 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0ae7d-4d63-44c5-ae78-52f50752b7f6 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:37.132625 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581ad6a-76fc-43bb-90ab-3d6f4c968486 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:37.191057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0ae7d-4d63-44c5-ae78-52f50752b7f6 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:37.200585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090ea31-27c8-4103-95ed-9105011d1ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:37.201256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090ea31-27c8-4103-95ed-9105011d1ff5 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:37.201533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090ea31-27c8-4103-95ed-9105011d1ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:37.201807 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090ea31-27c8-4103-95ed-9105011d1ff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:37.266663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e7f27-1824-4000-81dd-c58b0ec711ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:37.267539 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e7f27-1824-4000-81dd-c58b0ec711ac None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:37.267826 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e7f27-1824-4000-81dd-c58b0ec711ac None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:37.268085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e7f27-1824-4000-81dd-c58b0ec711ac None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:37.271210 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e7f27-1824-4000-81dd-c58b0ec711ac None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:37.273270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e7f27-1824-4000-81dd-c58b0ec711ac None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:37.275399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 207/425] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:37 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:37.285085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e7f27-1824-4000-81dd-c58b0ec711ac None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:37.313964 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090ea31-27c8-4103-95ed-9105011d1ff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:37.316069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090ea31-27c8-4103-95ed-9105011d1ff5 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:37.431753 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 219/426] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:37.433486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2dda8-88c2-4db7-8777-47be9fdfaef0 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:37.433957 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2dda8-88c2-4db7-8777-47be9fdfaef0 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:37.434476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2dda8-88c2-4db7-8777-47be9fdfaef0 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:37.436252 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 220/427] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:37.437176 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2dda8-88c2-4db7-8777-47be9fdfaef0 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:37.473835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e7f27-1824-4000-81dd-c58b0ec711ac None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:37.507604 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46472487-6dff-4382-82fe-b3cc5e6e5f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:37.508478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46472487-6dff-4382-82fe-b3cc5e6e5f2f None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:37.508750 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46472487-6dff-4382-82fe-b3cc5e6e5f2f None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:37.509016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46472487-6dff-4382-82fe-b3cc5e6e5f2f None admin] PATH_INFO: `/v3/groups/ae662303008b423aacfe57515fbf1c46` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:37.510649 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46472487-6dff-4382-82fe-b3cc5e6e5f2f None admin] RBAC: Authorizing `identity:get_group(group_id=ae662303008b423aacfe57515fbf1c46)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:37.512434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46472487-6dff-4382-82fe-b3cc5e6e5f2f None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:37.519966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 208/428] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 13:46:37 2022] GET /identity/v3/groups/ae662303008b423aacfe57515fbf1c46 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:37.521245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d488f-9783-42e2-96e7-136731034d1a None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:37.521528 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d488f-9783-42e2-96e7-136731034d1a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:37.521805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d488f-9783-42e2-96e7-136731034d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:37.542987 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-9d8d488f-9783-42e2-96e7-136731034d1a None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:37.544730 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-9d8d488f-9783-42e2-96e7-136731034d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:37.547508 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2dda8-88c2-4db7-8777-47be9fdfaef0 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:37.581140 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4159f-7640-4702-8016-ce8ed73279a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:37.582508 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4159f-7640-4702-8016-ce8ed73279a2 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:37.582987 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4159f-7640-4702-8016-ce8ed73279a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:37.583448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4159f-7640-4702-8016-ce8ed73279a2 None admin] PATH_INFO: `/v3/projects/bd162913396140aca4b3f16233ad0c64` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:37.585141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4159f-7640-4702-8016-ce8ed73279a2 None admin] RBAC: Authorizing `identity:get_project(project_id=bd162913396140aca4b3f16233ad0c64)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:37.586844 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4159f-7640-4702-8016-ce8ed73279a2 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:37.589199 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 221/429] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:37 2022] GET /identity/v3/projects/bd162913396140aca4b3f16233ad0c64 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:37.590480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4159f-7640-4702-8016-ce8ed73279a2 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:37.628286 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 209/430] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:37.629509 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d488f-9783-42e2-96e7-136731034d1a None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:37.705099 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4159f-7640-4702-8016-ce8ed73279a2 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:37.747236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d488f-9783-42e2-96e7-136731034d1a None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:37.747429 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28368580-1185-4ef0-87f8-ec8106883727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:37.747931 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28368580-1185-4ef0-87f8-ec8106883727 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:37.748226 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28368580-1185-4ef0-87f8-ec8106883727 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:37.748502 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28368580-1185-4ef0-87f8-ec8106883727 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:37.749321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28368580-1185-4ef0-87f8-ec8106883727 None admin] RBAC: Adding query filter params (group.id=ae662303008b423aacfe57515fbf1c46, role.id=15845f6e13b44ef7893159f660311b15, scope.project.id=bd162913396140aca4b3f16233ad0c64) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:37.749622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28368580-1185-4ef0-87f8-ec8106883727 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:37.751961 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28368580-1185-4ef0-87f8-ec8106883727 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:37.759389 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 222/431] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 13:46:37 2022] GET /identity/v3/role_assignments?group.id=ae662303008b423aacfe57515fbf1c46&scope.project.id=bd162913396140aca4b3f16233ad0c64&role.id=15845f6e13b44ef7893159f660311b15 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:37.759978 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28368580-1185-4ef0-87f8-ec8106883727 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:37.812652 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418052af-a0e5-45cc-ad51-18c9694c478a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:37.814678 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418052af-a0e5-45cc-ad51-18c9694c478a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:37.815922 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418052af-a0e5-45cc-ad51-18c9694c478a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:37.817139 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418052af-a0e5-45cc-ad51-18c9694c478a None admin] PATH_INFO: `/v3/groups/ae662303008b423aacfe57515fbf1c46` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:37.820577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418052af-a0e5-45cc-ad51-18c9694c478a None admin] RBAC: Authorizing `identity:get_group(group_id=ae662303008b423aacfe57515fbf1c46)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:37.822380 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418052af-a0e5-45cc-ad51-18c9694c478a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:37.825876 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 210/432] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 13:46:37 2022] GET /identity/v3/groups/ae662303008b423aacfe57515fbf1c46 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:37.832252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418052af-a0e5-45cc-ad51-18c9694c478a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:37.971916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28368580-1185-4ef0-87f8-ec8106883727 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:37.977053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418052af-a0e5-45cc-ad51-18c9694c478a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:38.014599 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec548f47-8a02-414b-8047-49a78860035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:38.015711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec548f47-8a02-414b-8047-49a78860035a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:38.016307 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec548f47-8a02-414b-8047-49a78860035a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:38.016853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec548f47-8a02-414b-8047-49a78860035a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:38.017160 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16100e31-4d47-4e92-91e1-bc3b00708acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:38.017963 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16100e31-4d47-4e92-91e1-bc3b00708acb None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:38.018245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16100e31-4d47-4e92-91e1-bc3b00708acb None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:38.018518 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16100e31-4d47-4e92-91e1-bc3b00708acb None admin] PATH_INFO: `/v3/roles/member` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:38.018747 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec548f47-8a02-414b-8047-49a78860035a None admin] RBAC: Adding query filter params (group.id=ae662303008b423aacfe57515fbf1c46, role.id=c8015925658a407b9977b5b0a7f50f05, scope.project.id=bd162913396140aca4b3f16233ad0c64) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:38.019428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec548f47-8a02-414b-8047-49a78860035a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:38.021093 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec548f47-8a02-414b-8047-49a78860035a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:38.028551 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 211/433] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 13:46:37 2022] GET /identity/v3/role_assignments?group.id=ae662303008b423aacfe57515fbf1c46&scope.project.id=bd162913396140aca4b3f16233ad0c64&role.id=c8015925658a407b9977b5b0a7f50f05 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:38.033101 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16100e31-4d47-4e92-91e1-bc3b00708acb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:38.041458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-16100e31-4d47-4e92-91e1-bc3b00708acb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:38.041458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:38.041458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:38.041458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:38.041458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:38.041458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:38.041458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:38.041458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:38.041458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:38.041458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:38.041458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:38.041458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:38.041458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:38.041458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:38.041458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:38.041458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:38.042452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:38.042452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:38.042452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:38.042452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:38.042452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:38.042452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:38.042452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:38.042452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:38.042452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:38.042452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:38.042452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:38.042452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:38.042452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:38.042452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:38.042452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:38.042452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:38.043273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:38.043273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:38.043273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:38.043273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:38.043273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:38.043273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:38.043273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:38.043273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:38.043273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:38.043273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:38.043273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 13:46:38.043273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:38.050898 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 223/434] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:38.052728 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec548f47-8a02-414b-8047-49a78860035a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:38.160517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec548f47-8a02-414b-8047-49a78860035a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:38.204991 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a872c9e-5665-4608-ad3a-d2ead20cd804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:38.206462 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a872c9e-5665-4608-ad3a-d2ead20cd804 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:38.206968 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a872c9e-5665-4608-ad3a-d2ead20cd804 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:38.207440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a872c9e-5665-4608-ad3a-d2ead20cd804 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:38.208452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a872c9e-5665-4608-ad3a-d2ead20cd804 None admin] RBAC: Adding query filter params (name=member) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:38.208960 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a872c9e-5665-4608-ad3a-d2ead20cd804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:38.211096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a872c9e-5665-4608-ad3a-d2ead20cd804 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:38.227053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 212/435] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:46:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:38.228819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16100e31-4d47-4e92-91e1-bc3b00708acb None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:38.341292 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16100e31-4d47-4e92-91e1-bc3b00708acb None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:38.380696 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cc09a-1701-4818-b257-9ae9bd6bef9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:38.380894 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cc09a-1701-4818-b257-9ae9bd6bef9b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:38.381124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cc09a-1701-4818-b257-9ae9bd6bef9b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:38.381357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cc09a-1701-4818-b257-9ae9bd6bef9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:38.460009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cc09a-1701-4818-b257-9ae9bd6bef9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:38.461572 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cc09a-1701-4818-b257-9ae9bd6bef9b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:38.473837 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206652b9-3a1a-4856-8a98-fc190ab53bb5 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:38.474119 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206652b9-3a1a-4856-8a98-fc190ab53bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:38.474391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206652b9-3a1a-4856-8a98-fc190ab53bb5 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:38.476545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 213/436] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:38.483325 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f97d3-c217-4736-bdfc-a88ee7387575 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:38.483619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f97d3-c217-4736-bdfc-a88ee7387575 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:38.483881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f97d3-c217-4736-bdfc-a88ee7387575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:38.502198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-fb8f97d3-c217-4736-bdfc-a88ee7387575 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:38.503473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-fb8f97d3-c217-4736-bdfc-a88ee7387575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:38.584289 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 224/437] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:38.587350 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cc09a-1701-4818-b257-9ae9bd6bef9b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:38.593971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 214/438] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:38.617479 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f97d3-c217-4736-bdfc-a88ee7387575 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:38.714103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cc09a-1701-4818-b257-9ae9bd6bef9b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:38.750433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f97d3-c217-4736-bdfc-a88ee7387575 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:38.754401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759d802-9ddd-4c14-a22c-404b40537bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:38.755275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759d802-9ddd-4c14-a22c-404b40537bd8 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:38.755557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759d802-9ddd-4c14-a22c-404b40537bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:38.755831 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759d802-9ddd-4c14-a22c-404b40537bd8 None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:38.757624 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759d802-9ddd-4c14-a22c-404b40537bd8 None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:38.759045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759d802-9ddd-4c14-a22c-404b40537bd8 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:38.761639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 225/439] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:38 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:38.761969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda11eb-97c3-47c7-8ef0-9fe47f3a5611 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:38.762224 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda11eb-97c3-47c7-8ef0-9fe47f3a5611 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:38.762507 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda11eb-97c3-47c7-8ef0-9fe47f3a5611 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:38.763713 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 226/440] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:38.768573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda11eb-97c3-47c7-8ef0-9fe47f3a5611 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:38.786275 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc75067-cf63-4e4d-9e7e-2a9de289ddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:38.787085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc75067-cf63-4e4d-9e7e-2a9de289ddc4 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:38.787365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc75067-cf63-4e4d-9e7e-2a9de289ddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:38.787636 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc75067-cf63-4e4d-9e7e-2a9de289ddc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:38.797485 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc75067-cf63-4e4d-9e7e-2a9de289ddc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:38.806002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-6dc75067-cf63-4e4d-9e7e-2a9de289ddc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:38.806002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:38.806002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:38.806002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:38.806002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:38.806002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:38.806002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:38.806002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:38.806002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:38.806002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:38.806002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:38.806002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:38.806002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:38.806002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:38.806002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:38.806002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:38.807103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:38.807103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:38.807103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:38.807103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:38.807103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:38.807103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:38.807103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:38.807103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:38.807103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:38.807103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:38.807103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:38.807103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:38.807103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:38.807103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:38.807103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:38.807103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:38.807975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:38.807975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:38.807975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:38.807975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:38.807975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:38.807975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:38.807975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:38.807975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:38.807975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:38.807975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:38.807975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:38.807975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:38.807975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 215/441] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:46:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:38.808721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840a562-13de-4229-a462-2a2f23ddafcc None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:38.808721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840a562-13de-4229-a462-2a2f23ddafcc None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:38.808942 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840a562-13de-4229-a462-2a2f23ddafcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:38.828846 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-e840a562-13de-4229-a462-2a2f23ddafcc None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:38.830006 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-e840a562-13de-4229-a462-2a2f23ddafcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:38.870347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda11eb-97c3-47c7-8ef0-9fe47f3a5611 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:38.892785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 216/442] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:38.893694 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840a562-13de-4229-a462-2a2f23ddafcc None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:38.905700 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c14e0-01ad-401d-a183-60c8788710f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:38.906979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c14e0-01ad-401d-a183-60c8788710f8 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:38.907389 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c14e0-01ad-401d-a183-60c8788710f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:38.907822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c14e0-01ad-401d-a183-60c8788710f8 None admin] PATH_INFO: `/v3/groups/ae662303008b423aacfe57515fbf1c46` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:38.909150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c14e0-01ad-401d-a183-60c8788710f8 None admin] RBAC: Authorizing `identity:get_group(group_id=ae662303008b423aacfe57515fbf1c46)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:38.910714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c14e0-01ad-401d-a183-60c8788710f8 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:38.912788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 227/443] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 13:46:38 2022] GET /identity/v3/groups/ae662303008b423aacfe57515fbf1c46 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:38.916145 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c14e0-01ad-401d-a183-60c8788710f8 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:38.986012 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840a562-13de-4229-a462-2a2f23ddafcc None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:39.010277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c14e0-01ad-401d-a183-60c8788710f8 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:39.026717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7370755-fc2e-4f1e-a4a0-fd9305257e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:39.027372 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7370755-fc2e-4f1e-a4a0-fd9305257e01 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:39.027651 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7370755-fc2e-4f1e-a4a0-fd9305257e01 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:39.027922 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7370755-fc2e-4f1e-a4a0-fd9305257e01 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:39.028689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7370755-fc2e-4f1e-a4a0-fd9305257e01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:39.028987 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7370755-fc2e-4f1e-a4a0-fd9305257e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:39.030358 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7370755-fc2e-4f1e-a4a0-fd9305257e01 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:39.038341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 217/444] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:39.039104 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7370755-fc2e-4f1e-a4a0-fd9305257e01 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:39.045155 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ba8cf-b5dc-4e0e-a637-6091cd9b1f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:39.045956 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ba8cf-b5dc-4e0e-a637-6091cd9b1f8b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:39.046235 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ba8cf-b5dc-4e0e-a637-6091cd9b1f8b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:39.046507 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ba8cf-b5dc-4e0e-a637-6091cd9b1f8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:39.056360 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ba8cf-b5dc-4e0e-a637-6091cd9b1f8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:39.063821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-851ba8cf-b5dc-4e0e-a637-6091cd9b1f8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:39.063821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:39.063821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:39.063821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:39.063821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:39.063821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:39.063821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:39.063821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:39.063821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:39.063821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:39.063821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:39.063821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:39.063821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:39.063821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:39.063821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:39.063821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:39.064923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:39.064923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:39.064923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:39.064923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:39.064923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:39.064923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:39.064923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:39.064923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:39.064923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:39.064923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:39.064923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:39.064923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:39.064923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:39.064923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:39.064923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:39.064923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:39.071189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:39.071189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:39.071189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:39.071189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:39.071189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:39.071189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:39.071189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:39.071189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:39.071189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:39.071189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:39.071189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:46:39.071189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:39.071189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 228/445] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:46:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:39.071189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ba8cf-b5dc-4e0e-a637-6091cd9b1f8b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:39.138941 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7370755-fc2e-4f1e-a4a0-fd9305257e01 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:39.158909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ba8cf-b5dc-4e0e-a637-6091cd9b1f8b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:39.171073 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597410d2-5559-4b90-945c-e2a1a609aa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:39.171727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597410d2-5559-4b90-945c-e2a1a609aa49 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:39.172000 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597410d2-5559-4b90-945c-e2a1a609aa49 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:39.172296 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597410d2-5559-4b90-945c-e2a1a609aa49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:39.173119 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597410d2-5559-4b90-945c-e2a1a609aa49 None admin] RBAC: Adding query filter params (group.id=ae662303008b423aacfe57515fbf1c46, role.id=15845f6e13b44ef7893159f660311b15, scope.project.id=e826a1db652e46829670062be316817a) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:39.173430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597410d2-5559-4b90-945c-e2a1a609aa49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:39.174851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597410d2-5559-4b90-945c-e2a1a609aa49 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:39.180542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 218/446] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 13:46:39 2022] GET /identity/v3/role_assignments?group.id=ae662303008b423aacfe57515fbf1c46&scope.project.id=e826a1db652e46829670062be316817a&role.id=15845f6e13b44ef7893159f660311b15 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:39.181308 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597410d2-5559-4b90-945c-e2a1a609aa49 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:39.191011 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7048b-6039-4904-b63c-989ec5285d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:39.191692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7048b-6039-4904-b63c-989ec5285d83 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:39.191974 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7048b-6039-4904-b63c-989ec5285d83 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:39.192281 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7048b-6039-4904-b63c-989ec5285d83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:39.264042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7048b-6039-4904-b63c-989ec5285d83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:39.265550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7048b-6039-4904-b63c-989ec5285d83 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:39.288579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597410d2-5559-4b90-945c-e2a1a609aa49 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:39.323084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b7a44-c0e9-4786-84b0-8b5654839cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:39.323898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b7a44-c0e9-4786-84b0-8b5654839cfd None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:39.324441 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b7a44-c0e9-4786-84b0-8b5654839cfd None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:39.324731 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b7a44-c0e9-4786-84b0-8b5654839cfd None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:39.325484 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b7a44-c0e9-4786-84b0-8b5654839cfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:39.325794 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b7a44-c0e9-4786-84b0-8b5654839cfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:39.327185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b7a44-c0e9-4786-84b0-8b5654839cfd None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:39.340221 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 219/447] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:39.342202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b7a44-c0e9-4786-84b0-8b5654839cfd None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:39.377423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 229/448] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:39.384341 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7048b-6039-4904-b63c-989ec5285d83 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:39.460913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b7a44-c0e9-4786-84b0-8b5654839cfd None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:39.489768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7048b-6039-4904-b63c-989ec5285d83 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:39.494980 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e89d4-b8e3-43df-8a5e-d9904516fa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:39.494980 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e89d4-b8e3-43df-8a5e-d9904516fa07 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:39.495203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e89d4-b8e3-43df-8a5e-d9904516fa07 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:39.495386 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e89d4-b8e3-43df-8a5e-d9904516fa07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:39.526018 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be3b01-ea8c-41b8-863c-1abdbbe49741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:39.526875 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be3b01-ea8c-41b8-863c-1abdbbe49741 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:39.527616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be3b01-ea8c-41b8-863c-1abdbbe49741 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:39.527616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be3b01-ea8c-41b8-863c-1abdbbe49741 None admin] PATH_INFO: `/v3/projects/e826a1db652e46829670062be316817a` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:39.529318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be3b01-ea8c-41b8-863c-1abdbbe49741 None admin] RBAC: Authorizing `identity:get_project(project_id=e826a1db652e46829670062be316817a)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:39.532186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be3b01-ea8c-41b8-863c-1abdbbe49741 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:39.532970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 230/449] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:39 2022] GET /identity/v3/projects/e826a1db652e46829670062be316817a => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:39.540148 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be3b01-ea8c-41b8-863c-1abdbbe49741 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:39.576398 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e89d4-b8e3-43df-8a5e-d9904516fa07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:39.577838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e89d4-b8e3-43df-8a5e-d9904516fa07 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:39.640916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be3b01-ea8c-41b8-863c-1abdbbe49741 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:39.670321 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 220/450] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 13:46:39.672065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780da7e-bb9e-4fd2-85c7-42872a2eb076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:39.672959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780da7e-bb9e-4fd2-85c7-42872a2eb076 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:39.673232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780da7e-bb9e-4fd2-85c7-42872a2eb076 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:39.673499 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780da7e-bb9e-4fd2-85c7-42872a2eb076 None admin] PATH_INFO: `/v3/groups/ae662303008b423aacfe57515fbf1c46` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:39.674747 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780da7e-bb9e-4fd2-85c7-42872a2eb076 None admin] RBAC: Authorizing `identity:get_group(group_id=ae662303008b423aacfe57515fbf1c46)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:39.675724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e89d4-b8e3-43df-8a5e-d9904516fa07 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:39.676152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780da7e-bb9e-4fd2-85c7-42872a2eb076 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:39.677749 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 231/451] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 13:46:39 2022] GET /identity/v3/groups/ae662303008b423aacfe57515fbf1c46 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:39.683638 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780da7e-bb9e-4fd2-85c7-42872a2eb076 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:39.767612 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e89d4-b8e3-43df-8a5e-d9904516fa07 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:39.773914 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780da7e-bb9e-4fd2-85c7-42872a2eb076 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:39.799099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c71704-4516-4bd5-93ff-250bb39e4713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:39.799930 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c71704-4516-4bd5-93ff-250bb39e4713 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:39.800233 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c71704-4516-4bd5-93ff-250bb39e4713 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:39.800503 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c71704-4516-4bd5-93ff-250bb39e4713 None admin] PATH_INFO: `/v3/projects/71179eb4635448dd8ef63856db24457f` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:39.801655 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c71704-4516-4bd5-93ff-250bb39e4713 None admin] RBAC: Authorizing `identity:get_project(project_id=71179eb4635448dd8ef63856db24457f)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:39.803075 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c71704-4516-4bd5-93ff-250bb39e4713 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:39.805467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 221/452] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:46:39 2022] GET /identity/v3/projects/71179eb4635448dd8ef63856db24457f => generated 344 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:39.806711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb006d4a-6a14-4ae8-bf50-5636d4736f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:39.807359 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb006d4a-6a14-4ae8-bf50-5636d4736f77 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:39.807639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb006d4a-6a14-4ae8-bf50-5636d4736f77 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:39.807911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb006d4a-6a14-4ae8-bf50-5636d4736f77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:39.808763 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb006d4a-6a14-4ae8-bf50-5636d4736f77 None admin] RBAC: Adding query filter params (group.id=ae662303008b423aacfe57515fbf1c46, role.id=c8015925658a407b9977b5b0a7f50f05, scope.project.id=e826a1db652e46829670062be316817a) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:39.809072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb006d4a-6a14-4ae8-bf50-5636d4736f77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:39.810479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb006d4a-6a14-4ae8-bf50-5636d4736f77 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:39.810692 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c71704-4516-4bd5-93ff-250bb39e4713 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:39.820627 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 232/453] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 13:46:39 2022] GET /identity/v3/role_assignments?group.id=ae662303008b423aacfe57515fbf1c46&scope.project.id=e826a1db652e46829670062be316817a&role.id=c8015925658a407b9977b5b0a7f50f05 => generated 611 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:39.908558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c71704-4516-4bd5-93ff-250bb39e4713 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:39.942457 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da058c-734d-4136-ad05-713ee68ba6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:39.943315 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da058c-734d-4136-ad05-713ee68ba6d0 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:39.943589 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da058c-734d-4136-ad05-713ee68ba6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:39.943856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da058c-734d-4136-ad05-713ee68ba6d0 None admin] PATH_INFO: `/v3/groups/58b864e1cf844a3491c971d5c6156caf` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:39.945139 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da058c-734d-4136-ad05-713ee68ba6d0 None admin] RBAC: Authorizing `identity:get_group(group_id=58b864e1cf844a3491c971d5c6156caf)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:39.946582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da058c-734d-4136-ad05-713ee68ba6d0 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:39.948256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 222/454] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 13:46:39 2022] GET /identity/v3/groups/58b864e1cf844a3491c971d5c6156caf => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:39.954282 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb006d4a-6a14-4ae8-bf50-5636d4736f77 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:40.055656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb006d4a-6a14-4ae8-bf50-5636d4736f77 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:40.087734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a1fd3-7034-4a1e-8f0c-5eff29247bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:40.088414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a1fd3-7034-4a1e-8f0c-5eff29247bf4 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:40.088696 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a1fd3-7034-4a1e-8f0c-5eff29247bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:40.088968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a1fd3-7034-4a1e-8f0c-5eff29247bf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:40.089791 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a1fd3-7034-4a1e-8f0c-5eff29247bf4 None admin] RBAC: Adding query filter params (group.id=58b864e1cf844a3491c971d5c6156caf, role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=71179eb4635448dd8ef63856db24457f) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:40.090094 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a1fd3-7034-4a1e-8f0c-5eff29247bf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:40.091529 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a1fd3-7034-4a1e-8f0c-5eff29247bf4 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:40.097238 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 233/455] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 13:46:39 2022] GET /identity/v3/role_assignments?group.id=58b864e1cf844a3491c971d5c6156caf&scope.project.id=71179eb4635448dd8ef63856db24457f&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:42.652873 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff20a7-7e28-41f9-852c-26aae626d5cc None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:42.654014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff20a7-7e28-41f9-852c-26aae626d5cc None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:42.654588 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff20a7-7e28-41f9-852c-26aae626d5cc None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:42.656696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 223/456] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:42.662439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa069c73-9785-4927-9e1c-6c9b116e64e0 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:42.663836 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa069c73-9785-4927-9e1c-6c9b116e64e0 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:42.664344 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa069c73-9785-4927-9e1c-6c9b116e64e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:42.689159 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-aa069c73-9785-4927-9e1c-6c9b116e64e0 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:42.690691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-aa069c73-9785-4927-9e1c-6c9b116e64e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:42.781701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70de996-0ea5-4343-a48e-12726be1b807 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:42.782323 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70de996-0ea5-4343-a48e-12726be1b807 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:42.782805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70de996-0ea5-4343-a48e-12726be1b807 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:42.784643 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 224/457] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:42.785990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 234/458] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:42.789389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254c704-703d-4ee9-9236-9abe0cf87500 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:42.789680 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254c704-703d-4ee9-9236-9abe0cf87500 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:42.789960 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254c704-703d-4ee9-9236-9abe0cf87500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:42.810761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa069c73-9785-4927-9e1c-6c9b116e64e0 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:42.816745 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-2254c704-703d-4ee9-9236-9abe0cf87500 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:42.818189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-2254c704-703d-4ee9-9236-9abe0cf87500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:42.934886 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 225/459] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:42.963824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa069c73-9785-4927-9e1c-6c9b116e64e0 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:42.970177 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254c704-703d-4ee9-9236-9abe0cf87500 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:43.004631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5495ea-d738-4a8d-a54a-ecf152390725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:43.005428 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5495ea-d738-4a8d-a54a-ecf152390725 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:43.005710 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5495ea-d738-4a8d-a54a-ecf152390725 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:43.005985 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5495ea-d738-4a8d-a54a-ecf152390725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:43.030400 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5495ea-d738-4a8d-a54a-ecf152390725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:43.032122 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5495ea-d738-4a8d-a54a-ecf152390725 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:43.056668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-1a5495ea-d738-4a8d-a54a-ecf152390725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:43.056668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:43.056668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:43.056668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:43.056668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:43.056668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:43.056668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:43.056668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:43.056668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:43.056668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:43.056668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:43.056668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:43.056668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:43.056668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:43.056668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:43.057611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:43.057611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:43.057611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:43.057611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:43.057611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:43.057611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:43.057611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:43.057611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:43.057611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:43.057611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:43.057611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:43.057611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:43.057611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:43.057611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:43.057611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:43.057611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:43.057611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:43.058479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:43.058479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:43.058479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:43.058479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:43.058479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 235/460] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:43.064866 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5495ea-d738-4a8d-a54a-ecf152390725 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:43.111643 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254c704-703d-4ee9-9236-9abe0cf87500 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:43.160880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81773403-99ea-4371-bcbd-57109ce18a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:43.161677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81773403-99ea-4371-bcbd-57109ce18a41 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:43.161952 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81773403-99ea-4371-bcbd-57109ce18a41 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:43.162216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81773403-99ea-4371-bcbd-57109ce18a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:43.172557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81773403-99ea-4371-bcbd-57109ce18a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:43.174012 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81773403-99ea-4371-bcbd-57109ce18a41 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:43.200938 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5495ea-d738-4a8d-a54a-ecf152390725 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:43.206087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-81773403-99ea-4371-bcbd-57109ce18a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:43.206087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:43.206087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:43.206087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:43.206087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:43.206087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:43.206087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:43.206087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:43.206087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:43.206087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:43.206087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:43.206087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:43.206087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:43.206087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:43.206087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:43.207031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:43.207031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:43.207031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:43.207031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:43.207031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:43.207031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:43.207031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:43.207031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:43.207031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:43.207031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:43.207031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:43.207031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:43.207031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:43.207031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:43.207031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:43.207031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:43.207031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:43.207928 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:43.207928 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:43.207928 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:43.207928 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:43.208592 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 226/461] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:43.222063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81773403-99ea-4371-bcbd-57109ce18a41 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:43.243682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc82ae-1605-419c-bb1e-bc5e1dabd8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:43.244391 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc82ae-1605-419c-bb1e-bc5e1dabd8ec None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:43.244662 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc82ae-1605-419c-bb1e-bc5e1dabd8ec None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:43.244937 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc82ae-1605-419c-bb1e-bc5e1dabd8ec None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:43.245669 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc82ae-1605-419c-bb1e-bc5e1dabd8ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:43.245973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc82ae-1605-419c-bb1e-bc5e1dabd8ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:43.247341 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc82ae-1605-419c-bb1e-bc5e1dabd8ec None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:43.274394 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 236/462] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:43.280049 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc82ae-1605-419c-bb1e-bc5e1dabd8ec None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:43.357832 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81773403-99ea-4371-bcbd-57109ce18a41 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:43.404807 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc82ae-1605-419c-bb1e-bc5e1dabd8ec None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:43.405999 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62fd23-4236-4108-b438-6831c0187c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:43.406663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62fd23-4236-4108-b438-6831c0187c73 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:43.406945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62fd23-4236-4108-b438-6831c0187c73 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:43.407219 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62fd23-4236-4108-b438-6831c0187c73 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:43.407940 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62fd23-4236-4108-b438-6831c0187c73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:43.408266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62fd23-4236-4108-b438-6831c0187c73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:43.409638 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62fd23-4236-4108-b438-6831c0187c73 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:43.441738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 227/463] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:43.443354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebc706-be4f-4c6f-8861-bcc3079802ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:43.444332 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebc706-be4f-4c6f-8861-bcc3079802ab None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:43.444835 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebc706-be4f-4c6f-8861-bcc3079802ab None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:43.445297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebc706-be4f-4c6f-8861-bcc3079802ab None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:43.446270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebc706-be4f-4c6f-8861-bcc3079802ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:43.447275 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62fd23-4236-4108-b438-6831c0187c73 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:43.449703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebc706-be4f-4c6f-8861-bcc3079802ab None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:43.484514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 237/464] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:46:43 2022] POST /identity/v3/users => generated 246 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:46:43.517846 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea29688-d5cf-4a16-b30b-1ddf7502fd37 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:43.518454 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea29688-d5cf-4a16-b30b-1ddf7502fd37 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:43.518919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea29688-d5cf-4a16-b30b-1ddf7502fd37 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:43.525153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 238/465] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:43.534371 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625300a9-b2ec-429b-b06b-fc111321c646 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:43.534977 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625300a9-b2ec-429b-b06b-fc111321c646 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:43.535445 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625300a9-b2ec-429b-b06b-fc111321c646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:43.562840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-625300a9-b2ec-429b-b06b-fc111321c646 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:43.567598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-625300a9-b2ec-429b-b06b-fc111321c646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:43.581972 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62fd23-4236-4108-b438-6831c0187c73 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:43.627438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2699cca-6822-452f-a7b8-b26bb4d95e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:43.629340 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2699cca-6822-452f-a7b8-b26bb4d95e98 None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:43.632139 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2699cca-6822-452f-a7b8-b26bb4d95e98 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:43.632756 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2699cca-6822-452f-a7b8-b26bb4d95e98 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:43.633688 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2699cca-6822-452f-a7b8-b26bb4d95e98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:43.638353 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2699cca-6822-452f-a7b8-b26bb4d95e98 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:43.690334 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 228/466] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:46:43 2022] POST /identity/v3/users => generated 248 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:46:43.691736 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d224e-e5b6-45c5-8441-e9d7704287f0 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:43.692275 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d224e-e5b6-45c5-8441-e9d7704287f0 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:43.692763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d224e-e5b6-45c5-8441-e9d7704287f0 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:43.694936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 239/467] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:43.699818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 229/468] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:43.701276 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aa932-bb85-466a-bcff-5c27a0879aae None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:43.701566 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aa932-bb85-466a-bcff-5c27a0879aae None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:43.701842 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aa932-bb85-466a-bcff-5c27a0879aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:43.719781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d224e-e5b6-45c5-8441-e9d7704287f0 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:43.749506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-ea5aa932-bb85-466a-bcff-5c27a0879aae None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:43.750624 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ea5aa932-bb85-466a-bcff-5c27a0879aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:43.835186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 240/469] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:43.850685 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d224e-e5b6-45c5-8441-e9d7704287f0 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:43.862935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5aa932-bb85-466a-bcff-5c27a0879aae None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:43.896789 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92bf59-b4a7-485d-8763-b64c042e54e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:43.897632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92bf59-b4a7-485d-8763-b64c042e54e6 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:43.897915 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92bf59-b4a7-485d-8763-b64c042e54e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:43.898188 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92bf59-b4a7-485d-8763-b64c042e54e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:43.915606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92bf59-b4a7-485d-8763-b64c042e54e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:43.917695 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92bf59-b4a7-485d-8763-b64c042e54e6 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:43.939472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-0d92bf59-b4a7-485d-8763-b64c042e54e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:43.939472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:43.939472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:43.939472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:43.939472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:43.939472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:43.939472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:43.939472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:43.939472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:43.939472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:43.939472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:43.939472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:43.939472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:43.939472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:43.939472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:43.940460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:43.940460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:43.940460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:43.940460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:43.940460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:43.940460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:43.940460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:43.940460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:43.940460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:43.940460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:43.940460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:43.940460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:43.940460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:43.940460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:43.940460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:43.940460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:43.940460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:43.941335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:43.941335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:43.941335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:43.941335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:43.941335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 230/470] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:43.947309 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92bf59-b4a7-485d-8763-b64c042e54e6 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:43.979548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5aa932-bb85-466a-bcff-5c27a0879aae None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:44.026814 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf66983-0240-454e-a01a-e560ac9b5cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:44.027542 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf66983-0240-454e-a01a-e560ac9b5cc2 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:44.027823 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf66983-0240-454e-a01a-e560ac9b5cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:44.028100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf66983-0240-454e-a01a-e560ac9b5cc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:44.042276 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf66983-0240-454e-a01a-e560ac9b5cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:44.043787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf66983-0240-454e-a01a-e560ac9b5cc2 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:44.066138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-caf66983-0240-454e-a01a-e560ac9b5cc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:44.066138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:44.066138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:44.066138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:44.066138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:44.066138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:44.066138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:44.066138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:44.066138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:44.066138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:44.066138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:44.066138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:44.066138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:44.066138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:44.066138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:44.067083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:44.067083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:44.067083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:44.067083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:44.067083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:44.067083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:44.067083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:44.067083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:44.067083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:44.067083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:44.067083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:44.067083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:44.067083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:44.067083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:44.067083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:44.067083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:44.067083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:44.067960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:44.067960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:44.067960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:44.067960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:44.067960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 241/471] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:44.074365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf66983-0240-454e-a01a-e560ac9b5cc2 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:44.089525 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92bf59-b4a7-485d-8763-b64c042e54e6 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:44.134309 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d61a3-9006-46fe-91f4-c57daba0cc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:44.135628 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d61a3-9006-46fe-91f4-c57daba0cc6c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:44.136303 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d61a3-9006-46fe-91f4-c57daba0cc6c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:44.137084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d61a3-9006-46fe-91f4-c57daba0cc6c None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:44.138303 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d61a3-9006-46fe-91f4-c57daba0cc6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:44.138942 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d61a3-9006-46fe-91f4-c57daba0cc6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:44.141181 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d61a3-9006-46fe-91f4-c57daba0cc6c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:44.156700 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 231/472] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:44.162563 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d61a3-9006-46fe-91f4-c57daba0cc6c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:44.187443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf66983-0240-454e-a01a-e560ac9b5cc2 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:44.254201 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdda106-f5ac-49dc-a80f-4897b6a559c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:44.254863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdda106-f5ac-49dc-a80f-4897b6a559c8 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:44.255143 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdda106-f5ac-49dc-a80f-4897b6a559c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:44.255415 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdda106-f5ac-49dc-a80f-4897b6a559c8 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:44.256135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdda106-f5ac-49dc-a80f-4897b6a559c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:44.256740 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdda106-f5ac-49dc-a80f-4897b6a559c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:44.258100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdda106-f5ac-49dc-a80f-4897b6a559c8 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:44.274095 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 242/473] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:44.275411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186de55-b431-44c5-b9ef-54205be97e53 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:44.275698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186de55-b431-44c5-b9ef-54205be97e53 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:44.275980 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186de55-b431-44c5-b9ef-54205be97e53 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:44.282134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 243/474] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:44.282816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186de55-b431-44c5-b9ef-54205be97e53 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:44.315432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d61a3-9006-46fe-91f4-c57daba0cc6c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:44.349788 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844326d-f50b-4cbb-be41-b079319baaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:44.351025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844326d-f50b-4cbb-be41-b079319baaaf None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:44.351304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844326d-f50b-4cbb-be41-b079319baaaf None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:44.351615 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844326d-f50b-4cbb-be41-b079319baaaf None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:44.352350 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844326d-f50b-4cbb-be41-b079319baaaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:44.354457 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844326d-f50b-4cbb-be41-b079319baaaf None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:44.385393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 232/475] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:46:44 2022] POST /identity/v3/users => generated 248 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:46:44.387675 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dc627-40dc-42d9-8d80-7fdd94fa158a None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:44.388424 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dc627-40dc-42d9-8d80-7fdd94fa158a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:44.389279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dc627-40dc-42d9-8d80-7fdd94fa158a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:44.406571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186de55-b431-44c5-b9ef-54205be97e53 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:44.413226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-2c5dc627-40dc-42d9-8d80-7fdd94fa158a None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:44.414707 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-2c5dc627-40dc-42d9-8d80-7fdd94fa158a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:44.450529 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78f3eb-c0ff-4659-9a0d-3a3a30205e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:44.451224 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78f3eb-c0ff-4659-9a0d-3a3a30205e29 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:44.451507 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78f3eb-c0ff-4659-9a0d-3a3a30205e29 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:44.451785 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78f3eb-c0ff-4659-9a0d-3a3a30205e29 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:44.452744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78f3eb-c0ff-4659-9a0d-3a3a30205e29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:44.454980 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78f3eb-c0ff-4659-9a0d-3a3a30205e29 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:44.488702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 244/476] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:46:44 2022] POST /identity/v3/users => generated 249 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:46:44.514620 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 233/477] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:44.538196 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78f3eb-c0ff-4659-9a0d-3a3a30205e29 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:44.650725 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78f3eb-c0ff-4659-9a0d-3a3a30205e29 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:44.689923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882e9c5-27bd-4398-b0c7-240da00e3324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:44.690980 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882e9c5-27bd-4398-b0c7-240da00e3324 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:44.691460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882e9c5-27bd-4398-b0c7-240da00e3324 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:44.691924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882e9c5-27bd-4398-b0c7-240da00e3324 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:44.692928 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882e9c5-27bd-4398-b0c7-240da00e3324 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:44.694523 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882e9c5-27bd-4398-b0c7-240da00e3324 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:44.704661 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.sql.core [None req-e882e9c5-27bd-4398-b0c7-240da00e3324 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 13:46:44.704661 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 13:46:44.704661 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [parameters: {'id': 'dfdbcec2de884d50abcb7ef527ceaf36', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 13:46:44.704661 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79924) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 13:46:44.722487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-e882e9c5-27bd-4398-b0c7-240da00e3324 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 13:46:44.722487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:44.722487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 13:46:44.722487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 13:46:44.722487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 13:46:44.722487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 13:46:44.722487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 13:46:44.722487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application result = self._query(query) May 10 13:46:44.722487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 13:46:44.722487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application conn.query(q) May 10 13:46:44.722487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 13:46:44.722487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 13:46:44.722487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 13:46:44.722487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application result.read() May 10 13:46:44.722487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return ref.to_dict() May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 13:46:44.723479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application next(self.gen) May 10 13:46:44.724506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 13:46:44.724506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application yield resource May 10 13:46:44.724506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 13:46:44.724506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application next(self.gen) May 10 13:46:44.724506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 13:46:44.724506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self.session.rollback() May 10 13:46:44.724506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 13:46:44.724506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self.force_reraise() May 10 13:46:44.724506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 13:46:44.724506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise self.value May 10 13:46:44.724506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 13:46:44.724506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 13:46:44.724506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 13:46:44.724506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application session.commit() May 10 13:46:44.724506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 13:46:44.724506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 13:46:44.724506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 13:46:44.726065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._prepare_impl() May 10 13:46:44.726065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 13:46:44.726065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self.session.flush() May 10 13:46:44.726065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 13:46:44.726065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._flush(objects) May 10 13:46:44.726065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 13:46:44.726065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 13:46:44.726065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 13:46:44.726065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application compat.raise_( May 10 13:46:44.726065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 13:46:44.726065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception May 10 13:46:44.726065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 13:46:44.726065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application flush_context.execute() May 10 13:46:44.726065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 13:46:44.726065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rec.execute(self) May 10 13:46:44.726065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 13:46:44.726065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 13:46:44.728411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 13:46:44.728411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 13:46:44.728411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 13:46:44.728411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 13:46:44.728411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 13:46:44.728411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 13:46:44.728411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 13:46:44.728411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 13:46:44.728411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 13:46:44.728411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 13:46:44.728411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 13:46:44.728411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 13:46:44.728411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 13:46:44.728411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 13:46:44.728411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 13:46:44.728411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception May 10 13:46:44.730448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 13:46:44.730448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 13:46:44.730448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 13:46:44.730448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 13:46:44.730448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 13:46:44.730448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application result = self._query(query) May 10 13:46:44.730448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 13:46:44.730448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application conn.query(q) May 10 13:46:44.730448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 13:46:44.730448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 13:46:44.730448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 13:46:44.730448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application result.read() May 10 13:46:44.730448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 13:46:44.730448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 13:46:44.730448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 13:46:44.730448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 13:46:44.732466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 13:46:44.732466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 13:46:44.732466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 13:46:44.732466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 13:46:44.732466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 13:46:44.732466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 13:46:44.732466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [parameters: {'id': 'dfdbcec2de884d50abcb7ef527ceaf36', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 13:46:44.732466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 13:46:44.732466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:44.732466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:46:44.732466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:44.732466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:44.732466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:44.732466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:44.732466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:44.732466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:44.738932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:44.738932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:44.738932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:44.738932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:44.738932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:44.738932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:44.738932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 10 13:46:44.738932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 10 13:46:44.738932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:44.738932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:44.738932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 10 13:46:44.738932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 10 13:46:44.738932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 13:46:44.738932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 13:46:44.738932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 13:46:44.738932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:44.741062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 245/478] 10.222.0.49 () {60 vars in 1131 bytes} [Tue May 10 13:46:44 2022] POST /identity/v3/roles => generated 144 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:44.741211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dc627-40dc-42d9-8d80-7fdd94fa158a None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:44.838639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dc627-40dc-42d9-8d80-7fdd94fa158a None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:44.873085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123ce87-479c-4ea3-a76c-4cb3f23d6e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:44.873877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123ce87-479c-4ea3-a76c-4cb3f23d6e9c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:44.874149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123ce87-479c-4ea3-a76c-4cb3f23d6e9c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:44.874414 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123ce87-479c-4ea3-a76c-4cb3f23d6e9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:44.884785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123ce87-479c-4ea3-a76c-4cb3f23d6e9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:44.892899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-2123ce87-479c-4ea3-a76c-4cb3f23d6e9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:44.892899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:44.892899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:44.892899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:44.892899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:44.892899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:44.892899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:44.892899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:44.892899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:44.892899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:44.892899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:44.892899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:44.892899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:44.892899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:44.892899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:44.892899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:44.893858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:44.893858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:44.893858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:44.893858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:44.893858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:44.893858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:44.893858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:44.893858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:44.893858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:44.893858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:44.893858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:44.893858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:44.893858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:44.893858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:44.893858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:44.893858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:44.894701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:44.894701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:44.894701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:44.894701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:44.894701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:44.894701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:44.894701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:44.894701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:44.894701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:44.894701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:44.894701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 13:46:44.894701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:44.895900 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 234/479] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:46:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:44.901008 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882e9c5-27bd-4398-b0c7-240da00e3324 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:45.003216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882e9c5-27bd-4398-b0c7-240da00e3324 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:45.037387 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75a21f-0ff1-4b9f-b7e5-85984338825b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:45.038076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75a21f-0ff1-4b9f-b7e5-85984338825b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:45.038352 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75a21f-0ff1-4b9f-b7e5-85984338825b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:45.038618 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75a21f-0ff1-4b9f-b7e5-85984338825b None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:45.039352 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75a21f-0ff1-4b9f-b7e5-85984338825b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:45.039651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75a21f-0ff1-4b9f-b7e5-85984338825b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:45.041018 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75a21f-0ff1-4b9f-b7e5-85984338825b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:45.056330 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 246/480] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:46.515255 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a10f9-be7f-41f6-bd2d-9fbeca06d7b8 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.516269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a10f9-be7f-41f6-bd2d-9fbeca06d7b8 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.516269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a10f9-be7f-41f6-bd2d-9fbeca06d7b8 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.517492 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 235/481] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:46.523397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06929de-d6f5-4734-9ab2-66ee4c2499cb None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.524120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06929de-d6f5-4734-9ab2-66ee4c2499cb None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.524120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06929de-d6f5-4734-9ab2-66ee4c2499cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.540887 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-c06929de-d6f5-4734-9ab2-66ee4c2499cb None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:46.542052 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c06929de-d6f5-4734-9ab2-66ee4c2499cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:46.612286 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 247/482] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:46.631979 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a10f9-be7f-41f6-bd2d-9fbeca06d7b8 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:46.741799 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a10f9-be7f-41f6-bd2d-9fbeca06d7b8 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:46.769075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf2363-f2b4-4e29-81bf-fa9d14121799 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.769519 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf2363-f2b4-4e29-81bf-fa9d14121799 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.770006 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf2363-f2b4-4e29-81bf-fa9d14121799 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.774913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989077a-5e0e-4729-8c96-6022739435d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:46.775697 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989077a-5e0e-4729-8c96-6022739435d6 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.775977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989077a-5e0e-4729-8c96-6022739435d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.776278 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989077a-5e0e-4729-8c96-6022739435d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.781261 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 248/483] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:46 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:46.787252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989077a-5e0e-4729-8c96-6022739435d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:46.789915 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cb5ff-5870-4693-a0b2-554e23e76ec2 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.790404 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cb5ff-5870-4693-a0b2-554e23e76ec2 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.790891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cb5ff-5870-4693-a0b2-554e23e76ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.795280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-f989077a-5e0e-4729-8c96-6022739435d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:46.795280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:46.795280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:46.795280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:46.795280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:46.795280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:46.795280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:46.795280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:46.795280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:46.795280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:46.795280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:46.795280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:46.795280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:46.795280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:46.795280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:46.795280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:46.798690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:46.798690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:46.798690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:46.798690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:46.798690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:46.798690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:46.798690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:46.798690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:46.798690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:46.798690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:46.798690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:46.798690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:46.798690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:46.798690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:46.798690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:46.798690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:46.801806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:46.801806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:46.801806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:46.801806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:46.801806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:46.801806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:46.801806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:46.801806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:46.801806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:46.801806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:46.801806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:46.801806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:46.801806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 236/484] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:46:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:46.813255 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989077a-5e0e-4729-8c96-6022739435d6 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:46.845520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-3c7cb5ff-5870-4693-a0b2-554e23e76ec2 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:46.847939 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-3c7cb5ff-5870-4693-a0b2-554e23e76ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:46.901790 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989077a-5e0e-4729-8c96-6022739435d6 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:46.938316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4aa32-13a9-42a2-9148-0ab127a3dd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:46.938975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4aa32-13a9-42a2-9148-0ab127a3dd4f None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:46.939254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4aa32-13a9-42a2-9148-0ab127a3dd4f None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:46.939522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4aa32-13a9-42a2-9148-0ab127a3dd4f None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:46.940291 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4aa32-13a9-42a2-9148-0ab127a3dd4f None admin] RBAC: Adding query filter params (name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:46.940596 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4aa32-13a9-42a2-9148-0ab127a3dd4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:46.941978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4aa32-13a9-42a2-9148-0ab127a3dd4f None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:46.961234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 237/485] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:46:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:46.967002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4aa32-13a9-42a2-9148-0ab127a3dd4f None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:46.980931 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 249/486] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:47.045049 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cb5ff-5870-4693-a0b2-554e23e76ec2 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.095173 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4aa32-13a9-42a2-9148-0ab127a3dd4f None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.130670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3a589-8f80-4603-9702-5189d9b252e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.131498 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3a589-8f80-4603-9702-5189d9b252e0 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.131777 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3a589-8f80-4603-9702-5189d9b252e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.132049 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3a589-8f80-4603-9702-5189d9b252e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.148212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3a589-8f80-4603-9702-5189d9b252e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:47.148212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3a589-8f80-4603-9702-5189d9b252e0 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:47.161912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-a1a3a589-8f80-4603-9702-5189d9b252e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:47.161912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:47.161912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:47.161912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:47.161912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:47.161912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:47.161912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:47.161912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:47.161912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:47.161912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:47.161912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:47.161912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:47.161912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:47.161912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:47.161912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:47.164256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:47.164256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:47.164256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:47.164256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:47.164256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:47.164256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:47.164256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:47.164256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:47.164256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:47.164256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:47.164256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:47.164256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:47.164256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:47.164256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:47.164256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:47.164256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:47.164256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:47.166004 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:47.166004 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:47.166004 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:47.166004 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:47.168218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 238/487] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:47.169447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3a589-8f80-4603-9702-5189d9b252e0 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.268024 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3a589-8f80-4603-9702-5189d9b252e0 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.304919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f3e4c-ab24-4962-aaa3-a0b75ea2b4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.305753 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f3e4c-ab24-4962-aaa3-a0b75ea2b4ba None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.306031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f3e4c-ab24-4962-aaa3-a0b75ea2b4ba None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.306306 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f3e4c-ab24-4962-aaa3-a0b75ea2b4ba None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.307189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f3e4c-ab24-4962-aaa3-a0b75ea2b4ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:47.307802 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f3e4c-ab24-4962-aaa3-a0b75ea2b4ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:47.309493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f3e4c-ab24-4962-aaa3-a0b75ea2b4ba None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:47.310243 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cb5ff-5870-4693-a0b2-554e23e76ec2 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.328287 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 239/488] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:47.329658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96132878-9476-49d1-b92b-930aee3a2f1a None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.329945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96132878-9476-49d1-b92b-930aee3a2f1a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.330219 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96132878-9476-49d1-b92b-930aee3a2f1a None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.331642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 240/489] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:47.333058 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96132878-9476-49d1-b92b-930aee3a2f1a None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.355773 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24175628-8d07-45eb-a7ae-f6cac518d0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.356612 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24175628-8d07-45eb-a7ae-f6cac518d0bf None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.356891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24175628-8d07-45eb-a7ae-f6cac518d0bf None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.357240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24175628-8d07-45eb-a7ae-f6cac518d0bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.367686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24175628-8d07-45eb-a7ae-f6cac518d0bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:47.376069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-24175628-8d07-45eb-a7ae-f6cac518d0bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:47.376069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:47.376069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:47.376069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:47.376069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:47.376069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:47.376069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:47.376069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:47.376069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:47.376069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:47.376069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:47.376069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:47.376069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:47.376069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:47.376069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:47.376069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:47.377021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:47.377021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:47.377021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:47.377021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:47.377021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:47.377021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:47.377021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:47.377021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:47.377021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:47.377021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:47.377021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:47.377021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:47.377021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:47.377021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:47.377021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:47.377021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:47.378272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:47.378272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:47.378272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:47.378272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:47.378272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:47.378272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:47.378272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:47.378272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:47.378272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:47.378272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:47.378272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:47.378272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:47.378272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 250/490] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:47.379239 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2068c62-3e65-4e9c-ab57-e5af65485ce3 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.379239 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2068c62-3e65-4e9c-ab57-e5af65485ce3 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.379360 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2068c62-3e65-4e9c-ab57-e5af65485ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.397811 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f2068c62-3e65-4e9c-ab57-e5af65485ce3 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:47.399040 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f2068c62-3e65-4e9c-ab57-e5af65485ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:47.480551 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 251/491] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:47.480551 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2068c62-3e65-4e9c-ab57-e5af65485ce3 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.490947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96132878-9476-49d1-b92b-930aee3a2f1a None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.532449 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ab9e1-6645-4d09-89d8-ae05bf413f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.533406 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ab9e1-6645-4d09-89d8-ae05bf413f49 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.533786 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ab9e1-6645-4d09-89d8-ae05bf413f49 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.534159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ab9e1-6645-4d09-89d8-ae05bf413f49 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.543301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ab9e1-6645-4d09-89d8-ae05bf413f49 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:47.545030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ab9e1-6645-4d09-89d8-ae05bf413f49 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:47.565447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-1c5ab9e1-6645-4d09-89d8-ae05bf413f49 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:46:47.565447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:47.565447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:47.565447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:47.565447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:47.565447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:47.565447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:47.565447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:47.565447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:47.565447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:47.565447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:47.565447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:47.565447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:46:47.565447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:46:47.565447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:46:47.565447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:47.566423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:47.567352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:47.567352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:47.567352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:46:47.567352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:46:47.567352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:46:47.567352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:46:47.567352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:46:47.567352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:46:47.567352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:46:47.567352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:47.567352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 241/492] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:47.572880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ab9e1-6645-4d09-89d8-ae05bf413f49 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.598302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2068c62-3e65-4e9c-ab57-e5af65485ce3 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.633693 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77a190-c85e-46a1-ac3f-3a7f70cb7a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.634364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77a190-c85e-46a1-ac3f-3a7f70cb7a68 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.634644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77a190-c85e-46a1-ac3f-3a7f70cb7a68 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.634920 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77a190-c85e-46a1-ac3f-3a7f70cb7a68 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.635695 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77a190-c85e-46a1-ac3f-3a7f70cb7a68 None admin] RBAC: Adding query filter params (name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:47.635962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77a190-c85e-46a1-ac3f-3a7f70cb7a68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:47.637346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77a190-c85e-46a1-ac3f-3a7f70cb7a68 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:47.645720 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 252/493] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:47.646483 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77a190-c85e-46a1-ac3f-3a7f70cb7a68 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.701498 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ab9e1-6645-4d09-89d8-ae05bf413f49 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.751272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5f9ed-7ffe-4f15-bfbd-eb27f102a952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.752062 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5f9ed-7ffe-4f15-bfbd-eb27f102a952 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.752367 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5f9ed-7ffe-4f15-bfbd-eb27f102a952 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.752637 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5f9ed-7ffe-4f15-bfbd-eb27f102a952 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.755159 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77a190-c85e-46a1-ac3f-3a7f70cb7a68 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.768919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5f9ed-7ffe-4f15-bfbd-eb27f102a952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:47.779576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-03f5f9ed-7ffe-4f15-bfbd-eb27f102a952 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:47.779576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:47.779576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:47.779576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:47.779576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:47.779576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:47.779576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:47.779576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:47.779576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:47.779576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:47.779576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:47.779576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:47.779576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:47.779576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:47.779576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:47.779576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:47.780944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:47.780944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:47.780944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:47.780944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:47.780944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:47.780944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:47.780944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:47.780944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:47.780944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:47.780944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:47.780944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:47.780944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:47.780944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:47.780944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:47.780944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:47.780944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:47.781914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:47.781914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:47.781914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:47.781914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:47.781914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:47.781914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:47.781914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:47.781914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:47.781914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:47.781914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:47.781914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:47.781914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:47.789211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 242/494] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:47.789211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5f9ed-7ffe-4f15-bfbd-eb27f102a952 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.797110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950afa-81fd-43bb-b69d-27be9f58145b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.797831 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950afa-81fd-43bb-b69d-27be9f58145b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.798116 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950afa-81fd-43bb-b69d-27be9f58145b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.798390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950afa-81fd-43bb-b69d-27be9f58145b None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.799231 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07950afa-81fd-43bb-b69d-27be9f58145b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:47.799536 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07950afa-81fd-43bb-b69d-27be9f58145b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:47.800972 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07950afa-81fd-43bb-b69d-27be9f58145b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:47.838419 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 253/495] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:47.838977 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950afa-81fd-43bb-b69d-27be9f58145b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.898444 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5f9ed-7ffe-4f15-bfbd-eb27f102a952 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.932503 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bf9fb-7df0-42f8-b78e-0e2374f43ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.933639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bf9fb-7df0-42f8-b78e-0e2374f43ad9 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.934126 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bf9fb-7df0-42f8-b78e-0e2374f43ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.934603 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bf9fb-7df0-42f8-b78e-0e2374f43ad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.942100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950afa-81fd-43bb-b69d-27be9f58145b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:47.945963 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616bf9fb-7df0-42f8-b78e-0e2374f43ad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:47.947650 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616bf9fb-7df0-42f8-b78e-0e2374f43ad9 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:47.964511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-616bf9fb-7df0-42f8-b78e-0e2374f43ad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:47.964511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:47.964511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:47.964511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:47.964511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:47.964511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:47.964511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:47.964511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:47.964511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:47.964511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:47.964511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:47.964511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:47.964511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:47.964511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:47.964511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:47.965482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:47.965482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:47.965482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:47.965482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:47.965482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:47.965482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:47.965482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:47.965482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:47.965482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:47.965482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:47.965482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:47.965482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:47.965482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:47.965482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:47.965482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:47.965482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:47.965482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:47.966364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:47.966364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:47.966364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:47.966364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:47.969524 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 243/496] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:47.970601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bf9fb-7df0-42f8-b78e-0e2374f43ad9 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:47.977537 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154790b-347e-4f2c-a994-3634352f9e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:47.978207 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154790b-347e-4f2c-a994-3634352f9e16 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:47.978487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154790b-347e-4f2c-a994-3634352f9e16 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:47.978763 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154790b-347e-4f2c-a994-3634352f9e16 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:47.979511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154790b-347e-4f2c-a994-3634352f9e16 None admin] RBAC: Adding query filter params (name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:47.979814 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154790b-347e-4f2c-a994-3634352f9e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:47.981219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154790b-347e-4f2c-a994-3634352f9e16 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:47.989614 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 254/497] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:47.990527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154790b-347e-4f2c-a994-3634352f9e16 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:48.074869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bf9fb-7df0-42f8-b78e-0e2374f43ad9 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:48.095592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154790b-347e-4f2c-a994-3634352f9e16 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:48.110651 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0e787-703e-47ea-bcaf-c032f9d6a49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:48.111612 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0e787-703e-47ea-bcaf-c032f9d6a49d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:48.112130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0e787-703e-47ea-bcaf-c032f9d6a49d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:48.112629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0e787-703e-47ea-bcaf-c032f9d6a49d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.130798 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae40bd9-2ee2-433c-95e5-e4babf434815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:48.131579 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40bd9-2ee2-433c-95e5-e4babf434815 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:48.131865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40bd9-2ee2-433c-95e5-e4babf434815 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:48.132137 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40bd9-2ee2-433c-95e5-e4babf434815 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.132906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae40bd9-2ee2-433c-95e5-e4babf434815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:48.133208 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae40bd9-2ee2-433c-95e5-e4babf434815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:48.134624 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae40bd9-2ee2-433c-95e5-e4babf434815 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:48.146689 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 255/498] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:48.147497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae40bd9-2ee2-433c-95e5-e4babf434815 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:48.184937 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0e787-703e-47ea-bcaf-c032f9d6a49d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:48.186836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0e787-703e-47ea-bcaf-c032f9d6a49d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:48.247365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae40bd9-2ee2-433c-95e5-e4babf434815 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:48.281663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bf9ce-f6d4-484f-9549-f96f8048dbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:48.282509 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bf9ce-f6d4-484f-9549-f96f8048dbb0 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:48.282798 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bf9ce-f6d4-484f-9549-f96f8048dbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:48.283066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bf9ce-f6d4-484f-9549-f96f8048dbb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.288114 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 244/499] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:48.289246 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0e787-703e-47ea-bcaf-c032f9d6a49d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:48.298459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bf9ce-f6d4-484f-9549-f96f8048dbb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:48.299988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bf9ce-f6d4-484f-9549-f96f8048dbb0 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:48.320047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-814bf9ce-f6d4-484f-9549-f96f8048dbb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:48.320047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:48.320047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:48.320047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:48.320047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:48.320047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:48.320047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:48.320047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:48.320047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:48.320047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:48.320047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:48.320047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:48.320047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:48.320047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:48.320047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:48.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:48.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:48.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:48.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:48.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:48.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:48.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:48.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:48.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:48.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:48.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:48.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:48.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:48.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:48.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:48.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:48.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:48.323075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:48.323075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:48.323075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:48.323075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:48.323075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 256/500] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:48.323075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bf9ce-f6d4-484f-9549-f96f8048dbb0 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:48.394954 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0e787-703e-47ea-bcaf-c032f9d6a49d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:48.428630 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dd535-8437-4368-9ddb-78b22c732434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:48.429422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dd535-8437-4368-9ddb-78b22c732434 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:48.429644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bf9ce-f6d4-484f-9549-f96f8048dbb0 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:48.429743 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dd535-8437-4368-9ddb-78b22c732434 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:48.429951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dd535-8437-4368-9ddb-78b22c732434 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.436897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dd535-8437-4368-9ddb-78b22c732434 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:48.438329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dd535-8437-4368-9ddb-78b22c732434 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:48.452428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-191dd535-8437-4368-9ddb-78b22c732434 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 13:46:48.452428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:48.452428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:48.452428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:48.452428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:48.452428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:48.452428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:48.452428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:48.452428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:48.452428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:48.452428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:48.452428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:48.452428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:46:48.452428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:46:48.452428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:46:48.452428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:48.453361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:48.454262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:48.454262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:48.454262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:46:48.454262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:46:48.454262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:46:48.454262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:46:48.454262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:46:48.454262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:46:48.454262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 13:46:48.454262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:48.454262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 245/501] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:48.454848 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dd535-8437-4368-9ddb-78b22c732434 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:48.469313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b5acb-cc17-467e-8e65-4358d4a5a440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:48.470114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b5acb-cc17-467e-8e65-4358d4a5a440 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:48.470396 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b5acb-cc17-467e-8e65-4358d4a5a440 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:48.470679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b5acb-cc17-467e-8e65-4358d4a5a440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.481503 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b5acb-cc17-467e-8e65-4358d4a5a440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:48.482957 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b5acb-cc17-467e-8e65-4358d4a5a440 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:48.499944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-4d0b5acb-cc17-467e-8e65-4358d4a5a440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:48.499944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:48.499944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:48.499944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:48.499944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:48.499944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:48.499944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:48.499944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:48.499944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:48.499944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:48.499944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:48.499944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:48.499944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:48.499944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:48.499944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:48.501103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:48.501103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:48.501103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:48.501103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:48.501103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:48.501103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:48.501103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:48.501103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:48.501103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:48.501103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:48.501103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:48.501103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:48.501103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:48.501103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:48.501103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:48.501103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:48.501103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:48.501973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:48.501973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:48.501973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:48.501973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:48.501973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 257/502] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:48.502675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643947e-b8c5-4a9a-8493-bcdf781a8a41 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:48.502963 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643947e-b8c5-4a9a-8493-bcdf781a8a41 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:48.503241 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643947e-b8c5-4a9a-8493-bcdf781a8a41 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.505048 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 258/503] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:48.505203 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643947e-b8c5-4a9a-8493-bcdf781a8a41 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:48.559780 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dd535-8437-4368-9ddb-78b22c732434 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:48.592152 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976324d2-92f0-4994-80e8-b96f97946616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:48.592835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976324d2-92f0-4994-80e8-b96f97946616 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:48.593109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976324d2-92f0-4994-80e8-b96f97946616 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:48.593376 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976324d2-92f0-4994-80e8-b96f97946616 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.594082 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976324d2-92f0-4994-80e8-b96f97946616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:48.594380 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976324d2-92f0-4994-80e8-b96f97946616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:48.595733 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976324d2-92f0-4994-80e8-b96f97946616 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:48.611475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 246/504] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:48.611475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976324d2-92f0-4994-80e8-b96f97946616 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:48.613383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643947e-b8c5-4a9a-8493-bcdf781a8a41 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:48.646632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa635ba-adde-48dc-b5a7-5ffe5ce9160f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:48.647782 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa635ba-adde-48dc-b5a7-5ffe5ce9160f None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:48.648055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa635ba-adde-48dc-b5a7-5ffe5ce9160f None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:48.648357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa635ba-adde-48dc-b5a7-5ffe5ce9160f None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.649210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa635ba-adde-48dc-b5a7-5ffe5ce9160f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:48.649514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa635ba-adde-48dc-b5a7-5ffe5ce9160f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:48.650968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa635ba-adde-48dc-b5a7-5ffe5ce9160f None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:48.675285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 259/505] 10.222.0.49 () {56 vars in 1137 bytes} [Tue May 10 13:46:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:48.675285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3be0c8-4cd8-4d0a-b1a5-2528fc72573c None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:48.675285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3be0c8-4cd8-4d0a-b1a5-2528fc72573c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:48.675285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3be0c8-4cd8-4d0a-b1a5-2528fc72573c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.689068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-cc3be0c8-4cd8-4d0a-b1a5-2528fc72573c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:48.690237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cc3be0c8-4cd8-4d0a-b1a5-2528fc72573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:48.716486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976324d2-92f0-4994-80e8-b96f97946616 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:48.749590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3043a8-915f-4748-bf4c-24e60493acf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:48.750241 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3043a8-915f-4748-bf4c-24e60493acf6 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:48.750516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3043a8-915f-4748-bf4c-24e60493acf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:48.750792 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3043a8-915f-4748-bf4c-24e60493acf6 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.751497 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3043a8-915f-4748-bf4c-24e60493acf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:48.751795 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3043a8-915f-4748-bf4c-24e60493acf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:48.753173 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3043a8-915f-4748-bf4c-24e60493acf6 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:48.757908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 260/506] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:48.759005 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3be0c8-4cd8-4d0a-b1a5-2528fc72573c None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:48.771785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 247/507] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:48.774130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3043a8-915f-4748-bf4c-24e60493acf6 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:48.861427 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3be0c8-4cd8-4d0a-b1a5-2528fc72573c None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:48.876040 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3043a8-915f-4748-bf4c-24e60493acf6 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:48.893983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01996d0f-55eb-4a75-ab3e-24d67e82ecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:48.894776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01996d0f-55eb-4a75-ab3e-24d67e82ecc8 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:48.895056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01996d0f-55eb-4a75-ab3e-24d67e82ecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:48.895328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01996d0f-55eb-4a75-ab3e-24d67e82ecc8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.902830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01996d0f-55eb-4a75-ab3e-24d67e82ecc8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:48.904219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01996d0f-55eb-4a75-ab3e-24d67e82ecc8 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:48.909470 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22904aa1-11e4-415d-b196-baed303e07c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:48.910110 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22904aa1-11e4-415d-b196-baed303e07c3 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:48.910389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22904aa1-11e4-415d-b196-baed303e07c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:48.910663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22904aa1-11e4-415d-b196-baed303e07c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:48.919893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-01996d0f-55eb-4a75-ab3e-24d67e82ecc8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 13:46:48.919893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:48.919893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:48.919893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:48.919893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:48.919893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:48.919893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:48.919893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:48.919893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:48.919893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:48.919893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:48.919893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:48.919893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:46:48.919893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:46:48.919893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:46:48.919893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:48.920860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:48.921786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:48.921786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:48.921786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:46:48.921786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:46:48.921786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:46:48.921786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:46:48.921786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:46:48.921786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:46:48.921786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 13:46:48.921786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:48.921786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 261/508] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:46:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:48.922373 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01996d0f-55eb-4a75-ab3e-24d67e82ecc8 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:48.977380 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22904aa1-11e4-415d-b196-baed303e07c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:48.978902 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22904aa1-11e4-415d-b196-baed303e07c3 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:49.016978 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01996d0f-55eb-4a75-ab3e-24d67e82ecc8 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:49.048836 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae22e72-4ff4-4922-8054-3b59ee41afb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:49.049641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae22e72-4ff4-4922-8054-3b59ee41afb8 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:49.049933 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae22e72-4ff4-4922-8054-3b59ee41afb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:49.050209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae22e72-4ff4-4922-8054-3b59ee41afb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:49.056747 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae22e72-4ff4-4922-8054-3b59ee41afb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:49.058167 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae22e72-4ff4-4922-8054-3b59ee41afb8 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:49.072497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-fae22e72-4ff4-4922-8054-3b59ee41afb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:49.072497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:49.072497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:49.072497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:49.072497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:49.072497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:49.072497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:49.072497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:49.072497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:49.072497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:49.072497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:49.072497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:49.072497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:46:49.072497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:46:49.072497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:46:49.073364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:46:49.073364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:49.073364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:49.073364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:49.073364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:49.073364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:49.073364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:49.073364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:49.073364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:49.073364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:49.073364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:49.073364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:49.073364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:49.073364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:49.073364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:49.073364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:49.073364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:49.074543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:46:49.074543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:46:49.074543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:46:49.074543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:46:49.074543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:46:49.074543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:46:49.074543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:49.074543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:49.074543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 262/509] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:49.075276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 248/510] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:49.075437 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd2aac-b0e8-4a40-8054-f4ed58b74ece None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:49.075715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd2aac-b0e8-4a40-8054-f4ed58b74ece None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:49.075986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd2aac-b0e8-4a40-8054-f4ed58b74ece None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:49.076598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae22e72-4ff4-4922-8054-3b59ee41afb8 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:49.077435 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 249/511] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:49.078986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd2aac-b0e8-4a40-8054-f4ed58b74ece None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:49.170457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae22e72-4ff4-4922-8054-3b59ee41afb8 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:49.175111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd2aac-b0e8-4a40-8054-f4ed58b74ece None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:49.202003 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70511f02-7bd4-4486-82a3-62ec2dfc221d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:49.202787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70511f02-7bd4-4486-82a3-62ec2dfc221d None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:49.203063 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70511f02-7bd4-4486-82a3-62ec2dfc221d None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:49.203339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70511f02-7bd4-4486-82a3-62ec2dfc221d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:49.206921 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb07e4-0f38-4e6d-8f90-7a934c393254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:49.207567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb07e4-0f38-4e6d-8f90-7a934c393254 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:49.207847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb07e4-0f38-4e6d-8f90-7a934c393254 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:49.208120 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb07e4-0f38-4e6d-8f90-7a934c393254 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:49.208972 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb07e4-0f38-4e6d-8f90-7a934c393254 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:49.209904 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb07e4-0f38-4e6d-8f90-7a934c393254 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:49.211332 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb07e4-0f38-4e6d-8f90-7a934c393254 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:49.213628 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70511f02-7bd4-4486-82a3-62ec2dfc221d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:49.221275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-70511f02-7bd4-4486-82a3-62ec2dfc221d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:49.221275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:49.221275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:49.221275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:49.221275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:49.221275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:49.221275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:49.221275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:49.221275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:49.221275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:49.221275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:49.221275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:49.221275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:49.221275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:49.221275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:49.221275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:49.222163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:49.222163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:49.222163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:49.222163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:49.222163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:49.222163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:49.222163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:49.222163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:49.222163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:49.222163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:49.222163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:49.222163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:49.222163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:49.222163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:49.222163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:49.222163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:49.222994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:49.222994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:49.222994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:49.222994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:49.222994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:49.222994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:49.222994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:49.222994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:49.222994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:49.222994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:49.222994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:49.222994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:49.222994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 263/512] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:46:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:49.223664 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70511f02-7bd4-4486-82a3-62ec2dfc221d None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:49.247082 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 250/513] 10.222.0.49 () {56 vars in 1139 bytes} [Tue May 10 13:46:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:49.247897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb07e4-0f38-4e6d-8f90-7a934c393254 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:49.321232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70511f02-7bd4-4486-82a3-62ec2dfc221d None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:49.339387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb07e4-0f38-4e6d-8f90-7a934c393254 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:49.352877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe1732-6fb6-4f33-9d5d-775676ba911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:49.353658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1732-6fb6-4f33-9d5d-775676ba911d None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:49.353937 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1732-6fb6-4f33-9d5d-775676ba911d None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:49.354209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1732-6fb6-4f33-9d5d-775676ba911d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:49.364253 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe1732-6fb6-4f33-9d5d-775676ba911d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:49.366194 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe1732-6fb6-4f33-9d5d-775676ba911d None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:49.371794 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb049a-4214-4582-b81b-8ee8da8b5909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:49.372466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb049a-4214-4582-b81b-8ee8da8b5909 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:49.372743 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb049a-4214-4582-b81b-8ee8da8b5909 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:49.373013 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb049a-4214-4582-b81b-8ee8da8b5909 None admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:49.373786 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb049a-4214-4582-b81b-8ee8da8b5909 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:49.374088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb049a-4214-4582-b81b-8ee8da8b5909 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:49.375492 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb049a-4214-4582-b81b-8ee8da8b5909 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:49.383658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-bafe1732-6fb6-4f33-9d5d-775676ba911d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:49.383658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:49.383658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:49.383658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:49.383658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:49.383658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:49.383658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:49.383658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:49.383658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:49.383658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:49.383658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:49.383658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:49.383658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:49.383658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:49.383658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:49.384653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:49.384653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:49.384653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:49.384653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:49.384653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:49.384653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:49.384653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:49.384653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:49.384653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:49.384653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:49.384653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:49.384653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:49.384653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:49.384653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:49.384653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:49.384653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:49.384653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:49.385819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:49.385819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:49.385819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:49.385819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:49.385819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 264/514] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:49.385819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0c3f-1654-46d4-9354-9b47edc45ad5 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:49.386145 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0c3f-1654-46d4-9354-9b47edc45ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:49.386305 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0c3f-1654-46d4-9354-9b47edc45ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:49.397591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 251/515] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:46:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:49.398437 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb049a-4214-4582-b81b-8ee8da8b5909 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:49.405877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-eb6b0c3f-1654-46d4-9354-9b47edc45ad5 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:49.407062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-eb6b0c3f-1654-46d4-9354-9b47edc45ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:49.469585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 265/516] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:49.470579 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0c3f-1654-46d4-9354-9b47edc45ad5 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:49.494489 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb049a-4214-4582-b81b-8ee8da8b5909 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:49.525884 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68de35e-08e3-45c1-becd-eee033524e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:49.526538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68de35e-08e3-45c1-becd-eee033524e82 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:49.526819 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68de35e-08e3-45c1-becd-eee033524e82 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:49.527097 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68de35e-08e3-45c1-becd-eee033524e82 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:49.527833 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68de35e-08e3-45c1-becd-eee033524e82 None admin] RBAC: Adding query filter params (name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:49.528134 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68de35e-08e3-45c1-becd-eee033524e82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:49.529526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68de35e-08e3-45c1-becd-eee033524e82 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:49.537898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 252/517] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:46:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:49.538609 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68de35e-08e3-45c1-becd-eee033524e82 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:49.569752 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0c3f-1654-46d4-9354-9b47edc45ad5 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:49.600765 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75925c-6585-4516-af84-b4b98d0ced1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:49.601392 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75925c-6585-4516-af84-b4b98d0ced1e None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:49.601708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75925c-6585-4516-af84-b4b98d0ced1e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:49.601969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75925c-6585-4516-af84-b4b98d0ced1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:49.631672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68de35e-08e3-45c1-becd-eee033524e82 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:49.663010 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276316b-89b0-4085-8c44-b3727c532b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:49.663648 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276316b-89b0-4085-8c44-b3727c532b69 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:49.663923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276316b-89b0-4085-8c44-b3727c532b69 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:49.664060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75925c-6585-4516-af84-b4b98d0ced1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:49.664476 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276316b-89b0-4085-8c44-b3727c532b69 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:49.664962 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276316b-89b0-4085-8c44-b3727c532b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:49.665208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276316b-89b0-4085-8c44-b3727c532b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:49.665521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75925c-6585-4516-af84-b4b98d0ced1e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:49.666548 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276316b-89b0-4085-8c44-b3727c532b69 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:49.677731 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 253/518] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:49.678472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276316b-89b0-4085-8c44-b3727c532b69 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:49.763683 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 266/519] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:49.764458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75925c-6585-4516-af84-b4b98d0ced1e None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:49.776276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276316b-89b0-4085-8c44-b3727c532b69 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:49.809459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f38837-83bb-460b-920f-3ccba99e451f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:49.810090 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f38837-83bb-460b-920f-3ccba99e451f None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:49.810369 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f38837-83bb-460b-920f-3ccba99e451f None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:49.810642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f38837-83bb-460b-920f-3ccba99e451f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:49.811457 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f38837-83bb-460b-920f-3ccba99e451f None admin] RBAC: Adding query filter params (role.id=10053e4259ae4b3bbbdbefa96320c937, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=975f10f781b94bdaa8edee39a2b1bba4) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:49.811764 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f38837-83bb-460b-920f-3ccba99e451f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:49.813222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f38837-83bb-460b-920f-3ccba99e451f None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:49.818585 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 254/520] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:49 2022] GET /identity/v3/role_assignments?user.id=975f10f781b94bdaa8edee39a2b1bba4&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=10053e4259ae4b3bbbdbefa96320c937 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:49.819284 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f38837-83bb-460b-920f-3ccba99e451f None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:49.863526 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75925c-6585-4516-af84-b4b98d0ced1e None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:49.900107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd42cbe-16d2-43e7-9032-7fe76aabba7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:49.901038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd42cbe-16d2-43e7-9032-7fe76aabba7f None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:49.901391 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd42cbe-16d2-43e7-9032-7fe76aabba7f None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:49.901731 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd42cbe-16d2-43e7-9032-7fe76aabba7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:49.912758 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd42cbe-16d2-43e7-9032-7fe76aabba7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:49.914250 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd42cbe-16d2-43e7-9032-7fe76aabba7f None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:49.925165 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f38837-83bb-460b-920f-3ccba99e451f None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:49.932935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-dcd42cbe-16d2-43e7-9032-7fe76aabba7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:49.932935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:49.932935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:49.932935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:49.932935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:49.932935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:49.932935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:49.932935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:49.932935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:49.932935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:49.932935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:49.932935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:49.932935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:49.932935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:49.932935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:49.934010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:49.934010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:49.934010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:49.934010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:49.934010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:49.934010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:49.934010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:49.934010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:49.934010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:49.934010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:49.934010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:49.934010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:49.934010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:49.934010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:49.934010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:49.934010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:49.934010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:49.934924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:49.934924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:49.934924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:49.934924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:49.934924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 267/521] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:49.935450 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd42cbe-16d2-43e7-9032-7fe76aabba7f None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:49.968220 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509ceb7-51c2-4ac7-84b7-668a75ced7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:49.969130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ceb7-51c2-4ac7-84b7-668a75ced7f9 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:49.969480 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ceb7-51c2-4ac7-84b7-668a75ced7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:49.969827 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ceb7-51c2-4ac7-84b7-668a75ced7f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:49.980963 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509ceb7-51c2-4ac7-84b7-668a75ced7f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:49.982552 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509ceb7-51c2-4ac7-84b7-668a75ced7f9 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:50.000693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-d509ceb7-51c2-4ac7-84b7-668a75ced7f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:50.000693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:50.000693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:50.000693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:50.000693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:50.000693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:50.000693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:50.000693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:50.000693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:50.000693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:50.000693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:50.000693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:50.000693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:50.000693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:50.000693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:50.001773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:50.001773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:50.001773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:50.001773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:50.001773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:50.001773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:50.001773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:50.001773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:50.001773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:50.001773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:50.001773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:50.001773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:50.001773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:50.001773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:50.001773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:50.001773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:50.001773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:50.002911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:50.002911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:50.002911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:50.002911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:50.002911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 255/522] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:50.002911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509ceb7-51c2-4ac7-84b7-668a75ced7f9 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:50.040482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd42cbe-16d2-43e7-9032-7fe76aabba7f None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:50.073738 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675642f8-cba8-4b0e-993f-9e5cc636846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:50.074537 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675642f8-cba8-4b0e-993f-9e5cc636846b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:50.074815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675642f8-cba8-4b0e-993f-9e5cc636846b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:50.075084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675642f8-cba8-4b0e-993f-9e5cc636846b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:50.083046 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675642f8-cba8-4b0e-993f-9e5cc636846b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:50.084526 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675642f8-cba8-4b0e-993f-9e5cc636846b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:50.098072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-675642f8-cba8-4b0e-993f-9e5cc636846b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:50.098072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:50.098072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:50.098072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:50.098072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:50.098072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:50.098072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:50.098072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:50.098072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:50.098072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:50.098072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:50.098072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:50.098072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:46:50.098072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:46:50.098072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:46:50.099195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:46:50.099195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:50.099195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:50.099195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:50.099195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:50.099195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:50.099195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:50.099195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:50.099195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:50.099195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:50.099195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:50.099195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:50.099195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:50.099195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:50.099195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:50.099195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:50.099195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:50.100354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:46:50.100354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:46:50.100354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:46:50.100354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:46:50.100354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:46:50.100354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:46:50.100354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:50.100354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:50.100354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 268/523] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:50.101577 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675642f8-cba8-4b0e-993f-9e5cc636846b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:50.106530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509ceb7-51c2-4ac7-84b7-668a75ced7f9 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:50.142184 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee72f1-32c5-4d2f-a563-9aede1dcc7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:50.143123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee72f1-32c5-4d2f-a563-9aede1dcc7de None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:50.143534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee72f1-32c5-4d2f-a563-9aede1dcc7de None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:50.144063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee72f1-32c5-4d2f-a563-9aede1dcc7de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:50.155464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee72f1-32c5-4d2f-a563-9aede1dcc7de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:50.157362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee72f1-32c5-4d2f-a563-9aede1dcc7de None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:50.174185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-08ee72f1-32c5-4d2f-a563-9aede1dcc7de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:50.174185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:50.174185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:50.174185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:50.174185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:50.174185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:50.174185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:50.174185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:50.174185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:50.174185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:50.174185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:50.174185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:50.174185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:50.174185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:50.174185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:50.175267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:50.175267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:50.175267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:50.175267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:50.175267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:50.175267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:50.175267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:50.175267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:50.175267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:50.175267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:50.175267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:50.175267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:50.175267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:50.175267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:50.175267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:50.175267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:50.175267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:50.176399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:50.176399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:50.176399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:50.176399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:50.182045 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 256/524] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:50.182045 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee72f1-32c5-4d2f-a563-9aede1dcc7de None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:50.207778 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675642f8-cba8-4b0e-993f-9e5cc636846b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:50.240051 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2191c-96f0-4c40-a09e-82622942230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:50.241386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2191c-96f0-4c40-a09e-82622942230d None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:50.241738 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2191c-96f0-4c40-a09e-82622942230d None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:50.242080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2191c-96f0-4c40-a09e-82622942230d None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:50.242866 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2191c-96f0-4c40-a09e-82622942230d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:50.243238 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2191c-96f0-4c40-a09e-82622942230d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:50.244700 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2191c-96f0-4c40-a09e-82622942230d None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:50.260474 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 269/525] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:50.260474 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2191c-96f0-4c40-a09e-82622942230d None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:50.283527 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee72f1-32c5-4d2f-a563-9aede1dcc7de None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:50.317526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ea38c-5db5-4780-ae33-a71a6e9dbe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:50.318264 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ea38c-5db5-4780-ae33-a71a6e9dbe9a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:50.318675 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ea38c-5db5-4780-ae33-a71a6e9dbe9a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:50.319048 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ea38c-5db5-4780-ae33-a71a6e9dbe9a None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:50.319864 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ea38c-5db5-4780-ae33-a71a6e9dbe9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:50.320334 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ea38c-5db5-4780-ae33-a71a6e9dbe9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:50.321800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ea38c-5db5-4780-ae33-a71a6e9dbe9a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:50.334485 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 257/526] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:50.335354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ea38c-5db5-4780-ae33-a71a6e9dbe9a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:50.359013 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2191c-96f0-4c40-a09e-82622942230d None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:50.391797 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf074488-e598-448f-b06d-6d15567f8a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:50.392480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf074488-e598-448f-b06d-6d15567f8a9a None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:50.392753 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf074488-e598-448f-b06d-6d15567f8a9a None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:50.393018 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf074488-e598-448f-b06d-6d15567f8a9a None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:50.393799 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf074488-e598-448f-b06d-6d15567f8a9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:50.394103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf074488-e598-448f-b06d-6d15567f8a9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:50.395517 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf074488-e598-448f-b06d-6d15567f8a9a None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:50.414998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 270/527] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:46:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:50.415799 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf074488-e598-448f-b06d-6d15567f8a9a None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:50.444391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ea38c-5db5-4780-ae33-a71a6e9dbe9a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:50.477213 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b90086-467d-4e3e-8b64-4a0d7f2a503c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:50.477865 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b90086-467d-4e3e-8b64-4a0d7f2a503c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:50.478146 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b90086-467d-4e3e-8b64-4a0d7f2a503c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:50.478408 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b90086-467d-4e3e-8b64-4a0d7f2a503c None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:50.479115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b90086-467d-4e3e-8b64-4a0d7f2a503c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:50.479417 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b90086-467d-4e3e-8b64-4a0d7f2a503c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:50.480809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b90086-467d-4e3e-8b64-4a0d7f2a503c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:50.496243 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 258/528] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:50.496243 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b90086-467d-4e3e-8b64-4a0d7f2a503c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:50.517988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf074488-e598-448f-b06d-6d15567f8a9a None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:50.550791 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0967be8-3edf-4f35-b45d-a432d2574a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:50.551449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0967be8-3edf-4f35-b45d-a432d2574a6e None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:50.551722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0967be8-3edf-4f35-b45d-a432d2574a6e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:50.551989 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0967be8-3edf-4f35-b45d-a432d2574a6e None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:50.552709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0967be8-3edf-4f35-b45d-a432d2574a6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:50.554705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0967be8-3edf-4f35-b45d-a432d2574a6e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:50.580280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 271/529] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:46:50 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:46:50.580280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0967be8-3edf-4f35-b45d-a432d2574a6e None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:50.594444 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b90086-467d-4e3e-8b64-4a0d7f2a503c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:50.631092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ec34f-655a-42d8-81a1-8293c6ede32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:50.631905 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ec34f-655a-42d8-81a1-8293c6ede32e None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:50.632457 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ec34f-655a-42d8-81a1-8293c6ede32e None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:50.632555 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ec34f-655a-42d8-81a1-8293c6ede32e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:50.640986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ec34f-655a-42d8-81a1-8293c6ede32e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:50.642486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ec34f-655a-42d8-81a1-8293c6ede32e None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:50.658645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-f69ec34f-655a-42d8-81a1-8293c6ede32e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 13:46:50.658645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:50.658645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:50.658645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:50.658645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:50.658645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:50.658645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:50.658645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:50.658645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:50.658645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:50.658645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:50.658645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:50.658645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:46:50.658645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:46:50.658645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:46:50.658645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:50.659766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:50.660727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:50.660727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:50.660727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:46:50.660727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:46:50.660727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:46:50.660727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:46:50.660727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:46:50.660727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:46:50.660727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 13:46:50.660727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:50.660727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 259/530] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:50.661944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ec34f-655a-42d8-81a1-8293c6ede32e None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:50.687871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0967be8-3edf-4f35-b45d-a432d2574a6e None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:50.723450 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f01bb-bb7a-4532-8f81-0d5b3c218b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:50.724403 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f01bb-bb7a-4532-8f81-0d5b3c218b19 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:50.726960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f01bb-bb7a-4532-8f81-0d5b3c218b19 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:50.726960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f01bb-bb7a-4532-8f81-0d5b3c218b19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:50.727287 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f01bb-bb7a-4532-8f81-0d5b3c218b19 None admin] RBAC: Adding query filter params (role.id=10053e4259ae4b3bbbdbefa96320c937, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=2d674fd1d6ab43ab982b66bb2349b625) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:50.732223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f01bb-bb7a-4532-8f81-0d5b3c218b19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:50.732223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f01bb-bb7a-4532-8f81-0d5b3c218b19 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:50.737331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 272/531] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:50 2022] GET /identity/v3/role_assignments?user.id=2d674fd1d6ab43ab982b66bb2349b625&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=10053e4259ae4b3bbbdbefa96320c937 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:50.738197 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f01bb-bb7a-4532-8f81-0d5b3c218b19 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:50.796145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ec34f-655a-42d8-81a1-8293c6ede32e None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:50.839065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69170842-0729-4665-a193-44df644a916d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:50.840274 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69170842-0729-4665-a193-44df644a916d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:50.840992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69170842-0729-4665-a193-44df644a916d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:50.841475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69170842-0729-4665-a193-44df644a916d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:50.849352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69170842-0729-4665-a193-44df644a916d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:50.851861 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69170842-0729-4665-a193-44df644a916d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:50.864516 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f01bb-bb7a-4532-8f81-0d5b3c218b19 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:50.869409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-69170842-0729-4665-a193-44df644a916d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:50.869409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:50.869409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:50.869409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:50.869409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:50.869409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:50.869409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:50.869409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:50.869409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:50.869409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:50.869409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:50.869409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:50.869409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:46:50.869409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:46:50.869409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:46:50.870316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:46:50.870316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:50.870316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:50.870316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:50.870316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:50.870316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:50.870316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:50.870316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:50.870316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:50.870316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:50.870316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:50.870316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:50.870316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:50.870316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:50.870316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:50.870316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:50.870316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:50.871185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:46:50.871185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:46:50.871185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:46:50.871185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:46:50.871185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:46:50.871185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:46:50.871185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:50.871185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:50.873739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 260/532] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:50.879532 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69170842-0729-4665-a193-44df644a916d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:50.906383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346214dc-7a55-41f7-9f9f-c2adc092eb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:50.907443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346214dc-7a55-41f7-9f9f-c2adc092eb06 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:50.907918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346214dc-7a55-41f7-9f9f-c2adc092eb06 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:50.908443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346214dc-7a55-41f7-9f9f-c2adc092eb06 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:50.909512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346214dc-7a55-41f7-9f9f-c2adc092eb06 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:50.910034 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346214dc-7a55-41f7-9f9f-c2adc092eb06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:50.911830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346214dc-7a55-41f7-9f9f-c2adc092eb06 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:50.931953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 273/533] 10.222.0.49 () {56 vars in 1137 bytes} [Tue May 10 13:46:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:50.938016 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346214dc-7a55-41f7-9f9f-c2adc092eb06 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:51.010102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69170842-0729-4665-a193-44df644a916d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:51.059418 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346214dc-7a55-41f7-9f9f-c2adc092eb06 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:51.076919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6c3ef-bc41-4c38-ad04-c221291c509a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:51.077595 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6c3ef-bc41-4c38-ad04-c221291c509a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:51.077882 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6c3ef-bc41-4c38-ad04-c221291c509a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:51.078159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6c3ef-bc41-4c38-ad04-c221291c509a None admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:51.078958 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6c3ef-bc41-4c38-ad04-c221291c509a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:51.079267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6c3ef-bc41-4c38-ad04-c221291c509a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:51.080766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6c3ef-bc41-4c38-ad04-c221291c509a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:51.096605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a057a48-db90-4b3e-be69-99cc96974cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:51.097318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a057a48-db90-4b3e-be69-99cc96974cfc None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:51.097665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a057a48-db90-4b3e-be69-99cc96974cfc None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:51.098462 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a057a48-db90-4b3e-be69-99cc96974cfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:51.103561 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 261/534] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:46:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:51.109572 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6c3ef-bc41-4c38-ad04-c221291c509a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:51.201357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a057a48-db90-4b3e-be69-99cc96974cfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:51.204190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a057a48-db90-4b3e-be69-99cc96974cfc None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:51.287446 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6c3ef-bc41-4c38-ad04-c221291c509a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:51.324007 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5fbda-741a-4031-abe1-6acf47ebba9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:51.324710 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5fbda-741a-4031-abe1-6acf47ebba9d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:51.324996 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5fbda-741a-4031-abe1-6acf47ebba9d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:51.325272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5fbda-741a-4031-abe1-6acf47ebba9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:51.326105 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5fbda-741a-4031-abe1-6acf47ebba9d None admin] RBAC: Adding query filter params (role.id=10053e4259ae4b3bbbdbefa96320c937, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=930f350dad954c7783f479bbb25c1f46) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:51.326412 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5fbda-741a-4031-abe1-6acf47ebba9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:51.328159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5fbda-741a-4031-abe1-6acf47ebba9d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:51.335470 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 262/535] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:51 2022] GET /identity/v3/role_assignments?user.id=930f350dad954c7783f479bbb25c1f46&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=10053e4259ae4b3bbbdbefa96320c937 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:51.405487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 274/536] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 13:46:51.411354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5fbda-741a-4031-abe1-6acf47ebba9d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:51.563673 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5fbda-741a-4031-abe1-6acf47ebba9d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:51.597736 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b587b-791d-4a3f-ab3b-fa9c69af26f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:51.598768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b587b-791d-4a3f-ab3b-fa9c69af26f6 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:51.599187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b587b-791d-4a3f-ab3b-fa9c69af26f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:51.599652 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b587b-791d-4a3f-ab3b-fa9c69af26f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:51.610874 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b587b-791d-4a3f-ab3b-fa9c69af26f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:51.612558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b587b-791d-4a3f-ab3b-fa9c69af26f6 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:51.630128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-bd2b587b-791d-4a3f-ab3b-fa9c69af26f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:51.630128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:51.630128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:51.630128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:51.630128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:51.630128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:51.630128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:51.630128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:51.630128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:51.630128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:51.630128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:51.630128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:51.630128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:51.630128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:51.630128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:51.631769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:51.631769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:51.631769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:51.631769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:51.631769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:51.631769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:51.631769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:51.631769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:51.631769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:51.631769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:51.631769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:51.631769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:51.631769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:51.631769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:51.631769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:51.631769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:51.631769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:51.633101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:51.633101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:51.633101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:51.633101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:51.634909 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 263/537] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:51.640479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a057a48-db90-4b3e-be69-99cc96974cfc None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:51.772429 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a057a48-db90-4b3e-be69-99cc96974cfc None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:51.807764 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44973a57-746c-4359-afc6-55b44c3729bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:51.808456 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44973a57-746c-4359-afc6-55b44c3729bb None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:51.808728 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44973a57-746c-4359-afc6-55b44c3729bb None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:51.808994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44973a57-746c-4359-afc6-55b44c3729bb None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:51.809711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44973a57-746c-4359-afc6-55b44c3729bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:51.810004 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44973a57-746c-4359-afc6-55b44c3729bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:51.811340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44973a57-746c-4359-afc6-55b44c3729bb None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:51.823041 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 275/538] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:51.830085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b587b-791d-4a3f-ab3b-fa9c69af26f6 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:51.972716 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b587b-791d-4a3f-ab3b-fa9c69af26f6 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:52.006422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1330369-3f79-4633-b244-b480df1adbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:52.007578 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1330369-3f79-4633-b244-b480df1adbb4 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.008051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1330369-3f79-4633-b244-b480df1adbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.008533 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1330369-3f79-4633-b244-b480df1adbb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.015291 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1330369-3f79-4633-b244-b480df1adbb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:52.016971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1330369-3f79-4633-b244-b480df1adbb4 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:52.031301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-a1330369-3f79-4633-b244-b480df1adbb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:52.031301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:52.031301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:52.031301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:52.031301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:52.031301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:52.031301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:52.031301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:52.031301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:52.031301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:52.031301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:52.031301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:52.031301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:46:52.031301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:46:52.031301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:46:52.032195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:46:52.032195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:52.032195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:52.032195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:52.032195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:52.032195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:52.032195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:52.032195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:52.032195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:52.032195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:52.032195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:52.032195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:52.032195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:52.032195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:52.032195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:52.032195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:52.032195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:52.033059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:46:52.033059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:46:52.033059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:46:52.033059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:46:52.033059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:46:52.033059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:46:52.033059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:52.033059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:52.035443 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 264/539] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:52.045315 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44973a57-746c-4359-afc6-55b44c3729bb None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:52.169366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44973a57-746c-4359-afc6-55b44c3729bb None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:52.202137 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774eaab-1d99-4b42-98de-73d8215fcb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:52.202792 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774eaab-1d99-4b42-98de-73d8215fcb82 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.203067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774eaab-1d99-4b42-98de-73d8215fcb82 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.203333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774eaab-1d99-4b42-98de-73d8215fcb82 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.204109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774eaab-1d99-4b42-98de-73d8215fcb82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:52.204437 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774eaab-1d99-4b42-98de-73d8215fcb82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:52.205846 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774eaab-1d99-4b42-98de-73d8215fcb82 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:52.218788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 276/540] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:46:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:52.226121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1330369-3f79-4633-b244-b480df1adbb4 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:52.347595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091709e5-4310-4a60-b9e9-78aae8e04e31 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.347595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091709e5-4310-4a60-b9e9-78aae8e04e31 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.348102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091709e5-4310-4a60-b9e9-78aae8e04e31 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.352291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 277/541] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:52.355499 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008afbbc-4781-42b2-9acd-8ad9c6b957b5 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.355987 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008afbbc-4781-42b2-9acd-8ad9c6b957b5 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.356283 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008afbbc-4781-42b2-9acd-8ad9c6b957b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.371212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1330369-3f79-4633-b244-b480df1adbb4 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:52.372787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-008afbbc-4781-42b2-9acd-8ad9c6b957b5 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:52.374419 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-008afbbc-4781-42b2-9acd-8ad9c6b957b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:52.407294 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a71df5-97c7-4a47-996e-3bee737d59ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:52.408248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a71df5-97c7-4a47-996e-3bee737d59ae None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.408686 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a71df5-97c7-4a47-996e-3bee737d59ae None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.409098 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a71df5-97c7-4a47-996e-3bee737d59ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.410057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a71df5-97c7-4a47-996e-3bee737d59ae None admin] RBAC: Adding query filter params (role.id=10053e4259ae4b3bbbdbefa96320c937, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=7fc8efc2d5134bdba361a5c7bcfc1ffc) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:52.410494 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a71df5-97c7-4a47-996e-3bee737d59ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:52.412143 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a71df5-97c7-4a47-996e-3bee737d59ae None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:52.419028 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 265/542] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:52 2022] GET /identity/v3/role_assignments?user.id=7fc8efc2d5134bdba361a5c7bcfc1ffc&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=10053e4259ae4b3bbbdbefa96320c937 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:52.448307 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 278/543] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:52.467641 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a71df5-97c7-4a47-996e-3bee737d59ae None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:52.608951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a71df5-97c7-4a47-996e-3bee737d59ae None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:52.644089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c28707-99be-4dd9-b4e6-ce73c764deed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:52.645731 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28707-99be-4dd9-b4e6-ce73c764deed None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.646220 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28707-99be-4dd9-b4e6-ce73c764deed None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.646750 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28707-99be-4dd9-b4e6-ce73c764deed None admin] PATH_INFO: `/v3/roles/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.657911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c28707-99be-4dd9-b4e6-ce73c764deed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:52.666622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-27c28707-99be-4dd9-b4e6-ce73c764deed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:52.666622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:52.666622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:52.666622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:52.666622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:52.666622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:52.666622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:52.666622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:52.666622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:52.666622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:52.666622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:52.666622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:52.666622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:52.666622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:52.666622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:52.666622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:52.667508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:52.667508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:52.667508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:52.667508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:52.667508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:52.667508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:52.667508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:52.667508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:52.667508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:52.667508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:52.667508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:52.667508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:52.667508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:52.667508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:52.667508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:52.667508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:52.668356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:52.668356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:52.668356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:52.668356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:52.668356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:52.668356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:52.668356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:52.668356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:52.668356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:52.668356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:52.668356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:52.668356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:52.671038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 266/544] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:46:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:52.681333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008afbbc-4781-42b2-9acd-8ad9c6b957b5 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:52.829356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008afbbc-4781-42b2-9acd-8ad9c6b957b5 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:52.877990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63ba64-823a-437d-a761-41e6f57ae012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:52.878667 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63ba64-823a-437d-a761-41e6f57ae012 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:52.878946 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63ba64-823a-437d-a761-41e6f57ae012 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:52.879220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63ba64-823a-437d-a761-41e6f57ae012 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:52.879969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63ba64-823a-437d-a761-41e6f57ae012 None admin] RBAC: Adding query filter params (name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:52.880300 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63ba64-823a-437d-a761-41e6f57ae012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:52.881755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63ba64-823a-437d-a761-41e6f57ae012 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:52.895691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 279/545] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:46:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:52.902653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c28707-99be-4dd9-b4e6-ce73c764deed None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:53.027656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c28707-99be-4dd9-b4e6-ce73c764deed None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:53.064649 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c79062-af08-48a6-a639-de9f4563d420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:53.065979 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c79062-af08-48a6-a639-de9f4563d420 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.066475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c79062-af08-48a6-a639-de9f4563d420 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.066942 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c79062-af08-48a6-a639-de9f4563d420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.078404 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c79062-af08-48a6-a639-de9f4563d420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:53.080268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c79062-af08-48a6-a639-de9f4563d420 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:53.099270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-c8c79062-af08-48a6-a639-de9f4563d420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:53.099270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:53.099270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:53.099270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:53.099270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:53.099270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:53.099270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:53.099270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:53.099270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:53.099270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:53.099270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:53.099270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:53.099270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:53.099270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:53.099270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:53.100813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:53.100813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:53.100813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:53.100813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:53.100813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:53.100813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:53.100813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:53.100813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:53.100813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:53.100813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:53.100813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:53.100813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:53.100813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:53.100813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:53.100813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:53.100813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:53.100813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:53.101674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:53.101674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:53.101674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:53.101674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:53.103610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 267/546] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:53.109371 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63ba64-823a-437d-a761-41e6f57ae012 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:53.232514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63ba64-823a-437d-a761-41e6f57ae012 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:53.267134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43607f6-c473-4d2e-9627-a98246a13bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:53.268155 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43607f6-c473-4d2e-9627-a98246a13bd9 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.268654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43607f6-c473-4d2e-9627-a98246a13bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.269123 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43607f6-c473-4d2e-9627-a98246a13bd9 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.270049 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43607f6-c473-4d2e-9627-a98246a13bd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:53.270560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43607f6-c473-4d2e-9627-a98246a13bd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:53.272721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43607f6-c473-4d2e-9627-a98246a13bd9 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:53.285969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 280/547] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:53.291136 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c79062-af08-48a6-a639-de9f4563d420 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:53.348877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389553fd-46d8-40ce-97c8-dd47eedb4920 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.349506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389553fd-46d8-40ce-97c8-dd47eedb4920 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.350023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389553fd-46d8-40ce-97c8-dd47eedb4920 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.351632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 281/548] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:46:53.357432 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44142cc-f2c6-439d-b001-a11400ca8573 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.357768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44142cc-f2c6-439d-b001-a11400ca8573 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.357984 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44142cc-f2c6-439d-b001-a11400ca8573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.404192 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-a44142cc-f2c6-439d-b001-a11400ca8573 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:53.404192 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a44142cc-f2c6-439d-b001-a11400ca8573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:53.408777 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c79062-af08-48a6-a639-de9f4563d420 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:53.445018 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1dc84-7f83-4be0-8efa-83666c49ce29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:53.445807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1dc84-7f83-4be0-8efa-83666c49ce29 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.446087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1dc84-7f83-4be0-8efa-83666c49ce29 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.446357 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1dc84-7f83-4be0-8efa-83666c49ce29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.453961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1dc84-7f83-4be0-8efa-83666c49ce29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:53.455386 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1dc84-7f83-4be0-8efa-83666c49ce29 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:53.469835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-96b1dc84-7f83-4be0-8efa-83666c49ce29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:46:53.469835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:53.469835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:53.469835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:53.469835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:53.469835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:53.469835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:53.469835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:53.469835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:53.469835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:53.469835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:53.469835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:53.469835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:46:53.469835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:46:53.469835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:46:53.469835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:53.470751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:53.471681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:53.471681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:53.471681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:46:53.471681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:46:53.471681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:46:53.471681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:46:53.471681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:46:53.471681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:46:53.471681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:46:53.471681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:53.471681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 268/549] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 13:46:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:53.476840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1dc84-7f83-4be0-8efa-83666c49ce29 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:53.518902 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 282/550] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:53.554628 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44142cc-f2c6-439d-b001-a11400ca8573 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:53.575644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1dc84-7f83-4be0-8efa-83666c49ce29 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:53.612814 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408aa75-1463-46d5-80c2-d359c0bfc55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:53.613487 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408aa75-1463-46d5-80c2-d359c0bfc55a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.614143 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408aa75-1463-46d5-80c2-d359c0bfc55a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.614432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408aa75-1463-46d5-80c2-d359c0bfc55a None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.616139 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408aa75-1463-46d5-80c2-d359c0bfc55a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:53.616647 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408aa75-1463-46d5-80c2-d359c0bfc55a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:53.618368 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408aa75-1463-46d5-80c2-d359c0bfc55a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:53.642022 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 269/551] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 13:46:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:53.644137 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b6dbf-5aca-47dc-b4d0-f806c7f07774 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.644782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b6dbf-5aca-47dc-b4d0-f806c7f07774 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.644782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b6dbf-5aca-47dc-b4d0-f806c7f07774 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.646275 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 270/552] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:53.647024 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b6dbf-5aca-47dc-b4d0-f806c7f07774 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:53.685723 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44142cc-f2c6-439d-b001-a11400ca8573 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:53.733354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c47c2-5f7c-4df4-9ce3-1030bbc3616a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:53.734797 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c47c2-5f7c-4df4-9ce3-1030bbc3616a None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.735086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c47c2-5f7c-4df4-9ce3-1030bbc3616a None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.735365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c47c2-5f7c-4df4-9ce3-1030bbc3616a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.749396 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c47c2-5f7c-4df4-9ce3-1030bbc3616a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:53.752486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b6dbf-5aca-47dc-b4d0-f806c7f07774 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:53.758592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-136c47c2-5f7c-4df4-9ce3-1030bbc3616a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:53.758592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:53.758592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:53.758592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:53.758592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:53.758592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:53.758592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:53.758592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:53.758592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:53.758592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:53.758592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:53.758592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:53.758592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:53.758592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:53.758592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:53.758592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:53.760080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:53.760080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:53.760080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:53.760080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:53.760080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:53.760080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:53.760080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:53.760080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:53.760080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:53.760080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:53.760080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:53.760080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:53.760080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:53.760080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:53.760080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:53.760080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:53.761701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:53.761701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:53.761701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:53.761701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:53.761701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:53.761701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:53.761701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:53.761701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:53.761701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:53.761701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:53.761701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:53.761701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:53.761701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 283/553] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:46:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:53.761701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65383bd5-87ef-4d7e-af31-c1172e908d33 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.763167 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65383bd5-87ef-4d7e-af31-c1172e908d33 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.763167 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65383bd5-87ef-4d7e-af31-c1172e908d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.783595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-65383bd5-87ef-4d7e-af31-c1172e908d33 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:53.785184 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-65383bd5-87ef-4d7e-af31-c1172e908d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:53.791890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb20fd-d795-4b08-be08-76d8c91d5e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:53.792908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb20fd-d795-4b08-be08-76d8c91d5e3c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:53.793285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb20fd-d795-4b08-be08-76d8c91d5e3c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:53.793670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb20fd-d795-4b08-be08-76d8c91d5e3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:53.806021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb20fd-d795-4b08-be08-76d8c91d5e3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:53.807457 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb20fd-d795-4b08-be08-76d8c91d5e3c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:53.833559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-26cb20fd-d795-4b08-be08-76d8c91d5e3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:53.833559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:53.833559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:53.833559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:53.833559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:53.833559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:53.833559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:53.833559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:53.833559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:53.833559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:53.833559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:53.833559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:53.833559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:53.833559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:53.833559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:53.836123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:53.836123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:53.836123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:53.836123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:53.836123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:53.836123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:53.836123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:53.836123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:53.836123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:53.836123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:53.836123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:53.836123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:53.836123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:53.836123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:53.836123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:53.836123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:53.836123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:53.838016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:53.838016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:53.838016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:53.838016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:53.838016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 271/554] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:53.838016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb20fd-d795-4b08-be08-76d8c91d5e3c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:53.859212 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 284/555] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:53.860283 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65383bd5-87ef-4d7e-af31-c1172e908d33 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:53.960532 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb20fd-d795-4b08-be08-76d8c91d5e3c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:53.990076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65383bd5-87ef-4d7e-af31-c1172e908d33 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:54.002712 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eab069-fdba-44b5-996b-527aa4a48200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.003848 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eab069-fdba-44b5-996b-527aa4a48200 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.004285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eab069-fdba-44b5-996b-527aa4a48200 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.004620 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eab069-fdba-44b5-996b-527aa4a48200 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.005374 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eab069-fdba-44b5-996b-527aa4a48200 None admin] RBAC: Adding query filter params (name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:54.005865 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eab069-fdba-44b5-996b-527aa4a48200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:54.007938 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eab069-fdba-44b5-996b-527aa4a48200 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:54.018811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 272/556] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:46:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:54.019999 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eab069-fdba-44b5-996b-527aa4a48200 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.026385 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71958994-5c4a-471a-9d5f-5c2c79a4667a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.027169 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71958994-5c4a-471a-9d5f-5c2c79a4667a None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.027540 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71958994-5c4a-471a-9d5f-5c2c79a4667a None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.027931 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71958994-5c4a-471a-9d5f-5c2c79a4667a None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.028824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71958994-5c4a-471a-9d5f-5c2c79a4667a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:54.029377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71958994-5c4a-471a-9d5f-5c2c79a4667a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:54.031095 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71958994-5c4a-471a-9d5f-5c2c79a4667a None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:54.047929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 285/557] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:54.048905 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71958994-5c4a-471a-9d5f-5c2c79a4667a None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.136568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eab069-fdba-44b5-996b-527aa4a48200 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:54.164575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71958994-5c4a-471a-9d5f-5c2c79a4667a None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:54.178841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218059d-f427-4717-b0e6-c4e45f6ff2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.180145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218059d-f427-4717-b0e6-c4e45f6ff2a6 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.180466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218059d-f427-4717-b0e6-c4e45f6ff2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.180747 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218059d-f427-4717-b0e6-c4e45f6ff2a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.193779 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218059d-f427-4717-b0e6-c4e45f6ff2a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:54.199571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e44c47-f9e3-4b7c-9c0e-061773b0b30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.200532 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e44c47-f9e3-4b7c-9c0e-061773b0b30a None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.200899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e44c47-f9e3-4b7c-9c0e-061773b0b30a None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.201342 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e44c47-f9e3-4b7c-9c0e-061773b0b30a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.202800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-9218059d-f427-4717-b0e6-c4e45f6ff2a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:54.202800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:54.202800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:54.202800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:54.202800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:54.202800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:54.202800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:54.202800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:54.202800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:54.202800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:54.202800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:54.202800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:54.202800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:54.202800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:54.202800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:54.202800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:54.204546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:54.204546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:54.204546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:54.204546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:54.204546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:54.204546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:54.204546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:54.204546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:54.204546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:54.204546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:54.204546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:54.204546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:54.204546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:54.204546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:54.204546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:54.204546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:54.205797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:54.205797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:54.205797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:54.205797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:54.205797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:54.205797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:54.205797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:54.205797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:54.205797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:54.205797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:54.205797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:54.205797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:54.212192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 273/558] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:46:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:54.212192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218059d-f427-4717-b0e6-c4e45f6ff2a6 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.217713 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e44c47-f9e3-4b7c-9c0e-061773b0b30a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:54.219257 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e44c47-f9e3-4b7c-9c0e-061773b0b30a None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:54.237494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-14e44c47-f9e3-4b7c-9c0e-061773b0b30a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:54.237494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:54.237494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:54.237494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:54.237494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:54.237494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:54.237494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:54.237494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:54.237494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:54.237494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:54.237494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:54.237494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:54.237494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:54.237494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:54.237494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:54.238737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:54.238737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:54.238737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:54.238737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:54.238737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:54.238737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:54.238737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:54.238737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:54.238737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:54.238737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:54.238737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:54.238737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:54.238737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:54.238737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:54.238737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:54.238737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:54.238737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:54.241138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:54.241138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:54.241138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:54.241138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:54.245650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 286/559] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:54.245650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e44c47-f9e3-4b7c-9c0e-061773b0b30a None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.323030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218059d-f427-4717-b0e6-c4e45f6ff2a6 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:54.345106 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e44c47-f9e3-4b7c-9c0e-061773b0b30a None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:54.355208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1f820-a0ea-4219-8bc9-6b7ec4146c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.356076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1f820-a0ea-4219-8bc9-6b7ec4146c6a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.356451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1f820-a0ea-4219-8bc9-6b7ec4146c6a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.356794 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1f820-a0ea-4219-8bc9-6b7ec4146c6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.363212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1f820-a0ea-4219-8bc9-6b7ec4146c6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:54.364674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1f820-a0ea-4219-8bc9-6b7ec4146c6a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:54.380689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-b7f1f820-a0ea-4219-8bc9-6b7ec4146c6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:54.380689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:54.380689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:54.380689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:54.380689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:54.380689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:54.380689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:54.380689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:54.380689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:54.380689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:54.380689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:54.380689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:54.380689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:46:54.380689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:46:54.380689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:46:54.382130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:46:54.382130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:54.382130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:54.382130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:54.382130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:54.382130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:54.382130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:54.382130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:54.382130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:54.382130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:54.382130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:54.382130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:54.382130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:54.382130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:54.382130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:54.382130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:54.382130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:54.382994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:46:54.382994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:46:54.382994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:46:54.382994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:46:54.382994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:46:54.382994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:46:54.382994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:54.382994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:54.382994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 274/560] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:54.382994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1f820-a0ea-4219-8bc9-6b7ec4146c6a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.386743 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c691bcc-5d62-49c0-ab72-0fb34d6d955d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.387467 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c691bcc-5d62-49c0-ab72-0fb34d6d955d None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.387708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c691bcc-5d62-49c0-ab72-0fb34d6d955d None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.387983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c691bcc-5d62-49c0-ab72-0fb34d6d955d None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.388774 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c691bcc-5d62-49c0-ab72-0fb34d6d955d None admin] RBAC: Adding query filter params (name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:54.389081 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c691bcc-5d62-49c0-ab72-0fb34d6d955d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:54.390466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c691bcc-5d62-49c0-ab72-0fb34d6d955d None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:54.400143 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 287/561] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:46:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:54.405982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a5bd5-5b98-4412-865b-fc0b7bada52f None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.406270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a5bd5-5b98-4412-865b-fc0b7bada52f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.406549 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a5bd5-5b98-4412-865b-fc0b7bada52f None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.407950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 288/562] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:54.408497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a5bd5-5b98-4412-865b-fc0b7bada52f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.491712 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1f820-a0ea-4219-8bc9-6b7ec4146c6a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:54.524851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a63d8a-0871-4102-96e1-fd76f19c78f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.525512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a63d8a-0871-4102-96e1-fd76f19c78f3 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.525702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a5bd5-5b98-4412-865b-fc0b7bada52f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:54.525843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a63d8a-0871-4102-96e1-fd76f19c78f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.526084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a63d8a-0871-4102-96e1-fd76f19c78f3 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.526758 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a63d8a-0871-4102-96e1-fd76f19c78f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:54.527061 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a63d8a-0871-4102-96e1-fd76f19c78f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:54.528455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a63d8a-0871-4102-96e1-fd76f19c78f3 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:54.542300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 275/563] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:54.542300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a63d8a-0871-4102-96e1-fd76f19c78f3 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.571766 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f3f18-7f5f-4be8-9d83-7a4db5816587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.572466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f3f18-7f5f-4be8-9d83-7a4db5816587 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.572747 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f3f18-7f5f-4be8-9d83-7a4db5816587 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.573021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f3f18-7f5f-4be8-9d83-7a4db5816587 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.573858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f3f18-7f5f-4be8-9d83-7a4db5816587 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:54.574107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f3f18-7f5f-4be8-9d83-7a4db5816587 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:54.575512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f3f18-7f5f-4be8-9d83-7a4db5816587 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:54.587242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 289/564] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:46:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:54.588490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e5940-e8dd-4e41-8592-b5d61aacfcf3 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.588776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e5940-e8dd-4e41-8592-b5d61aacfcf3 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.589051 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e5940-e8dd-4e41-8592-b5d61aacfcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.605159 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-e49e5940-e8dd-4e41-8592-b5d61aacfcf3 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:54.606342 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e49e5940-e8dd-4e41-8592-b5d61aacfcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:54.651930 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a63d8a-0871-4102-96e1-fd76f19c78f3 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:54.680193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 290/565] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:54.680193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e5940-e8dd-4e41-8592-b5d61aacfcf3 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.696868 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec4143-9737-42f4-9c8e-62801ed98eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.697669 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4143-9737-42f4-9c8e-62801ed98eb8 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.697949 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4143-9737-42f4-9c8e-62801ed98eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.698225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4143-9737-42f4-9c8e-62801ed98eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.708748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec4143-9737-42f4-9c8e-62801ed98eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:54.710286 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec4143-9737-42f4-9c8e-62801ed98eb8 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:54.727519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-f8ec4143-9737-42f4-9c8e-62801ed98eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:54.727519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:54.727519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:54.727519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:54.727519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:54.727519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:54.727519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:54.727519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:54.727519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:54.727519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:54.727519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:54.727519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:54.727519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:54.727519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:54.727519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:54.728689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:54.728689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:54.728689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:54.728689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:54.728689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:54.728689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:54.728689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:54.728689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:54.728689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:54.728689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:54.728689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:54.728689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:54.728689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:54.728689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:54.728689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:54.728689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:54.728689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:54.729955 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:54.729955 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:54.729955 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:54.729955 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:54.733119 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 276/566] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:54.733927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec4143-9737-42f4-9c8e-62801ed98eb8 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.779684 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e5940-e8dd-4e41-8592-b5d61aacfcf3 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:54.814322 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e1092-4062-4047-a6e6-29c8b2ac8470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.815119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e1092-4062-4047-a6e6-29c8b2ac8470 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.815424 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e1092-4062-4047-a6e6-29c8b2ac8470 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.815702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e1092-4062-4047-a6e6-29c8b2ac8470 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.822664 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e1092-4062-4047-a6e6-29c8b2ac8470 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:54.824141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e1092-4062-4047-a6e6-29c8b2ac8470 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:54.833892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec4143-9737-42f4-9c8e-62801ed98eb8 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:54.838679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-2f1e1092-4062-4047-a6e6-29c8b2ac8470 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 13:46:54.838679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:54.838679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:54.838679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:54.838679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:54.838679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:54.838679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:54.838679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:54.838679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:54.838679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:54.838679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:54.838679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:54.838679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:46:54.838679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:46:54.838679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:46:54.838679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:54.839686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:54.841222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:54.841222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:54.841222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:46:54.841222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:46:54.841222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:46:54.841222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:46:54.841222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:46:54.841222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:46:54.841222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 13:46:54.841222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:54.844646 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 291/567] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:46:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:54.845629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e1092-4062-4047-a6e6-29c8b2ac8470 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.874869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f6c25-2641-469e-abc5-49b966b038e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:54.875764 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f6c25-2641-469e-abc5-49b966b038e9 None admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:54.876041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f6c25-2641-469e-abc5-49b966b038e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:54.876341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f6c25-2641-469e-abc5-49b966b038e9 None admin] PATH_INFO: `/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/975f10f781b94bdaa8edee39a2b1bba4/roles/10053e4259ae4b3bbbdbefa96320c937` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:54.891708 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f6c25-2641-469e-abc5-49b966b038e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9613de9a3bc9461d9d348e5b66b8d684, user_id=975f10f781b94bdaa8edee39a2b1bba4, role_id=10053e4259ae4b3bbbdbefa96320c937)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:54.893607 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f6c25-2641-469e-abc5-49b966b038e9 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:54.907249 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 277/568] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:46:54 2022] PUT /identity/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/975f10f781b94bdaa8edee39a2b1bba4/roles/10053e4259ae4b3bbbdbefa96320c937 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:54.908046 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f6c25-2641-469e-abc5-49b966b038e9 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:54.968897 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e1092-4062-4047-a6e6-29c8b2ac8470 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.008002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f8a0c-af44-4d42-8dd3-0a6ab39ece97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:55.009224 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8a0c-af44-4d42-8dd3-0a6ab39ece97 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.009745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8a0c-af44-4d42-8dd3-0a6ab39ece97 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.010222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8a0c-af44-4d42-8dd3-0a6ab39ece97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.019893 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f6c25-2641-469e-abc5-49b966b038e9 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.022778 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f8a0c-af44-4d42-8dd3-0a6ab39ece97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:55.031608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-8f6f8a0c-af44-4d42-8dd3-0a6ab39ece97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:55.031608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:55.031608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:55.031608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:55.031608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:55.031608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:55.031608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:55.031608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:55.031608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:55.031608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:55.031608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:55.031608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:55.031608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:55.031608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:55.031608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:55.031608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:55.032922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:55.032922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:55.032922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:55.032922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:55.032922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:55.032922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:55.032922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:55.032922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:55.032922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:55.032922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:55.032922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:55.032922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:55.032922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:55.032922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:55.032922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:55.032922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:55.033770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:55.033770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:55.033770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:55.033770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:55.033770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:55.033770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:55.033770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:55.033770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:55.033770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:55.033770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:55.033770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:55.033770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:55.042975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 292/569] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:46:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:55.042975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f8a0c-af44-4d42-8dd3-0a6ab39ece97 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:55.058872 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e929569-b328-4478-a34f-5e0aab59513d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:55.059547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e929569-b328-4478-a34f-5e0aab59513d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.059838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e929569-b328-4478-a34f-5e0aab59513d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.060111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e929569-b328-4478-a34f-5e0aab59513d None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.060912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e929569-b328-4478-a34f-5e0aab59513d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:55.061215 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e929569-b328-4478-a34f-5e0aab59513d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:55.062598 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e929569-b328-4478-a34f-5e0aab59513d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:55.074840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 278/570] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:55.076101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914301c9-5cad-43ab-a999-df7f66d46bd3 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.076427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914301c9-5cad-43ab-a999-df7f66d46bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.076704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914301c9-5cad-43ab-a999-df7f66d46bd3 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.082065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 279/571] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:55.082065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914301c9-5cad-43ab-a999-df7f66d46bd3 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:55.161639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f8a0c-af44-4d42-8dd3-0a6ab39ece97 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.184864 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914301c9-5cad-43ab-a999-df7f66d46bd3 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.195508 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eb139-47a5-4753-be86-d74d229a6589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:55.196197 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eb139-47a5-4753-be86-d74d229a6589 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.196468 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eb139-47a5-4753-be86-d74d229a6589 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.196734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eb139-47a5-4753-be86-d74d229a6589 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.197552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1eb139-47a5-4753-be86-d74d229a6589 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:55.197850 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1eb139-47a5-4753-be86-d74d229a6589 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:55.199252 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1eb139-47a5-4753-be86-d74d229a6589 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:55.216394 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 293/572] 10.222.0.49 () {56 vars in 1135 bytes} [Tue May 10 13:46:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:55.217189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eb139-47a5-4753-be86-d74d229a6589 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:55.223109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e73db-056f-4264-b7d4-c2f5aab169e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:55.223996 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e73db-056f-4264-b7d4-c2f5aab169e4 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.224310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e73db-056f-4264-b7d4-c2f5aab169e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.225164 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e73db-056f-4264-b7d4-c2f5aab169e4 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.225915 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e73db-056f-4264-b7d4-c2f5aab169e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:55.226217 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e73db-056f-4264-b7d4-c2f5aab169e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:55.227583 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e73db-056f-4264-b7d4-c2f5aab169e4 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:55.240147 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 280/573] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:46:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:55.240147 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a8580-d3b8-4190-ab13-ffa003aa6a00 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.240147 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a8580-d3b8-4190-ab13-ffa003aa6a00 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.240147 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a8580-d3b8-4190-ab13-ffa003aa6a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.253311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-468a8580-d3b8-4190-ab13-ffa003aa6a00 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:55.254501 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-468a8580-d3b8-4190-ab13-ffa003aa6a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:55.318916 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 281/574] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:55.319763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a8580-d3b8-4190-ab13-ffa003aa6a00 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:55.319977 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eb139-47a5-4753-be86-d74d229a6589 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.354361 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87ba32-aeb0-4fde-95d2-60b72ec86bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:55.355077 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87ba32-aeb0-4fde-95d2-60b72ec86bb2 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.355353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87ba32-aeb0-4fde-95d2-60b72ec86bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.355623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87ba32-aeb0-4fde-95d2-60b72ec86bb2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.362668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87ba32-aeb0-4fde-95d2-60b72ec86bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:55.364084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87ba32-aeb0-4fde-95d2-60b72ec86bb2 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:55.385401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-6d87ba32-aeb0-4fde-95d2-60b72ec86bb2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 13:46:55.385401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:55.385401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:55.385401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:55.385401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:55.385401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:55.385401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:55.385401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:55.385401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:55.385401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:55.385401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:55.385401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:55.385401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:46:55.385401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:46:55.385401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:46:55.385401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:55.387076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:55.388234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:55.388234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:55.388234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:46:55.388234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:46:55.388234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:46:55.388234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:46:55.388234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:46:55.388234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:46:55.388234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 13:46:55.388234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:55.388234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 294/575] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:55.388234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87ba32-aeb0-4fde-95d2-60b72ec86bb2 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:55.445112 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a8580-d3b8-4190-ab13-ffa003aa6a00 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.479057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff08ac-65af-4c39-8528-343a745807e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:55.479702 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff08ac-65af-4c39-8528-343a745807e0 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.479978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff08ac-65af-4c39-8528-343a745807e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.480280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff08ac-65af-4c39-8528-343a745807e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.484959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87ba32-aeb0-4fde-95d2-60b72ec86bb2 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.520680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef73d4-733b-4572-a502-b5645dd33dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:55.522029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef73d4-733b-4572-a502-b5645dd33dc7 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.522356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef73d4-733b-4572-a502-b5645dd33dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.522630 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef73d4-733b-4572-a502-b5645dd33dc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.532553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef73d4-733b-4572-a502-b5645dd33dc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:55.534063 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef73d4-733b-4572-a502-b5645dd33dc7 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:55.546045 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff08ac-65af-4c39-8528-343a745807e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:55.547557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff08ac-65af-4c39-8528-343a745807e0 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:55.551362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-8fef73d4-733b-4572-a502-b5645dd33dc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:55.551362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:55.551362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:55.551362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:55.551362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:55.551362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:55.551362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:55.551362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:55.551362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:55.551362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:55.551362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:55.551362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:55.551362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:55.551362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:55.551362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:55.552514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:55.552514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:55.552514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:55.552514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:55.552514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:55.552514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:55.552514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:55.552514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:55.552514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:55.552514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:55.552514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:55.552514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:55.552514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:55.552514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:55.552514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:55.552514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:55.552514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:55.553683 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:55.553683 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:55.553683 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:55.553683 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:55.559033 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 295/576] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:55.559033 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef73d4-733b-4572-a502-b5645dd33dc7 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:55.649563 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 282/577] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:55.650328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef73d4-733b-4572-a502-b5645dd33dc7 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.650437 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff08ac-65af-4c39-8528-343a745807e0 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:55.686962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff975c3-f600-4247-a65f-35b4892f2d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:55.687998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff975c3-f600-4247-a65f-35b4892f2d0e None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.688484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff975c3-f600-4247-a65f-35b4892f2d0e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.688903 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff975c3-f600-4247-a65f-35b4892f2d0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.699562 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff975c3-f600-4247-a65f-35b4892f2d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:55.707451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-0ff975c3-f600-4247-a65f-35b4892f2d0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:55.707451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:55.707451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:55.707451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:55.707451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:55.707451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:55.707451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:55.707451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:55.707451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:55.707451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:55.707451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:55.707451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:55.707451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:55.707451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:55.707451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:55.707451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:55.708623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:55.708623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:55.708623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:55.708623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:55.708623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:55.708623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:55.708623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:55.708623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:55.708623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:55.708623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:55.708623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:55.708623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:55.708623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:55.708623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:55.708623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:55.708623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:55.709735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:55.709735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:55.709735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:55.709735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:55.709735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:55.709735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:55.709735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:55.709735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:55.709735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:55.709735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:55.709735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:55.709735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:55.711823 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 296/578] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:46:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:55.712784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff975c3-f600-4247-a65f-35b4892f2d0e None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:55.750514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff08ac-65af-4c39-8528-343a745807e0 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.782952 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d161cb5-f4b1-40ba-a06e-5b497c4ea082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:55.783620 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d161cb5-f4b1-40ba-a06e-5b497c4ea082 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.783897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d161cb5-f4b1-40ba-a06e-5b497c4ea082 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.784208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d161cb5-f4b1-40ba-a06e-5b497c4ea082 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.785014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d161cb5-f4b1-40ba-a06e-5b497c4ea082 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:55.785320 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d161cb5-f4b1-40ba-a06e-5b497c4ea082 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:55.786726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d161cb5-f4b1-40ba-a06e-5b497c4ea082 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:55.808500 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 283/579] 10.222.0.49 () {56 vars in 1137 bytes} [Tue May 10 13:46:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:55.809373 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d161cb5-f4b1-40ba-a06e-5b497c4ea082 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:55.814455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff975c3-f600-4247-a65f-35b4892f2d0e None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.846506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5ad29-25c3-441e-b45a-ab02d701d799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:55.847151 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5ad29-25c3-441e-b45a-ab02d701d799 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.847425 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5ad29-25c3-441e-b45a-ab02d701d799 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.847693 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5ad29-25c3-441e-b45a-ab02d701d799 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.848426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5ad29-25c3-441e-b45a-ab02d701d799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:55.848723 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5ad29-25c3-441e-b45a-ab02d701d799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:55.850632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5ad29-25c3-441e-b45a-ab02d701d799 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:55.862367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 297/580] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:55.863161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5ad29-25c3-441e-b45a-ab02d701d799 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:55.910663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d161cb5-f4b1-40ba-a06e-5b497c4ea082 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.943345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f746c3-99d7-4ec7-8bb1-a77eb91ffb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:55.944134 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f746c3-99d7-4ec7-8bb1-a77eb91ffb4a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:55.944449 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f746c3-99d7-4ec7-8bb1-a77eb91ffb4a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:55.944731 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f746c3-99d7-4ec7-8bb1-a77eb91ffb4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:55.954479 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f746c3-99d7-4ec7-8bb1-a77eb91ffb4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:55.955941 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f746c3-99d7-4ec7-8bb1-a77eb91ffb4a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:55.958415 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5ad29-25c3-441e-b45a-ab02d701d799 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:55.973432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-32f746c3-99d7-4ec7-8bb1-a77eb91ffb4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:55.973432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:55.973432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:55.973432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:55.973432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:55.973432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:55.973432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:55.973432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:55.973432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:55.973432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:55.973432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:55.973432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:55.973432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:55.973432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:55.973432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:55.974329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:55.974329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:55.974329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:55.974329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:55.974329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:55.974329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:55.974329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:55.974329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:55.974329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:55.974329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:55.974329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:55.974329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:55.974329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:55.974329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:55.974329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:55.974329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:55.974329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:55.976458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:55.976458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:55.976458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:55.976458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:55.976458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 284/581] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:55.976458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f746c3-99d7-4ec7-8bb1-a77eb91ffb4a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:55.999191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5e2aa-f071-46c5-acbc-c4b3732207d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:56.000530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5e2aa-f071-46c5-acbc-c4b3732207d5 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:56.000817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5e2aa-f071-46c5-acbc-c4b3732207d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:56.001148 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5e2aa-f071-46c5-acbc-c4b3732207d5 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:56.001901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5e2aa-f071-46c5-acbc-c4b3732207d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:56.002207 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5e2aa-f071-46c5-acbc-c4b3732207d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:56.003623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5e2aa-f071-46c5-acbc-c4b3732207d5 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:56.016900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 298/582] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:46:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:56.016900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5e2aa-f071-46c5-acbc-c4b3732207d5 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:56.079747 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f746c3-99d7-4ec7-8bb1-a77eb91ffb4a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:56.113308 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6abcc4-ccc7-4843-bca4-e01671dc1d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:56.114089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6abcc4-ccc7-4843-bca4-e01671dc1d1a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:56.114363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6abcc4-ccc7-4843-bca4-e01671dc1d1a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:56.114634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6abcc4-ccc7-4843-bca4-e01671dc1d1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:56.116393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5e2aa-f071-46c5-acbc-c4b3732207d5 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:56.124517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6abcc4-ccc7-4843-bca4-e01671dc1d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:56.127320 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6abcc4-ccc7-4843-bca4-e01671dc1d1a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:56.150325 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e24768-aca8-4b22-8536-73c74d964313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:56.151122 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e24768-aca8-4b22-8536-73c74d964313 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:56.151403 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e24768-aca8-4b22-8536-73c74d964313 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:56.151677 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e24768-aca8-4b22-8536-73c74d964313 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:56.151778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-5b6abcc4-ccc7-4843-bca4-e01671dc1d1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:56.151778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:56.151778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:56.151778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:56.151778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:56.151778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:56.151778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:56.151778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:56.151778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:56.151778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:56.151778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:56.151778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:56.151778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:56.151778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:56.151778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:56.152889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:56.152889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:56.152889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:56.152889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:56.152889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:56.152889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:56.152889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:56.152889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:56.152889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:56.152889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:56.152889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:56.152889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:56.152889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:56.152889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:56.152889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:56.152889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:56.152889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:56.153870 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:56.153870 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:56.153870 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:56.153870 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:56.153870 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 285/583] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:56.154784 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6abcc4-ccc7-4843-bca4-e01671dc1d1a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:56.166302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e24768-aca8-4b22-8536-73c74d964313 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:56.167674 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e24768-aca8-4b22-8536-73c74d964313 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:56.181936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-28e24768-aca8-4b22-8536-73c74d964313 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 13:46:56.181936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:56.181936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:56.181936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:56.181936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:56.181936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:56.181936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:56.181936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:56.181936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:56.181936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:56.181936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:56.181936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:56.181936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:46:56.181936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:46:56.181936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:46:56.181936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:56.183002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:56.189058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:56.189058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:56.189058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:46:56.189058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:46:56.189058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:46:56.189058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:46:56.189058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:46:56.189058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:46:56.189058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 13:46:56.189058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:56.189058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 299/584] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:46:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:56.189058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e24768-aca8-4b22-8536-73c74d964313 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:56.277478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6abcc4-ccc7-4843-bca4-e01671dc1d1a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:56.285889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e24768-aca8-4b22-8536-73c74d964313 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:56.310936 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f496b-3e98-406d-8e90-6d2653c7bd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:56.311618 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f496b-3e98-406d-8e90-6d2653c7bd5b None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:56.311894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f496b-3e98-406d-8e90-6d2653c7bd5b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:56.312211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f496b-3e98-406d-8e90-6d2653c7bd5b None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:56.312905 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f496b-3e98-406d-8e90-6d2653c7bd5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:56.313233 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f496b-3e98-406d-8e90-6d2653c7bd5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:56.314599 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f496b-3e98-406d-8e90-6d2653c7bd5b None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:56.330381 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 286/585] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:56.330545 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1d27b-c946-473d-8a33-96cba4de6197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:56.330656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f496b-3e98-406d-8e90-6d2653c7bd5b None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:56.330744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d27b-c946-473d-8a33-96cba4de6197 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:56.330744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d27b-c946-473d-8a33-96cba4de6197 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:56.330744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d27b-c946-473d-8a33-96cba4de6197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:56.341648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1d27b-c946-473d-8a33-96cba4de6197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:56.343084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1d27b-c946-473d-8a33-96cba4de6197 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:56.360191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-53a1d27b-c946-473d-8a33-96cba4de6197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:56.360191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:56.360191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:56.360191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:56.360191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:56.360191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:56.360191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:56.360191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:56.360191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:56.360191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:56.360191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:56.360191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:56.360191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:56.360191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:56.360191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:56.361124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:56.361124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:56.361124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:56.361124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:56.361124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:56.361124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:56.361124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:56.361124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:56.361124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:56.361124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:56.361124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:56.361124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:56.361124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:56.361124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:56.361124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:56.361124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:56.361124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:56.362054 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:56.362054 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:56.362054 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:56.362054 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:56.362054 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 300/586] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:56.362338 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1d27b-c946-473d-8a33-96cba4de6197 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:56.438817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f496b-3e98-406d-8e90-6d2653c7bd5b None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:56.474030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f2aad-01fa-4413-ab59-427d121f8551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:56.475028 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f2aad-01fa-4413-ab59-427d121f8551 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:56.475455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f2aad-01fa-4413-ab59-427d121f8551 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:56.475833 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f2aad-01fa-4413-ab59-427d121f8551 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:56.476972 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f2aad-01fa-4413-ab59-427d121f8551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:56.477428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f2aad-01fa-4413-ab59-427d121f8551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:56.479504 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f2aad-01fa-4413-ab59-427d121f8551 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:56.479611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1d27b-c946-473d-8a33-96cba4de6197 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:56.500411 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 287/587] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:56.500411 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f2aad-01fa-4413-ab59-427d121f8551 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:56.515684 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34bed4-4d66-4f11-8482-fdc4d26b2628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:56.516385 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34bed4-4d66-4f11-8482-fdc4d26b2628 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:56.516664 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34bed4-4d66-4f11-8482-fdc4d26b2628 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:56.516934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34bed4-4d66-4f11-8482-fdc4d26b2628 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:56.517759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34bed4-4d66-4f11-8482-fdc4d26b2628 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:56.518061 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34bed4-4d66-4f11-8482-fdc4d26b2628 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:56.519483 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34bed4-4d66-4f11-8482-fdc4d26b2628 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:56.542915 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 301/588] 10.222.0.49 () {56 vars in 1139 bytes} [Tue May 10 13:46:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:56.542915 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34bed4-4d66-4f11-8482-fdc4d26b2628 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:56.610203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f2aad-01fa-4413-ab59-427d121f8551 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:56.637636 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34bed4-4d66-4f11-8482-fdc4d26b2628 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:56.644369 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7061e9-8d41-413b-8a77-acbb574c447b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:56.645163 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7061e9-8d41-413b-8a77-acbb574c447b None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:56.645441 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7061e9-8d41-413b-8a77-acbb574c447b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:56.645714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7061e9-8d41-413b-8a77-acbb574c447b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:56.652998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7061e9-8d41-413b-8a77-acbb574c447b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:56.654439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7061e9-8d41-413b-8a77-acbb574c447b None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:56.668654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-0e7061e9-8d41-413b-8a77-acbb574c447b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:56.668654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:56.668654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:56.668654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:56.668654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:56.668654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:56.668654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:56.668654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:56.668654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:56.668654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:56.668654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:56.668654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:56.668654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:46:56.668654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:46:56.668654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:46:56.669687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:46:56.669687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:56.669687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:56.669687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:56.669687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:56.669687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:56.669687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:56.669687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:56.669687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:56.669687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:56.669687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:56.669687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:56.669687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:56.669687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:56.669687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:56.669687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:56.669687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:56.670619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:46:56.670619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:46:56.670619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:46:56.670619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:46:56.670619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:46:56.670619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:46:56.670619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:56.670619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:56.670619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 288/589] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:56.670619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7061e9-8d41-413b-8a77-acbb574c447b None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:56.675814 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95492a86-abe3-4821-b04f-1d4b87d1a99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:56.676511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95492a86-abe3-4821-b04f-1d4b87d1a99e None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:56.676786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95492a86-abe3-4821-b04f-1d4b87d1a99e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:56.677055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95492a86-abe3-4821-b04f-1d4b87d1a99e None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:56.678303 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95492a86-abe3-4821-b04f-1d4b87d1a99e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:56.678601 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95492a86-abe3-4821-b04f-1d4b87d1a99e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:56.680129 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95492a86-abe3-4821-b04f-1d4b87d1a99e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:56.696236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 302/590] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:56.696236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95492a86-abe3-4821-b04f-1d4b87d1a99e None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:56.767353 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7061e9-8d41-413b-8a77-acbb574c447b None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:56.790066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95492a86-abe3-4821-b04f-1d4b87d1a99e None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:56.799675 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114e810-4188-4218-a452-011c71058cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:56.800491 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114e810-4188-4218-a452-011c71058cc8 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:56.800775 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114e810-4188-4218-a452-011c71058cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:56.801048 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114e810-4188-4218-a452-011c71058cc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:56.808286 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114e810-4188-4218-a452-011c71058cc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:56.809722 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114e810-4188-4218-a452-011c71058cc8 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:56.822475 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e3cc4-3bb5-4ce8-bdb9-918621102c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:56.823258 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e3cc4-3bb5-4ce8-bdb9-918621102c78 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:56.823533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e3cc4-3bb5-4ce8-bdb9-918621102c78 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:56.823801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e3cc4-3bb5-4ce8-bdb9-918621102c78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:56.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-6114e810-4188-4218-a452-011c71058cc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:56.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:56.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:56.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:56.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:56.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:56.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:56.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:56.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:56.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:56.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:56.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:56.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:46:56.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:46:56.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:46:56.825361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:46:56.825361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:56.825361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:56.825361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:56.825361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:56.825361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:56.825361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:56.825361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:56.825361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:56.825361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:56.825361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:56.825361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:56.825361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:56.825361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:56.825361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:56.825361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:56.825361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:56.826254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:46:56.826254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:46:56.826254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:46:56.826254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:46:56.826254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:46:56.826254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:46:56.826254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:56.826254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:56.826254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 289/591] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:56.826747 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114e810-4188-4218-a452-011c71058cc8 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:56.839310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e3cc4-3bb5-4ce8-bdb9-918621102c78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:56.840802 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e3cc4-3bb5-4ce8-bdb9-918621102c78 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:56.857596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-e72e3cc4-3bb5-4ce8-bdb9-918621102c78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:56.857596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:56.857596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:56.857596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:56.857596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:56.857596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:56.857596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:56.857596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:56.857596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:56.857596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:56.857596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:56.857596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:56.857596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:56.857596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:56.857596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:56.858721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:56.858721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:56.858721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:56.858721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:56.858721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:56.858721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:56.858721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:56.858721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:56.858721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:56.858721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:56.858721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:56.858721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:56.858721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:56.858721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:56.858721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:56.858721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:56.858721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:56.864138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:56.864138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:56.864138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:56.864138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:56.864138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 303/592] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:56.864138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e3cc4-3bb5-4ce8-bdb9-918621102c78 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:56.931491 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114e810-4188-4218-a452-011c71058cc8 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:56.958714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e3cc4-3bb5-4ce8-bdb9-918621102c78 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:56.967139 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950be24a-04cc-4ef3-8534-fbeffd8e6634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:56.967811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950be24a-04cc-4ef3-8534-fbeffd8e6634 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:56.968090 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950be24a-04cc-4ef3-8534-fbeffd8e6634 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:56.968399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950be24a-04cc-4ef3-8534-fbeffd8e6634 None admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:56.969197 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950be24a-04cc-4ef3-8534-fbeffd8e6634 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:56.969505 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950be24a-04cc-4ef3-8534-fbeffd8e6634 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:56.970960 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950be24a-04cc-4ef3-8534-fbeffd8e6634 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:56.983076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 290/593] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:46:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:56.983900 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950be24a-04cc-4ef3-8534-fbeffd8e6634 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:56.995307 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4fc5c-8925-4f28-a480-40aab1f9349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:56.996102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4fc5c-8925-4f28-a480-40aab1f9349b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:56.996431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4fc5c-8925-4f28-a480-40aab1f9349b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:56.996705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4fc5c-8925-4f28-a480-40aab1f9349b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:57.004225 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4fc5c-8925-4f28-a480-40aab1f9349b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:57.006296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4fc5c-8925-4f28-a480-40aab1f9349b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:57.020032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-2ec4fc5c-8925-4f28-a480-40aab1f9349b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 13:46:57.020032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:57.020032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:57.020032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:57.020032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:57.020032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:57.020032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:57.020032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:57.020032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:57.020032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:57.020032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:57.020032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:57.020032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:46:57.020032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:46:57.020032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:46:57.020032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:57.021010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:57.022029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:57.022029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:57.022029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:46:57.022029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:46:57.022029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:46:57.022029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:46:57.022029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:46:57.022029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:46:57.022029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 13:46:57.022029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:57.025972 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 304/594] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:46:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:57.026803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4fc5c-8925-4f28-a480-40aab1f9349b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:57.086332 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950be24a-04cc-4ef3-8534-fbeffd8e6634 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:57.119727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2fdad-e29d-4789-b3b7-75408cb8c6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:57.120416 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2fdad-e29d-4789-b3b7-75408cb8c6a0 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:57.120695 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2fdad-e29d-4789-b3b7-75408cb8c6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:57.120966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2fdad-e29d-4789-b3b7-75408cb8c6a0 None admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:57.121744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2fdad-e29d-4789-b3b7-75408cb8c6a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:57.122050 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2fdad-e29d-4789-b3b7-75408cb8c6a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:57.122970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4fc5c-8925-4f28-a480-40aab1f9349b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:57.123494 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2fdad-e29d-4789-b3b7-75408cb8c6a0 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:57.140293 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 291/595] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:46:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:57.140293 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2fdad-e29d-4789-b3b7-75408cb8c6a0 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:57.160728 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42f144-f05b-4fa3-b7a5-0c1e64d029f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:57.161380 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42f144-f05b-4fa3-b7a5-0c1e64d029f2 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:57.161651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42f144-f05b-4fa3-b7a5-0c1e64d029f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:57.161944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42f144-f05b-4fa3-b7a5-0c1e64d029f2 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:57.162666 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42f144-f05b-4fa3-b7a5-0c1e64d029f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:57.162964 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42f144-f05b-4fa3-b7a5-0c1e64d029f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:57.164326 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42f144-f05b-4fa3-b7a5-0c1e64d029f2 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:57.175228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 305/596] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:57.175983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42f144-f05b-4fa3-b7a5-0c1e64d029f2 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:57.229736 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2fdad-e29d-4789-b3b7-75408cb8c6a0 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:57.261559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4dd68-5aea-4bc8-ba1f-6002a800fb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:57.262201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4dd68-5aea-4bc8-ba1f-6002a800fb6d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:57.262481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4dd68-5aea-4bc8-ba1f-6002a800fb6d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:57.262758 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4dd68-5aea-4bc8-ba1f-6002a800fb6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:57.263575 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4dd68-5aea-4bc8-ba1f-6002a800fb6d None admin] RBAC: Adding query filter params (role.id=10053e4259ae4b3bbbdbefa96320c937, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=d102155cd1bd4368ad272668da1651f4) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:57.263887 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4dd68-5aea-4bc8-ba1f-6002a800fb6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:57.265339 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4dd68-5aea-4bc8-ba1f-6002a800fb6d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:57.270538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 292/597] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:46:57 2022] GET /identity/v3/role_assignments?user.id=d102155cd1bd4368ad272668da1651f4&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=10053e4259ae4b3bbbdbefa96320c937 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:57.271299 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4dd68-5aea-4bc8-ba1f-6002a800fb6d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:57.272195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42f144-f05b-4fa3-b7a5-0c1e64d029f2 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:57.308423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbf1d3-6dad-4f8c-a49d-29606c17fb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:57.309125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbf1d3-6dad-4f8c-a49d-29606c17fb10 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:57.309405 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbf1d3-6dad-4f8c-a49d-29606c17fb10 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:57.309676 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbf1d3-6dad-4f8c-a49d-29606c17fb10 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:57.310531 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbf1d3-6dad-4f8c-a49d-29606c17fb10 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:57.310840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbf1d3-6dad-4f8c-a49d-29606c17fb10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:57.312360 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbf1d3-6dad-4f8c-a49d-29606c17fb10 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:57.331416 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 306/598] 10.222.0.49 () {56 vars in 1137 bytes} [Tue May 10 13:46:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:57.332621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afe618-54f1-4c33-a5bc-701209335d60 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:57.332892 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afe618-54f1-4c33-a5bc-701209335d60 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:57.333217 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afe618-54f1-4c33-a5bc-701209335d60 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:57.335497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 307/599] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:57.336326 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afe618-54f1-4c33-a5bc-701209335d60 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:57.381942 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4dd68-5aea-4bc8-ba1f-6002a800fb6d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:57.419866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef029-3684-470f-bd9a-b77d4c6b81dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:57.420789 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef029-3684-470f-bd9a-b77d4c6b81dd None admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:57.421067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef029-3684-470f-bd9a-b77d4c6b81dd None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:57.421342 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef029-3684-470f-bd9a-b77d4c6b81dd None admin] PATH_INFO: `/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/2d674fd1d6ab43ab982b66bb2349b625/roles/10053e4259ae4b3bbbdbefa96320c937` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:57.436863 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ef029-3684-470f-bd9a-b77d4c6b81dd None admin] RBAC: Authorizing `identity:create_grant(project_id=9613de9a3bc9461d9d348e5b66b8d684, user_id=2d674fd1d6ab43ab982b66bb2349b625, role_id=10053e4259ae4b3bbbdbefa96320c937)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:57.438296 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ef029-3684-470f-bd9a-b77d4c6b81dd None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:57.448121 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afe618-54f1-4c33-a5bc-701209335d60 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:57.464198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 293/600] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:46:57 2022] PUT /identity/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/2d674fd1d6ab43ab982b66bb2349b625/roles/10053e4259ae4b3bbbdbefa96320c937 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:57.464198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef029-3684-470f-bd9a-b77d4c6b81dd None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:57.485773 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edde31b-ae29-4a6f-a4dc-6bc02bd2ee13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:57.486491 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edde31b-ae29-4a6f-a4dc-6bc02bd2ee13 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:57.486761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edde31b-ae29-4a6f-a4dc-6bc02bd2ee13 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:57.487023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edde31b-ae29-4a6f-a4dc-6bc02bd2ee13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:57.495116 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edde31b-ae29-4a6f-a4dc-6bc02bd2ee13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:57.496605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edde31b-ae29-4a6f-a4dc-6bc02bd2ee13 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:57.511921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-3edde31b-ae29-4a6f-a4dc-6bc02bd2ee13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:57.511921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:57.511921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:57.511921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:57.511921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:57.511921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:57.511921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:57.511921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:57.511921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:57.511921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:57.511921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:57.511921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:57.511921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:46:57.511921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:46:57.511921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:46:57.512918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:46:57.512918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:57.512918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:57.512918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:57.512918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:57.512918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:57.512918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:57.512918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:57.512918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:57.512918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:57.512918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:57.512918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:57.512918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:57.512918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:57.512918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:57.512918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:57.512918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:57.513829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:46:57.513829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:46:57.513829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:46:57.513829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:46:57.513829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:46:57.513829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:46:57.513829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:57.513829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:57.518223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 308/601] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:57.519664 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ae39b-a479-4240-aeb9-51f0a1e46640 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:57.519947 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ae39b-a479-4240-aeb9-51f0a1e46640 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:57.520240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ae39b-a479-4240-aeb9-51f0a1e46640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:57.538124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-aa8ae39b-a479-4240-aeb9-51f0a1e46640 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:57.539344 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-aa8ae39b-a479-4240-aeb9-51f0a1e46640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:57.579948 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef029-3684-470f-bd9a-b77d4c6b81dd None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:57.612042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 309/602] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:46:57.612938 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ae39b-a479-4240-aeb9-51f0a1e46640 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:57.625887 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1872f-0283-463b-8a4d-4a7148aa750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:57.626704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1872f-0283-463b-8a4d-4a7148aa750c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:57.626986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1872f-0283-463b-8a4d-4a7148aa750c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:57.627256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1872f-0283-463b-8a4d-4a7148aa750c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:57.650522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1872f-0283-463b-8a4d-4a7148aa750c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:57.651991 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1872f-0283-463b-8a4d-4a7148aa750c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:57.673445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-ffe1872f-0283-463b-8a4d-4a7148aa750c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:57.673445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:57.673445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:57.673445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:57.673445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:57.673445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:57.673445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:57.673445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:57.673445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:57.673445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:57.673445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:57.673445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:57.673445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:57.673445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:57.673445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:57.674429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:57.674429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:57.674429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:57.674429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:57.674429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:57.674429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:57.674429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:57.674429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:57.674429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:57.674429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:57.674429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:57.674429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:57.674429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:57.674429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:57.674429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:57.674429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:57.674429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:57.675430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:57.675430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:57.675430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:57.675430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:57.675430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 294/603] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:57.675879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1872f-0283-463b-8a4d-4a7148aa750c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:57.716586 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ae39b-a479-4240-aeb9-51f0a1e46640 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:57.750086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c36ee-d1b9-4f7e-aee3-82886695e7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:57.750970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c36ee-d1b9-4f7e-aee3-82886695e7f5 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:57.751391 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c36ee-d1b9-4f7e-aee3-82886695e7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:57.751827 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c36ee-d1b9-4f7e-aee3-82886695e7f5 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:57.752781 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c36ee-d1b9-4f7e-aee3-82886695e7f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:57.753243 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c36ee-d1b9-4f7e-aee3-82886695e7f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:57.754780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c36ee-d1b9-4f7e-aee3-82886695e7f5 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:57.767692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 310/604] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:46:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:57.772923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c36ee-d1b9-4f7e-aee3-82886695e7f5 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:57.775701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1872f-0283-463b-8a4d-4a7148aa750c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:57.813989 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729cdd8-8944-4011-b533-6fca8945107c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:57.814795 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729cdd8-8944-4011-b533-6fca8945107c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:57.815075 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729cdd8-8944-4011-b533-6fca8945107c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:57.815339 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729cdd8-8944-4011-b533-6fca8945107c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:57.828480 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729cdd8-8944-4011-b533-6fca8945107c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:46:57.839451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-2729cdd8-8944-4011-b533-6fca8945107c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:57.839451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:57.839451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:57.839451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:57.839451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:57.839451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:57.839451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:57.839451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:57.839451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:57.839451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:57.839451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:57.839451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:57.839451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:46:57.839451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:46:57.839451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:46:57.839451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:46:57.840668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:46:57.840668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:46:57.840668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:46:57.840668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:46:57.840668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:57.840668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:57.840668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:57.840668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:57.840668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:57.840668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:57.840668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:57.840668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:57.840668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:57.840668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:57.840668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:57.840668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:57.841526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:57.841526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:57.841526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:57.841526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:57.841526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:46:57.841526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:46:57.841526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:46:57.841526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:46:57.841526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:46:57.841526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:46:57.841526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:46:57.841526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:57.841526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 295/605] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:46:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:57.842249 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729cdd8-8944-4011-b533-6fca8945107c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:57.879825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c36ee-d1b9-4f7e-aee3-82886695e7f5 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:57.920555 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2c40c-7f2d-4d5b-bac0-98cc7946b4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:57.921524 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2c40c-7f2d-4d5b-bac0-98cc7946b4c8 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:57.921818 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2c40c-7f2d-4d5b-bac0-98cc7946b4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:57.922096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2c40c-7f2d-4d5b-bac0-98cc7946b4c8 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:57.923094 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2c40c-7f2d-4d5b-bac0-98cc7946b4c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:57.923404 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2c40c-7f2d-4d5b-bac0-98cc7946b4c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:57.924773 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2c40c-7f2d-4d5b-bac0-98cc7946b4c8 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:57.938650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 311/606] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:57.940828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2c40c-7f2d-4d5b-bac0-98cc7946b4c8 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:57.966236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729cdd8-8944-4011-b533-6fca8945107c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:57.999923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d25a0-03ad-40cc-9786-046c493a7921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:58.001254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d25a0-03ad-40cc-9786-046c493a7921 None admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:58.001739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d25a0-03ad-40cc-9786-046c493a7921 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:58.002203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d25a0-03ad-40cc-9786-046c493a7921 None admin] PATH_INFO: `/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/930f350dad954c7783f479bbb25c1f46/roles/10053e4259ae4b3bbbdbefa96320c937` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:58.023692 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d25a0-03ad-40cc-9786-046c493a7921 None admin] RBAC: Authorizing `identity:create_grant(project_id=9613de9a3bc9461d9d348e5b66b8d684, user_id=930f350dad954c7783f479bbb25c1f46, role_id=10053e4259ae4b3bbbdbefa96320c937)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:58.026084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d25a0-03ad-40cc-9786-046c493a7921 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:58.050175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 296/607] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:46:57 2022] PUT /identity/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/930f350dad954c7783f479bbb25c1f46/roles/10053e4259ae4b3bbbdbefa96320c937 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:58.050175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d25a0-03ad-40cc-9786-046c493a7921 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:58.101617 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2c40c-7f2d-4d5b-bac0-98cc7946b4c8 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:58.200288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d25a0-03ad-40cc-9786-046c493a7921 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:58.205567 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cc3e9-5d76-41e4-b883-717276f8e8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:58.206261 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cc3e9-5d76-41e4-b883-717276f8e8cb None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:58.206546 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cc3e9-5d76-41e4-b883-717276f8e8cb None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:58.206820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cc3e9-5d76-41e4-b883-717276f8e8cb None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:58.207582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cc3e9-5d76-41e4-b883-717276f8e8cb None admin] RBAC: Adding query filter params (name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:58.207886 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cc3e9-5d76-41e4-b883-717276f8e8cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:58.209838 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cc3e9-5d76-41e4-b883-717276f8e8cb None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:58.231798 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 312/608] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:46:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:58.238760 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cc3e9-5d76-41e4-b883-717276f8e8cb None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:58.243610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d5783-8f29-4aa0-ab4a-9e1870d60805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:58.243610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d5783-8f29-4aa0-ab4a-9e1870d60805 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:58.243928 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d5783-8f29-4aa0-ab4a-9e1870d60805 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:58.244139 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d5783-8f29-4aa0-ab4a-9e1870d60805 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:58.251452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d5783-8f29-4aa0-ab4a-9e1870d60805 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:58.252916 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d5783-8f29-4aa0-ab4a-9e1870d60805 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:58.267161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-7b1d5783-8f29-4aa0-ab4a-9e1870d60805 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:58.267161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:58.267161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:58.267161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:58.267161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:58.267161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:58.267161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:58.267161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:58.267161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:58.267161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:58.267161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:58.267161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:58.267161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:46:58.267161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:46:58.267161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:46:58.268150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:46:58.268150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:58.268150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:58.268150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:58.268150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:58.268150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:58.268150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:58.268150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:58.268150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:58.268150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:58.268150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:58.268150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:58.268150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:58.268150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:58.268150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:58.268150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:58.268150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:58.269211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:46:58.269211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:46:58.269211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:46:58.269211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:46:58.269211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:46:58.269211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:46:58.269211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:46:58.269211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:58.269211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 297/609] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:58.274828 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d5783-8f29-4aa0-ab4a-9e1870d60805 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:58.370310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cc3e9-5d76-41e4-b883-717276f8e8cb None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:58.391167 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d5783-8f29-4aa0-ab4a-9e1870d60805 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:58.413988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b4503-4820-4755-94b5-4edf5d03cdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:58.415187 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b4503-4820-4755-94b5-4edf5d03cdd6 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:58.415704 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b4503-4820-4755-94b5-4edf5d03cdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:58.416213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b4503-4820-4755-94b5-4edf5d03cdd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:58.422930 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134442d-44ee-4f8e-94da-859cc61caff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:58.423913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134442d-44ee-4f8e-94da-859cc61caff7 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:58.423913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134442d-44ee-4f8e-94da-859cc61caff7 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:58.424110 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134442d-44ee-4f8e-94da-859cc61caff7 None admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:58.424919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134442d-44ee-4f8e-94da-859cc61caff7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:58.425223 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134442d-44ee-4f8e-94da-859cc61caff7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:58.426800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134442d-44ee-4f8e-94da-859cc61caff7 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:58.429476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b4503-4820-4755-94b5-4edf5d03cdd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:58.431148 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b4503-4820-4755-94b5-4edf5d03cdd6 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:58.439565 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 298/610] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:46:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:58.448206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134442d-44ee-4f8e-94da-859cc61caff7 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:58.452982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-eb0b4503-4820-4755-94b5-4edf5d03cdd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:58.452982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:58.452982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:58.452982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:58.452982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:58.452982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:58.452982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:58.452982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:58.452982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:58.452982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:58.452982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:58.452982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:58.452982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:58.452982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:58.452982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:58.453876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:58.453876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:58.453876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:58.453876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:58.453876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:58.453876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:58.453876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:58.453876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:58.453876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:58.453876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:58.453876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:58.453876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:58.453876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:58.453876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:58.453876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:58.453876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:58.453876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:58.454776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:58.454776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:58.454776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:58.454776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:58.466937 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 313/611] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:46:58.474416 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b4503-4820-4755-94b5-4edf5d03cdd6 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:58.633412 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134442d-44ee-4f8e-94da-859cc61caff7 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:58.669555 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa74f4f-5429-4cd4-acdd-b894ddfcf275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:58.670445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa74f4f-5429-4cd4-acdd-b894ddfcf275 None admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:58.670720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa74f4f-5429-4cd4-acdd-b894ddfcf275 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:58.670989 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa74f4f-5429-4cd4-acdd-b894ddfcf275 None admin] PATH_INFO: `/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/7fc8efc2d5134bdba361a5c7bcfc1ffc/roles/10053e4259ae4b3bbbdbefa96320c937` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:58.673328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b4503-4820-4755-94b5-4edf5d03cdd6 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:58.694245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa74f4f-5429-4cd4-acdd-b894ddfcf275 None admin] RBAC: Authorizing `identity:create_grant(project_id=9613de9a3bc9461d9d348e5b66b8d684, user_id=7fc8efc2d5134bdba361a5c7bcfc1ffc, role_id=10053e4259ae4b3bbbdbefa96320c937)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:58.695689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa74f4f-5429-4cd4-acdd-b894ddfcf275 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:58.714409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 299/612] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:46:58 2022] PUT /identity/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/7fc8efc2d5134bdba361a5c7bcfc1ffc/roles/10053e4259ae4b3bbbdbefa96320c937 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:46:58.736219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fd855-271a-4979-b4e0-09cbc17d419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:58.736907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fd855-271a-4979-b4e0-09cbc17d419c None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:58.737182 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fd855-271a-4979-b4e0-09cbc17d419c None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:58.737449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fd855-271a-4979-b4e0-09cbc17d419c None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:58.738223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fd855-271a-4979-b4e0-09cbc17d419c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:58.738523 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fd855-271a-4979-b4e0-09cbc17d419c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:58.739908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fd855-271a-4979-b4e0-09cbc17d419c None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:58.757354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 314/613] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:46:58.762759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa74f4f-5429-4cd4-acdd-b894ddfcf275 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:58.892102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa74f4f-5429-4cd4-acdd-b894ddfcf275 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:58.942109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cd3f3-a43f-4f79-a444-38e326bdb4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:58.942935 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cd3f3-a43f-4f79-a444-38e326bdb4c0 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:58.943778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cd3f3-a43f-4f79-a444-38e326bdb4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:58.944057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cd3f3-a43f-4f79-a444-38e326bdb4c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:58.955197 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cd3f3-a43f-4f79-a444-38e326bdb4c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:58.956676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cd3f3-a43f-4f79-a444-38e326bdb4c0 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:58.971203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-f15cd3f3-a43f-4f79-a444-38e326bdb4c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:46:58.971203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:58.971203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:58.971203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:58.971203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:58.971203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:58.971203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:58.971203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:58.971203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:58.971203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:58.971203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:58.971203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:58.971203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:46:58.971203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:46:58.971203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:46:58.971203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:58.972234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:58.973206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:58.973206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:58.973206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:46:58.973206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:46:58.973206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:46:58.973206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:46:58.973206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:46:58.973206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:46:58.973206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:46:58.973206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:46:58.973206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 300/614] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 13:46:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:58.978585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fd855-271a-4979-b4e0-09cbc17d419c None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:59.081479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fd855-271a-4979-b4e0-09cbc17d419c None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:59.132145 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a4e3e-101a-49e7-82bd-a45673cf0054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:59.133668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a4e3e-101a-49e7-82bd-a45673cf0054 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:59.134158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a4e3e-101a-49e7-82bd-a45673cf0054 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:59.134658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a4e3e-101a-49e7-82bd-a45673cf0054 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:59.135706 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a4e3e-101a-49e7-82bd-a45673cf0054 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:59.136244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a4e3e-101a-49e7-82bd-a45673cf0054 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:59.137891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a4e3e-101a-49e7-82bd-a45673cf0054 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:59.162848 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 315/615] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 13:46:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:59.167826 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cd3f3-a43f-4f79-a444-38e326bdb4c0 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:59.327672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cd3f3-a43f-4f79-a444-38e326bdb4c0 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:59.371621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d68fb2-3076-4005-9c27-90344ec8b77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:59.372292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d68fb2-3076-4005-9c27-90344ec8b77b None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:59.372620 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d68fb2-3076-4005-9c27-90344ec8b77b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:59.372897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d68fb2-3076-4005-9c27-90344ec8b77b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:59.450446 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d68fb2-3076-4005-9c27-90344ec8b77b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:59.451826 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d68fb2-3076-4005-9c27-90344ec8b77b None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:59.549811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 301/616] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:46:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:46:59.557297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a4e3e-101a-49e7-82bd-a45673cf0054 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:59.716971 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a4e3e-101a-49e7-82bd-a45673cf0054 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:59.758843 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba6cfe-a56b-4151-b62e-bcb68a4d8aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:59.759651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba6cfe-a56b-4151-b62e-bcb68a4d8aba None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:59.759932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba6cfe-a56b-4151-b62e-bcb68a4d8aba None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:59.760225 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba6cfe-a56b-4151-b62e-bcb68a4d8aba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:59.770318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba6cfe-a56b-4151-b62e-bcb68a4d8aba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:59.771778 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba6cfe-a56b-4151-b62e-bcb68a4d8aba None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:59.789438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-8eba6cfe-a56b-4151-b62e-bcb68a4d8aba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:59.789438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:46:59.789438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:46:59.789438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:46:59.789438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:46:59.789438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:46:59.789438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:46:59.789438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:46:59.789438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:46:59.789438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:46:59.789438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:46:59.789438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:46:59.789438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:46:59.789438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:46:59.789438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:46:59.790355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:46:59.790355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:46:59.790355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:46:59.790355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:46:59.790355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:46:59.790355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:46:59.790355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:46:59.790355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:46:59.790355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:46:59.790355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:46:59.790355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:46:59.790355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:46:59.790355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:46:59.790355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:46:59.790355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:46:59.790355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:46:59.790355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:46:59.791249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:46:59.791249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:46:59.791249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:46:59.791249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:46:59.791249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 316/617] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:46:59.801251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d68fb2-3076-4005-9c27-90344ec8b77b None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:46:59.829153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc85c5a-af3f-4874-9729-1a9ecd0dae47 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:59.829480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc85c5a-af3f-4874-9729-1a9ecd0dae47 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:59.829716 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc85c5a-af3f-4874-9729-1a9ecd0dae47 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:59.831334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 317/618] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:46:59.850299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa0d6b-0c3c-47ee-897f-13aeb4ef233f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:59.850582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa0d6b-0c3c-47ee-897f-13aeb4ef233f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:59.850863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa0d6b-0c3c-47ee-897f-13aeb4ef233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:59.877186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-9bfa0d6b-0c3c-47ee-897f-13aeb4ef233f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:46:59.878381 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-9bfa0d6b-0c3c-47ee-897f-13aeb4ef233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:46:59.909809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d68fb2-3076-4005-9c27-90344ec8b77b None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:46:59.951617 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a585e-ad55-457c-8a74-74e38295cce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:46:59.952309 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a585e-ad55-457c-8a74-74e38295cce2 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:46:59.952587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a585e-ad55-457c-8a74-74e38295cce2 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:46:59.952858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a585e-ad55-457c-8a74-74e38295cce2 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:46:59.953581 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a585e-ad55-457c-8a74-74e38295cce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:46:59.953879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a585e-ad55-457c-8a74-74e38295cce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:46:59.955228 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a585e-ad55-457c-8a74-74e38295cce2 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:46:59.975029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 318/619] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:46:59.980499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 302/620] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:46:59.985732 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa0d6b-0c3c-47ee-897f-13aeb4ef233f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.003148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a585e-ad55-457c-8a74-74e38295cce2 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.096044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa0d6b-0c3c-47ee-897f-13aeb4ef233f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:00.136506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69124315-b4a4-43ed-b826-5a6cedb15663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:00.138106 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69124315-b4a4-43ed-b826-5a6cedb15663 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.138581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69124315-b4a4-43ed-b826-5a6cedb15663 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.139057 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69124315-b4a4-43ed-b826-5a6cedb15663 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.150914 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69124315-b4a4-43ed-b826-5a6cedb15663 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:00.152854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69124315-b4a4-43ed-b826-5a6cedb15663 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:00.182426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-69124315-b4a4-43ed-b826-5a6cedb15663 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:00.182426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:00.182426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:00.182426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:00.182426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:00.182426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:00.182426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:00.182426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:00.182426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:00.182426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:00.182426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:00.182426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:00.182426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:00.182426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:00.182426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:00.183376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:00.183376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:00.183376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:00.183376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:00.183376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:00.183376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:00.183376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:00.183376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:00.183376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:00.183376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:00.183376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:00.183376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:00.183376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:00.183376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:00.183376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:00.183376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:00.183376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:00.184299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:00.184299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:00.184299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:00.184299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:00.184299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:00.184299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:00.184299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:00.184299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:00.186751 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 319/621] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:46:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:00.197273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69124315-b4a4-43ed-b826-5a6cedb15663 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.205812 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a585e-ad55-457c-8a74-74e38295cce2 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:00.243781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a6468-c616-4c9e-a66c-ac8bd1ac2a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:00.244528 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6468-c616-4c9e-a66c-ac8bd1ac2a56 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.244807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6468-c616-4c9e-a66c-ac8bd1ac2a56 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.245076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6468-c616-4c9e-a66c-ac8bd1ac2a56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.255361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a6468-c616-4c9e-a66c-ac8bd1ac2a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:00.263514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-c65a6468-c616-4c9e-a66c-ac8bd1ac2a56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:00.263514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:00.263514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:00.263514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:00.263514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:00.263514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:00.263514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:00.263514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:00.263514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:00.263514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:00.263514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:00.263514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:00.263514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:00.263514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:00.263514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:00.263514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:00.264515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:00.264515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:00.264515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:00.264515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:00.264515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:00.264515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:00.264515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:00.264515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:00.264515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:00.264515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:00.264515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:00.264515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:00.264515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:00.264515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:00.264515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:00.264515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:00.265391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:00.265391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:00.265391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:00.265391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:00.265391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:00.265391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:00.265391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:00.265391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:00.265391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:00.265391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:00.265391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:00.265391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:00.265391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 303/622] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:47:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:00.266661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bd05a-a820-4446-9d8c-e2f0b235e39b None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.266763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bd05a-a820-4446-9d8c-e2f0b235e39b None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.266962 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bd05a-a820-4446-9d8c-e2f0b235e39b None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.268523 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 304/623] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:00.276193 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bd05a-a820-4446-9d8c-e2f0b235e39b None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.307376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69124315-b4a4-43ed-b826-5a6cedb15663 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:00.341341 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592da8f-aa1a-45eb-9ba3-426137ca0ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:00.342003 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592da8f-aa1a-45eb-9ba3-426137ca0ef6 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.342338 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592da8f-aa1a-45eb-9ba3-426137ca0ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.342669 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592da8f-aa1a-45eb-9ba3-426137ca0ef6 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.343450 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592da8f-aa1a-45eb-9ba3-426137ca0ef6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:00.343811 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592da8f-aa1a-45eb-9ba3-426137ca0ef6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:00.345260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592da8f-aa1a-45eb-9ba3-426137ca0ef6 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:00.357999 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 320/624] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:00.359480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f269b-f46f-41b6-acf1-8946dc9bda48 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.359767 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f269b-f46f-41b6-acf1-8946dc9bda48 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.360040 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f269b-f46f-41b6-acf1-8946dc9bda48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.378984 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-e30f269b-f46f-41b6-acf1-8946dc9bda48 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:00.381230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e30f269b-f46f-41b6-acf1-8946dc9bda48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:00.404435 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bd05a-a820-4446-9d8c-e2f0b235e39b None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:00.441311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bbc8c-8626-4a85-8f59-b9112e01aa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:00.442353 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bbc8c-8626-4a85-8f59-b9112e01aa3c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.442867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bbc8c-8626-4a85-8f59-b9112e01aa3c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.443420 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bbc8c-8626-4a85-8f59-b9112e01aa3c None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.444424 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bbc8c-8626-4a85-8f59-b9112e01aa3c None admin] RBAC: Adding query filter params (name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:00.444936 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bbc8c-8626-4a85-8f59-b9112e01aa3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:00.446527 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bbc8c-8626-4a85-8f59-b9112e01aa3c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:00.456108 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 305/626] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:47:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:00.457554 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bbc8c-8626-4a85-8f59-b9112e01aa3c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.459197 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 321/626] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:00.461830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f269b-f46f-41b6-acf1-8946dc9bda48 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.562681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bbc8c-8626-4a85-8f59-b9112e01aa3c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:00.580835 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f269b-f46f-41b6-acf1-8946dc9bda48 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:00.596950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac83e5-8a49-4448-99d4-4bd32878d138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:00.597933 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac83e5-8a49-4448-99d4-4bd32878d138 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.598423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac83e5-8a49-4448-99d4-4bd32878d138 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.598923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac83e5-8a49-4448-99d4-4bd32878d138 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.600053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac83e5-8a49-4448-99d4-4bd32878d138 None admin] RBAC: Adding query filter params (role.id=10053e4259ae4b3bbbdbefa96320c937, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=975f10f781b94bdaa8edee39a2b1bba4) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:00.600604 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac83e5-8a49-4448-99d4-4bd32878d138 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:00.602256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac83e5-8a49-4448-99d4-4bd32878d138 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:00.608801 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 306/627] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:47:00 2022] GET /identity/v3/role_assignments?user.id=975f10f781b94bdaa8edee39a2b1bba4&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=10053e4259ae4b3bbbdbefa96320c937 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:00.609956 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac83e5-8a49-4448-99d4-4bd32878d138 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.617039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c0791-101e-4880-a305-26981e7d6623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:00.617865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c0791-101e-4880-a305-26981e7d6623 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.618146 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c0791-101e-4880-a305-26981e7d6623 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.618422 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c0791-101e-4880-a305-26981e7d6623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.629405 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c0791-101e-4880-a305-26981e7d6623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:00.631534 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c0791-101e-4880-a305-26981e7d6623 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:00.650575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-783c0791-101e-4880-a305-26981e7d6623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:00.650575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:00.650575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:00.650575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:00.650575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:00.650575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:00.650575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:00.650575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:00.650575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:00.650575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:00.650575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:00.650575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:00.650575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:00.650575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:00.650575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:00.651588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:00.651588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:00.651588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:00.651588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:00.651588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:00.651588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:00.651588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:00.651588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:00.651588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:00.651588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:00.651588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:00.651588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:00.651588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:00.651588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:00.651588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:00.651588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:00.651588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:00.653221 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:00.653221 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:00.653221 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:00.653221 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:00.653221 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 322/628] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:00.661233 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c0791-101e-4880-a305-26981e7d6623 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.723502 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac83e5-8a49-4448-99d4-4bd32878d138 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:00.760271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753cefe-39a4-44b5-ad7d-7b5e88882f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:00.761482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753cefe-39a4-44b5-ad7d-7b5e88882f38 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.761971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753cefe-39a4-44b5-ad7d-7b5e88882f38 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.762463 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753cefe-39a4-44b5-ad7d-7b5e88882f38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.773973 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753cefe-39a4-44b5-ad7d-7b5e88882f38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:00.782610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-3753cefe-39a4-44b5-ad7d-7b5e88882f38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:00.782610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:00.782610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:00.782610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:00.782610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:00.782610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:00.782610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:00.782610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:00.782610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:00.782610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:00.782610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:00.782610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:00.782610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:00.782610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:00.782610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:00.782610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:00.783639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:00.783639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:00.783639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:00.783639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:00.783639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:00.783639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:00.783639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:00.783639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:00.783639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:00.783639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:00.783639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:00.783639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:00.783639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:00.783639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:00.783639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:00.783639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:00.784522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:00.784522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:00.784522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:00.784522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:00.784522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:00.784522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:00.784522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:00.784522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:00.784522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:00.784522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:00.784522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:00.784522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:00.787593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 307/629] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:47:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:00.789238 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22749683-0453-474d-93af-cef73625d7b8 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.789737 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22749683-0453-474d-93af-cef73625d7b8 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.790205 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22749683-0453-474d-93af-cef73625d7b8 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.792154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 308/630] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:00.793199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22749683-0453-474d-93af-cef73625d7b8 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.799854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c0791-101e-4880-a305-26981e7d6623 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:00.850366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9455d-5b7b-4822-b276-3f9c1b05dd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:00.852383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9455d-5b7b-4822-b276-3f9c1b05dd6f None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.852383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9455d-5b7b-4822-b276-3f9c1b05dd6f None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.852383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9455d-5b7b-4822-b276-3f9c1b05dd6f None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.852813 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9455d-5b7b-4822-b276-3f9c1b05dd6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:00.853256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9455d-5b7b-4822-b276-3f9c1b05dd6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:00.854601 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9455d-5b7b-4822-b276-3f9c1b05dd6f None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:00.870687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 323/631] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:00.871970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68878d9f-e678-48cb-9456-45d40decc438 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.872272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68878d9f-e678-48cb-9456-45d40decc438 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.872542 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68878d9f-e678-48cb-9456-45d40decc438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.890841 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-68878d9f-e678-48cb-9456-45d40decc438 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:00.892006 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-68878d9f-e678-48cb-9456-45d40decc438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:00.931919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22749683-0453-474d-93af-cef73625d7b8 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:00.969016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ddcb3-1464-4bb6-ae60-d8897f6a723d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:00.969715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ddcb3-1464-4bb6-ae60-d8897f6a723d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:00.969993 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ddcb3-1464-4bb6-ae60-d8897f6a723d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:00.970264 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ddcb3-1464-4bb6-ae60-d8897f6a723d None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:00.970802 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 324/632] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:00.971014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ddcb3-1464-4bb6-ae60-d8897f6a723d None admin] RBAC: Adding query filter params (name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:00.971319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ddcb3-1464-4bb6-ae60-d8897f6a723d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:00.971666 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68878d9f-e678-48cb-9456-45d40decc438 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:00.972824 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ddcb3-1464-4bb6-ae60-d8897f6a723d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:00.981827 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 309/633] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:47:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:00.987106 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ddcb3-1464-4bb6-ae60-d8897f6a723d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:01.080296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68878d9f-e678-48cb-9456-45d40decc438 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:01.105383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ddcb3-1464-4bb6-ae60-d8897f6a723d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:01.114292 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48459f7c-8c9e-4544-87ab-f965fa8729da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:01.115635 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48459f7c-8c9e-4544-87ab-f965fa8729da None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.118010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48459f7c-8c9e-4544-87ab-f965fa8729da None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.118296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48459f7c-8c9e-4544-87ab-f965fa8729da None admin] PATH_INFO: `/v3/users/swift` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.127602 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48459f7c-8c9e-4544-87ab-f965fa8729da None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:01.129070 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48459f7c-8c9e-4544-87ab-f965fa8729da None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:01.143802 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c2e48-a51a-43de-940e-00d3a48c1c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:01.144636 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c2e48-a51a-43de-940e-00d3a48c1c8b None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.144917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c2e48-a51a-43de-940e-00d3a48c1c8b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.145189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c2e48-a51a-43de-940e-00d3a48c1c8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.148639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-48459f7c-8c9e-4544-87ab-f965fa8729da None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 13:47:01.148639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:01.148639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:01.148639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:01.148639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:01.148639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:01.148639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:01.148639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:01.148639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:01.148639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:01.148639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:01.148639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:01.148639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:01.148639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:01.148639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:01.148639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:01.149891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:01.150932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:01.150932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:01.150932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:01.150932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:01.150932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:01.150932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:01.150932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:01.150932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:01.150932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 13:47:01.150932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:01.154557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 325/634] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:47:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:01.155438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48459f7c-8c9e-4544-87ab-f965fa8729da None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:01.156417 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c2e48-a51a-43de-940e-00d3a48c1c8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:01.158251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c2e48-a51a-43de-940e-00d3a48c1c8b None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:01.181230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-6d6c2e48-a51a-43de-940e-00d3a48c1c8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:01.181230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:01.181230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:01.181230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:01.181230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:01.181230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:01.181230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:01.181230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:01.181230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:01.181230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:01.181230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:01.181230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:01.181230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:01.181230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:01.181230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:01.183121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:01.183121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:01.183121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:01.183121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:01.183121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:01.183121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:01.183121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:01.183121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:01.183121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:01.183121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:01.183121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:01.183121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:01.183121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:01.183121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:01.183121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:01.183121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:01.183121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:01.185080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:01.185080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:01.185080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:01.185080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:01.185080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 310/635] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:01.185080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c2e48-a51a-43de-940e-00d3a48c1c8b None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:01.278895 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48459f7c-8c9e-4544-87ab-f965fa8729da None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:01.300129 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c2e48-a51a-43de-940e-00d3a48c1c8b None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:01.317277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f995d-76ba-4b60-a1bb-736975f4f930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:01.318859 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f995d-76ba-4b60-a1bb-736975f4f930 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.319482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f995d-76ba-4b60-a1bb-736975f4f930 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.319767 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f995d-76ba-4b60-a1bb-736975f4f930 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.335774 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f995d-76ba-4b60-a1bb-736975f4f930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:01.338710 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f595c7-bfbd-4da5-ba58-96dca83cada6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:01.339459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f595c7-bfbd-4da5-ba58-96dca83cada6 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.339743 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f595c7-bfbd-4da5-ba58-96dca83cada6 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.340021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f595c7-bfbd-4da5-ba58-96dca83cada6 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.341016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f595c7-bfbd-4da5-ba58-96dca83cada6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:01.341329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f595c7-bfbd-4da5-ba58-96dca83cada6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:01.342825 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f595c7-bfbd-4da5-ba58-96dca83cada6 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:01.343729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-002f995d-76ba-4b60-a1bb-736975f4f930 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:01.343729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:01.343729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:01.343729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:01.343729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:01.343729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:01.343729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:01.343729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:01.343729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:01.343729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:01.343729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:01.343729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:01.343729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:01.343729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:01.343729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:01.343729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:01.345709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:01.345709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:01.345709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:01.345709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:01.345709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:01.345709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:01.345709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:01.345709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:01.345709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:01.345709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:01.345709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:01.345709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:01.345709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:01.345709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:01.345709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:01.345709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:01.347107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:01.347107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:01.347107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:01.347107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:01.347107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:01.347107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:01.347107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:01.347107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:01.347107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:01.347107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:01.347107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:01.347107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:01.347107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 326/636] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:47:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:01.347107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f995d-76ba-4b60-a1bb-736975f4f930 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:01.368362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 311/637] 10.222.0.49 () {56 vars in 1135 bytes} [Tue May 10 13:47:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:01.368362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f595c7-bfbd-4da5-ba58-96dca83cada6 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:01.481529 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f595c7-bfbd-4da5-ba58-96dca83cada6 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:01.483469 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f995d-76ba-4b60-a1bb-736975f4f930 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:01.515191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec7482-70a8-46c2-ac70-05a0efb1d4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:01.516130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec7482-70a8-46c2-ac70-05a0efb1d4fc None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.516607 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec7482-70a8-46c2-ac70-05a0efb1d4fc None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.517031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec7482-70a8-46c2-ac70-05a0efb1d4fc None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.517916 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec7482-70a8-46c2-ac70-05a0efb1d4fc None admin] RBAC: Adding query filter params (name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:01.518371 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec7482-70a8-46c2-ac70-05a0efb1d4fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:01.519888 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec7482-70a8-46c2-ac70-05a0efb1d4fc None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:01.524542 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befff20f-8f04-433d-a01a-b9d162a45779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:01.525213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befff20f-8f04-433d-a01a-b9d162a45779 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.525485 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befff20f-8f04-433d-a01a-b9d162a45779 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.525764 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befff20f-8f04-433d-a01a-b9d162a45779 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.526498 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befff20f-8f04-433d-a01a-b9d162a45779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:01.526786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befff20f-8f04-433d-a01a-b9d162a45779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:01.528132 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befff20f-8f04-433d-a01a-b9d162a45779 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:01.528708 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 312/638] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:47:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:01.532216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec7482-70a8-46c2-ac70-05a0efb1d4fc None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:01.541809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 327/639] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:01.543296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202152f-0767-415f-8189-a7b95ad6ec33 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.543581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202152f-0767-415f-8189-a7b95ad6ec33 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.543862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202152f-0767-415f-8189-a7b95ad6ec33 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.545119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 328/640] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:01.545863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202152f-0767-415f-8189-a7b95ad6ec33 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:01.633841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec7482-70a8-46c2-ac70-05a0efb1d4fc None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:01.644808 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202152f-0767-415f-8189-a7b95ad6ec33 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:01.667358 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60fc96-932f-4d32-9f36-7edef3a93a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:01.668153 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60fc96-932f-4d32-9f36-7edef3a93a64 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.668466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60fc96-932f-4d32-9f36-7edef3a93a64 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.668745 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60fc96-932f-4d32-9f36-7edef3a93a64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.679064 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60fc96-932f-4d32-9f36-7edef3a93a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:01.679347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c34ae-0033-413c-8510-4a6cf9c6fcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:01.680139 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c34ae-0033-413c-8510-4a6cf9c6fcb3 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.680447 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c34ae-0033-413c-8510-4a6cf9c6fcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.680545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60fc96-932f-4d32-9f36-7edef3a93a64 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:01.680724 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c34ae-0033-413c-8510-4a6cf9c6fcb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.690420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c34ae-0033-413c-8510-4a6cf9c6fcb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:01.691847 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c34ae-0033-413c-8510-4a6cf9c6fcb3 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:01.697796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-dd60fc96-932f-4d32-9f36-7edef3a93a64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:01.697796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:01.697796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:01.697796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:01.697796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:01.697796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:01.697796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:01.697796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:01.697796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:01.697796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:01.697796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:01.697796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:01.697796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:01.697796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:01.697796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:01.698656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:01.698656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:01.698656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:01.698656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:01.698656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:01.698656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:01.698656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:01.698656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:01.698656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:01.698656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:01.698656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:01.698656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:01.698656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:01.698656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:01.698656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:01.698656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:01.698656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:01.699601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:01.699601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:01.699601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:01.699601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:01.703647 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 313/641] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:01.704382 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60fc96-932f-4d32-9f36-7edef3a93a64 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:01.711595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-6e4c34ae-0033-413c-8510-4a6cf9c6fcb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:01.711595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:01.711595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:01.711595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:01.711595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:01.711595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:01.711595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:01.711595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:01.711595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:01.711595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:01.711595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:01.711595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:01.711595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:01.711595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:01.711595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:01.712648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:01.712648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:01.712648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:01.712648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:01.712648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:01.712648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:01.712648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:01.712648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:01.712648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:01.712648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:01.712648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:01.712648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:01.712648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:01.712648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:01.712648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:01.712648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:01.712648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:01.718438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:01.718438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:01.718438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:01.718438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:01.718438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 329/642] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:01.718438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab32b-50f3-40d2-9bde-e302be90fa11 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.718438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab32b-50f3-40d2-9bde-e302be90fa11 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.718438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab32b-50f3-40d2-9bde-e302be90fa11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.731994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-2a3ab32b-50f3-40d2-9bde-e302be90fa11 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:01.733189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-2a3ab32b-50f3-40d2-9bde-e302be90fa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:01.799160 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 330/643] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:01.799973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ab32b-50f3-40d2-9bde-e302be90fa11 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:01.820701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60fc96-932f-4d32-9f36-7edef3a93a64 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:01.853075 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a430d8-99ec-411b-b7fe-b4a25a2bdd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:01.853973 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a430d8-99ec-411b-b7fe-b4a25a2bdd26 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.854322 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a430d8-99ec-411b-b7fe-b4a25a2bdd26 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.854669 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a430d8-99ec-411b-b7fe-b4a25a2bdd26 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.861970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a430d8-99ec-411b-b7fe-b4a25a2bdd26 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:01.863480 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a430d8-99ec-411b-b7fe-b4a25a2bdd26 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:01.877674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-a1a430d8-99ec-411b-b7fe-b4a25a2bdd26 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 13:47:01.877674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:01.877674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:01.877674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:01.877674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:01.877674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:01.877674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:01.877674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:01.877674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:01.877674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:01.877674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:01.877674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:01.877674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:01.877674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:01.877674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:01.877674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:01.878622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:01.879642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:01.879642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:01.879642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:01.879642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:01.879642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:01.879642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:01.879642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:01.879642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:01.879642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 13:47:01.879642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:01.879642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 314/644] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:47:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:01.879642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a430d8-99ec-411b-b7fe-b4a25a2bdd26 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:01.906910 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ab32b-50f3-40d2-9bde-e302be90fa11 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:01.940805 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b14faa-f51b-4214-af9a-c25069f3ee53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:01.941465 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b14faa-f51b-4214-af9a-c25069f3ee53 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:01.941748 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b14faa-f51b-4214-af9a-c25069f3ee53 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:01.942023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b14faa-f51b-4214-af9a-c25069f3ee53 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:01.942734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b14faa-f51b-4214-af9a-c25069f3ee53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:01.943092 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b14faa-f51b-4214-af9a-c25069f3ee53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:01.944466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b14faa-f51b-4214-af9a-c25069f3ee53 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:01.961026 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 331/645] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:01.962053 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b14faa-f51b-4214-af9a-c25069f3ee53 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:01.976909 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a430d8-99ec-411b-b7fe-b4a25a2bdd26 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:02.010732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a85811-bf7b-4675-a246-1a32de1fbe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:02.011383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a85811-bf7b-4675-a246-1a32de1fbe43 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:02.011665 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a85811-bf7b-4675-a246-1a32de1fbe43 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:02.011943 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a85811-bf7b-4675-a246-1a32de1fbe43 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:02.012689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a85811-bf7b-4675-a246-1a32de1fbe43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:02.012990 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a85811-bf7b-4675-a246-1a32de1fbe43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:02.014345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a85811-bf7b-4675-a246-1a32de1fbe43 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:02.025667 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 315/646] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:02.026456 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a85811-bf7b-4675-a246-1a32de1fbe43 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:02.074694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b14faa-f51b-4214-af9a-c25069f3ee53 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:02.112857 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec03629-46fc-4010-be2d-0993eb77fe7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:02.113658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec03629-46fc-4010-be2d-0993eb77fe7f None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:02.113936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec03629-46fc-4010-be2d-0993eb77fe7f None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:02.114205 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec03629-46fc-4010-be2d-0993eb77fe7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:02.124515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a85811-bf7b-4675-a246-1a32de1fbe43 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:02.124775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec03629-46fc-4010-be2d-0993eb77fe7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:02.132463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-bec03629-46fc-4010-be2d-0993eb77fe7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:02.132463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:02.132463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:02.132463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:02.132463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:02.132463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:02.132463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:02.132463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:02.132463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:02.132463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:02.132463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:02.132463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:02.132463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:02.132463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:02.132463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:02.132463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:02.133431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:02.133431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:02.133431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:02.133431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:02.133431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:02.133431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:02.133431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:02.133431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:02.133431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:02.133431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:02.133431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:02.133431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:02.133431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:02.133431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:02.133431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:02.133431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:02.134335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:02.134335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:02.134335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:02.134335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:02.134335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:02.134335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:02.134335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:02.134335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:02.134335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:02.134335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:02.134335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:02.134335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:02.134335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 332/647] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:47:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:02.135062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec03629-46fc-4010-be2d-0993eb77fe7f None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:02.162917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65196b8d-1718-4c63-8eb7-edd310c93e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:02.163510 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65196b8d-1718-4c63-8eb7-edd310c93e46 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:02.163790 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65196b8d-1718-4c63-8eb7-edd310c93e46 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:02.164061 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65196b8d-1718-4c63-8eb7-edd310c93e46 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:02.164936 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65196b8d-1718-4c63-8eb7-edd310c93e46 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:02.165236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65196b8d-1718-4c63-8eb7-edd310c93e46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:02.166646 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65196b8d-1718-4c63-8eb7-edd310c93e46 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:02.183495 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 316/648] 10.222.0.49 () {56 vars in 1137 bytes} [Tue May 10 13:47:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:02.184322 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65196b8d-1718-4c63-8eb7-edd310c93e46 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:02.237646 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec03629-46fc-4010-be2d-0993eb77fe7f None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:02.273301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbf01e-f770-4b25-8b98-099fa4763eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:02.274252 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbf01e-f770-4b25-8b98-099fa4763eec None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:02.274835 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbf01e-f770-4b25-8b98-099fa4763eec None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:02.275119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbf01e-f770-4b25-8b98-099fa4763eec None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:02.277455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65196b8d-1718-4c63-8eb7-edd310c93e46 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:02.289623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbf01e-f770-4b25-8b98-099fa4763eec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:02.289623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbf01e-f770-4b25-8b98-099fa4763eec None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:02.305858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-4fdbf01e-f770-4b25-8b98-099fa4763eec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:02.305858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:02.305858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:02.305858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:02.305858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:02.305858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:02.305858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:02.305858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:02.305858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:02.305858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:02.305858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:02.305858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:02.305858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:02.305858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:02.305858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:02.306900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:02.306900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:02.306900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:02.306900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:02.306900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:02.306900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:02.306900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:02.306900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:02.306900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:02.306900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:02.306900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:02.306900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:02.306900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:02.306900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:02.306900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:02.306900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:02.306900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:02.307816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:02.307816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:02.307816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:02.307816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:02.307816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:02.307816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:02.307816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:02.307816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:02.307816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 333/649] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:02.307816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbf01e-f770-4b25-8b98-099fa4763eec None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:02.321263 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85241b7c-897e-47b2-b248-0015ebeb39dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:02.322169 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85241b7c-897e-47b2-b248-0015ebeb39dd None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:02.322523 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85241b7c-897e-47b2-b248-0015ebeb39dd None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:02.322868 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85241b7c-897e-47b2-b248-0015ebeb39dd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:02.329946 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85241b7c-897e-47b2-b248-0015ebeb39dd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:02.331371 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85241b7c-897e-47b2-b248-0015ebeb39dd None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:02.345544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-85241b7c-897e-47b2-b248-0015ebeb39dd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 13:47:02.345544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:02.345544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:02.345544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:02.345544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:02.345544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:02.345544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:02.345544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:02.345544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:02.345544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:02.345544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:02.345544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:02.345544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:02.345544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:02.345544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:02.345544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:02.346513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:02.347493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:02.347493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:02.347493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:02.347493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:02.347493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:02.347493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:02.347493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:02.347493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:02.347493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 13:47:02.347493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:02.347493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 317/650] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:47:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:02.347493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85241b7c-897e-47b2-b248-0015ebeb39dd None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:02.413599 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbf01e-f770-4b25-8b98-099fa4763eec None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:02.450374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaecae-192b-40db-a86c-77216a160589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:02.451044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaecae-192b-40db-a86c-77216a160589 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:02.451322 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaecae-192b-40db-a86c-77216a160589 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:02.451594 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaecae-192b-40db-a86c-77216a160589 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:02.452360 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaecae-192b-40db-a86c-77216a160589 None admin] RBAC: Adding query filter params (name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:02.452664 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaecae-192b-40db-a86c-77216a160589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:02.453999 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaecae-192b-40db-a86c-77216a160589 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:02.457599 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85241b7c-897e-47b2-b248-0015ebeb39dd None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:02.462501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 334/651] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:47:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:02.463292 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaecae-192b-40db-a86c-77216a160589 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:02.493520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7afe8e-a767-4c25-a4ca-ca6d7ba0015a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:02.494411 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7afe8e-a767-4c25-a4ca-ca6d7ba0015a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:02.494860 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7afe8e-a767-4c25-a4ca-ca6d7ba0015a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:02.495307 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7afe8e-a767-4c25-a4ca-ca6d7ba0015a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:02.558799 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaecae-192b-40db-a86c-77216a160589 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:02.560074 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7afe8e-a767-4c25-a4ca-ca6d7ba0015a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:02.561554 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7afe8e-a767-4c25-a4ca-ca6d7ba0015a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:02.591576 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72208a5-f583-439e-ac53-521be39fa45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:02.592611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72208a5-f583-439e-ac53-521be39fa45b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:02.593043 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72208a5-f583-439e-ac53-521be39fa45b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:02.593319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72208a5-f583-439e-ac53-521be39fa45b None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:02.594104 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72208a5-f583-439e-ac53-521be39fa45b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:02.594406 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72208a5-f583-439e-ac53-521be39fa45b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:02.595885 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72208a5-f583-439e-ac53-521be39fa45b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:02.612640 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 335/652] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:02.612640 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72208a5-f583-439e-ac53-521be39fa45b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:02.660356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 318/653] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:47:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:02.661372 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7afe8e-a767-4c25-a4ca-ca6d7ba0015a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:02.720611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72208a5-f583-439e-ac53-521be39fa45b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:02.754765 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d54de-ba54-476a-8e8b-f733de09fd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:02.755455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d54de-ba54-476a-8e8b-f733de09fd0f None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:02.755739 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d54de-ba54-476a-8e8b-f733de09fd0f None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:02.756018 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d54de-ba54-476a-8e8b-f733de09fd0f None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:02.756884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d54de-ba54-476a-8e8b-f733de09fd0f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:02.757187 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d54de-ba54-476a-8e8b-f733de09fd0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:02.758592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d54de-ba54-476a-8e8b-f733de09fd0f None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:02.762346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7afe8e-a767-4c25-a4ca-ca6d7ba0015a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:02.780339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 336/654] 10.222.0.49 () {56 vars in 1139 bytes} [Tue May 10 13:47:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:02.780339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d54de-ba54-476a-8e8b-f733de09fd0f None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:02.800330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79caafa8-abdc-4b39-9de8-2a6b7d7c1a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:02.801139 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79caafa8-abdc-4b39-9de8-2a6b7d7c1a4e None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:02.801390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79caafa8-abdc-4b39-9de8-2a6b7d7c1a4e None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:02.801665 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79caafa8-abdc-4b39-9de8-2a6b7d7c1a4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:02.811561 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79caafa8-abdc-4b39-9de8-2a6b7d7c1a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:02.813318 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79caafa8-abdc-4b39-9de8-2a6b7d7c1a4e None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:02.830363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-79caafa8-abdc-4b39-9de8-2a6b7d7c1a4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:02.830363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:02.830363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:02.830363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:02.830363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:02.830363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:02.830363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:02.830363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:02.830363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:02.830363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:02.830363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:02.830363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:02.830363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:02.830363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:02.830363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:02.831279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:02.831279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:02.831279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:02.831279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:02.831279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:02.831279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:02.831279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:02.831279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:02.831279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:02.831279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:02.831279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:02.831279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:02.831279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:02.831279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:02.831279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:02.831279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:02.831279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:02.832568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:02.832568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:02.832568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:02.832568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:02.832568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 319/655] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:02.832896 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79caafa8-abdc-4b39-9de8-2a6b7d7c1a4e None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:02.876608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d54de-ba54-476a-8e8b-f733de09fd0f None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:02.910636 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6c380-54b8-4b4f-bf4a-fa71ff9ad53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:02.911528 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6c380-54b8-4b4f-bf4a-fa71ff9ad53b None admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:02.911878 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6c380-54b8-4b4f-bf4a-fa71ff9ad53b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:02.912154 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6c380-54b8-4b4f-bf4a-fa71ff9ad53b None admin] PATH_INFO: `/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/d102155cd1bd4368ad272668da1651f4/roles/10053e4259ae4b3bbbdbefa96320c937` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:02.929580 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6c380-54b8-4b4f-bf4a-fa71ff9ad53b None admin] RBAC: Authorizing `identity:create_grant(project_id=9613de9a3bc9461d9d348e5b66b8d684, user_id=d102155cd1bd4368ad272668da1651f4, role_id=10053e4259ae4b3bbbdbefa96320c937)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:02.931297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6c380-54b8-4b4f-bf4a-fa71ff9ad53b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:02.936211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79caafa8-abdc-4b39-9de8-2a6b7d7c1a4e None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:02.945145 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 337/656] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:47:02 2022] PUT /identity/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/d102155cd1bd4368ad272668da1651f4/roles/10053e4259ae4b3bbbdbefa96320c937 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:47:02.945748 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6c380-54b8-4b4f-bf4a-fa71ff9ad53b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:02.982660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7a671-7550-4733-b81d-005e55969799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:02.984374 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7a671-7550-4733-b81d-005e55969799 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:02.984907 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7a671-7550-4733-b81d-005e55969799 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:02.985414 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7a671-7550-4733-b81d-005e55969799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:02.997001 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7a671-7550-4733-b81d-005e55969799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:02.998812 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7a671-7550-4733-b81d-005e55969799 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:03.018768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-e8d7a671-7550-4733-b81d-005e55969799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:03.018768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:03.018768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:03.018768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:03.018768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:03.018768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:03.018768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:03.018768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:03.018768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:03.018768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:03.018768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:03.018768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:03.018768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:03.018768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:03.018768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:03.019762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:03.019762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:03.019762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:03.019762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:03.019762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:03.019762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:03.019762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:03.019762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:03.019762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:03.019762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:03.019762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:03.019762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:03.019762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:03.019762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:03.019762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:03.019762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:03.019762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:03.021748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:03.021748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:03.021748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:03.021748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:03.028486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 320/657] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:03.029790 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7a671-7550-4733-b81d-005e55969799 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:03.053890 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6c380-54b8-4b4f-bf4a-fa71ff9ad53b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:03.090259 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789adfd-4d3e-4ec9-859b-709a21fa1fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:03.090891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789adfd-4d3e-4ec9-859b-709a21fa1fa2 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:03.091170 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789adfd-4d3e-4ec9-859b-709a21fa1fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:03.091434 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789adfd-4d3e-4ec9-859b-709a21fa1fa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:03.144023 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7a671-7550-4733-b81d-005e55969799 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:03.166388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789adfd-4d3e-4ec9-859b-709a21fa1fa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:03.169291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789adfd-4d3e-4ec9-859b-709a21fa1fa2 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:03.183335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51095fa-3b12-4a0f-9888-eefa5134cdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:03.183989 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51095fa-3b12-4a0f-9888-eefa5134cdff None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:03.184303 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51095fa-3b12-4a0f-9888-eefa5134cdff None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:03.184597 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51095fa-3b12-4a0f-9888-eefa5134cdff None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:03.185298 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51095fa-3b12-4a0f-9888-eefa5134cdff None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:03.185601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51095fa-3b12-4a0f-9888-eefa5134cdff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:03.186968 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51095fa-3b12-4a0f-9888-eefa5134cdff None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:03.198730 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 321/658] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:03.199592 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51095fa-3b12-4a0f-9888-eefa5134cdff None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:03.270675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 338/659] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:47:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:03.270675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4363ae8-d1b5-4a75-8e20-fd58719059dc None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:03.270675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4363ae8-d1b5-4a75-8e20-fd58719059dc None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:03.270675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4363ae8-d1b5-4a75-8e20-fd58719059dc None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:03.270675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 339/660] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:03.270675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4363ae8-d1b5-4a75-8e20-fd58719059dc None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:03.308698 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51095fa-3b12-4a0f-9888-eefa5134cdff None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:03.341479 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec02ae1-5234-456b-8ba6-6d7fdb6e3c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:03.342509 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec02ae1-5234-456b-8ba6-6d7fdb6e3c0d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:03.343023 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec02ae1-5234-456b-8ba6-6d7fdb6e3c0d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:03.343505 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec02ae1-5234-456b-8ba6-6d7fdb6e3c0d None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:03.344402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec02ae1-5234-456b-8ba6-6d7fdb6e3c0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:03.344858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec02ae1-5234-456b-8ba6-6d7fdb6e3c0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:03.346410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec02ae1-5234-456b-8ba6-6d7fdb6e3c0d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:03.358477 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 322/661] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:03.359541 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec02ae1-5234-456b-8ba6-6d7fdb6e3c0d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:03.373007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4363ae8-d1b5-4a75-8e20-fd58719059dc None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:03.407473 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587c94d-86fa-44ff-a759-94c1c02fc671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:03.408568 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587c94d-86fa-44ff-a759-94c1c02fc671 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:03.408993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587c94d-86fa-44ff-a759-94c1c02fc671 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:03.409447 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587c94d-86fa-44ff-a759-94c1c02fc671 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:03.416849 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587c94d-86fa-44ff-a759-94c1c02fc671 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:03.418433 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587c94d-86fa-44ff-a759-94c1c02fc671 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:03.435788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-1587c94d-86fa-44ff-a759-94c1c02fc671 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 13:47:03.435788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:03.435788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:03.435788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:03.435788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:03.435788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:03.435788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:03.435788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:03.435788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:03.435788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:03.435788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:03.435788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:03.435788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:03.435788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:03.435788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:03.435788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:03.436970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:03.438164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:03.438164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:03.438164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:03.438164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:03.438164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:03.438164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:03.438164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:03.438164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:03.438164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 13:47:03.438164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:03.440098 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 340/662] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:47:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:03.441437 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd3847-0814-4b6c-8b4c-9f8828ef8fe7 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:03.441885 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd3847-0814-4b6c-8b4c-9f8828ef8fe7 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:03.442303 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd3847-0814-4b6c-8b4c-9f8828ef8fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:03.459031 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-62fd3847-0814-4b6c-8b4c-9f8828ef8fe7 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:03.460760 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-62fd3847-0814-4b6c-8b4c-9f8828ef8fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:03.473917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec02ae1-5234-456b-8ba6-6d7fdb6e3c0d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:03.508601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6930a08-6092-42c3-8444-824a5bbaccd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:03.509391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6930a08-6092-42c3-8444-824a5bbaccd5 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:03.509668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6930a08-6092-42c3-8444-824a5bbaccd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:03.509942 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6930a08-6092-42c3-8444-824a5bbaccd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:03.519571 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6930a08-6092-42c3-8444-824a5bbaccd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:03.521137 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6930a08-6092-42c3-8444-824a5bbaccd5 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:03.526933 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 341/663] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:03.529062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd3847-0814-4b6c-8b4c-9f8828ef8fe7 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:03.544587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-b6930a08-6092-42c3-8444-824a5bbaccd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:03.544587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:03.544587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:03.544587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:03.544587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:03.544587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:03.544587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:03.544587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:03.544587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:03.544587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:03.544587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:03.544587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:03.544587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:03.544587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:03.544587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:03.545515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:03.545515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:03.545515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:03.545515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:03.545515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:03.545515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:03.545515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:03.545515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:03.545515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:03.545515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:03.545515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:03.545515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:03.545515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:03.545515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:03.545515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:03.545515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:03.545515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:03.546442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:03.546442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:03.546442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:03.546442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:03.550193 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 323/664] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:03.550910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6930a08-6092-42c3-8444-824a5bbaccd5 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:03.650874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd3847-0814-4b6c-8b4c-9f8828ef8fe7 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:03.661989 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6930a08-6092-42c3-8444-824a5bbaccd5 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:03.697618 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62fe24-5f3e-44ea-a99c-2aeb43817e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:03.697843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932261a9-8c39-4ead-9b81-4b83eab5a90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:03.698417 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62fe24-5f3e-44ea-a99c-2aeb43817e6c None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:03.698696 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62fe24-5f3e-44ea-a99c-2aeb43817e6c None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:03.698967 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62fe24-5f3e-44ea-a99c-2aeb43817e6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:03.699102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932261a9-8c39-4ead-9b81-4b83eab5a90d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:03.699591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932261a9-8c39-4ead-9b81-4b83eab5a90d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:03.700080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932261a9-8c39-4ead-9b81-4b83eab5a90d None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:03.701245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932261a9-8c39-4ead-9b81-4b83eab5a90d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:03.701696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932261a9-8c39-4ead-9b81-4b83eab5a90d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:03.703266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932261a9-8c39-4ead-9b81-4b83eab5a90d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:03.713252 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62fe24-5f3e-44ea-a99c-2aeb43817e6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:03.714826 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62fe24-5f3e-44ea-a99c-2aeb43817e6c None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:03.722010 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 324/665] 10.222.0.49 () {56 vars in 1137 bytes} [Tue May 10 13:47:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:03.723024 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932261a9-8c39-4ead-9b81-4b83eab5a90d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:03.739152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-5e62fe24-5f3e-44ea-a99c-2aeb43817e6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:03.739152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:03.739152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:03.739152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:03.739152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:03.739152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:03.739152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:03.739152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:03.739152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:03.739152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:03.739152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:03.739152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:03.739152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:03.739152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:03.739152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:03.740901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:03.740901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:03.740901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:03.740901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:03.740901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:03.740901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:03.740901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:03.740901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:03.740901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:03.740901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:03.740901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:03.740901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:03.740901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:03.740901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:03.740901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:03.740901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:03.740901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:03.741975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:03.741975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:03.741975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:03.741975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:03.741975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:03.741975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:03.741975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:03.741975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:03.745630 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 342/666] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:03.746477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62fe24-5f3e-44ea-a99c-2aeb43817e6c None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:03.823920 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932261a9-8c39-4ead-9b81-4b83eab5a90d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:03.846451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62fe24-5f3e-44ea-a99c-2aeb43817e6c None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:03.857323 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41ffc5-2d82-41a1-b7b2-4f3873024bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:03.858361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41ffc5-2d82-41a1-b7b2-4f3873024bbc None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:03.858856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41ffc5-2d82-41a1-b7b2-4f3873024bbc None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:03.859356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41ffc5-2d82-41a1-b7b2-4f3873024bbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:03.870852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41ffc5-2d82-41a1-b7b2-4f3873024bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:03.878953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-5a41ffc5-2d82-41a1-b7b2-4f3873024bbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:03.878953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:03.878953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:03.878953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:03.878953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:03.878953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:03.878953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:03.878953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:03.878953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:03.878953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:03.878953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:03.878953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:03.878953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:03.878953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:03.878953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:03.878953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:03.879908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:03.879908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:03.879908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:03.879908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:03.879908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:03.879908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:03.879908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:03.879908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:03.879908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:03.879908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:03.879908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:03.879908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:03.879908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:03.879908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:03.879908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:03.879908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:03.880862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:03.880862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:03.880862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:03.880862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:03.880862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:03.880862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:03.880862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:03.880862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:03.880862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:03.880862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:03.880862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:03.880862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:03.881613 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d2abb-2b1d-4aea-b880-fb6cd6c7fc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:03.882171 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2abb-2b1d-4aea-b880-fb6cd6c7fc69 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:03.882364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2abb-2b1d-4aea-b880-fb6cd6c7fc69 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:03.882641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2abb-2b1d-4aea-b880-fb6cd6c7fc69 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:03.883360 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d2abb-2b1d-4aea-b880-fb6cd6c7fc69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:03.883663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d2abb-2b1d-4aea-b880-fb6cd6c7fc69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:03.889018 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d2abb-2b1d-4aea-b880-fb6cd6c7fc69 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:03.889489 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 325/667] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:47:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:03.890576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41ffc5-2d82-41a1-b7b2-4f3873024bbc None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:03.903060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 343/668] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:03.904109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d2abb-2b1d-4aea-b880-fb6cd6c7fc69 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:04.002019 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41ffc5-2d82-41a1-b7b2-4f3873024bbc None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:04.012615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d2abb-2b1d-4aea-b880-fb6cd6c7fc69 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:04.034969 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25614e4-3215-4a7b-a431-8e64e85c5d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:04.035611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25614e4-3215-4a7b-a431-8e64e85c5d5c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.035892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25614e4-3215-4a7b-a431-8e64e85c5d5c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.036264 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25614e4-3215-4a7b-a431-8e64e85c5d5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.046078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8b4c9-af6e-4ec1-b1b8-eefb736998b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:04.046751 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8b4c9-af6e-4ec1-b1b8-eefb736998b3 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.047035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8b4c9-af6e-4ec1-b1b8-eefb736998b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.047312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8b4c9-af6e-4ec1-b1b8-eefb736998b3 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.048119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8b4c9-af6e-4ec1-b1b8-eefb736998b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:04.048459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8b4c9-af6e-4ec1-b1b8-eefb736998b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:04.049912 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8b4c9-af6e-4ec1-b1b8-eefb736998b3 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:04.068220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 344/669] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:04.068220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8b4c9-af6e-4ec1-b1b8-eefb736998b3 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:04.109895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25614e4-3215-4a7b-a431-8e64e85c5d5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:04.111266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25614e4-3215-4a7b-a431-8e64e85c5d5c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:04.171974 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8b4c9-af6e-4ec1-b1b8-eefb736998b3 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:04.205291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78961c4a-7eda-4db7-a56a-7de80a9d17ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:04.206275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78961c4a-7eda-4db7-a56a-7de80a9d17ae None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.206761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78961c4a-7eda-4db7-a56a-7de80a9d17ae None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.207117 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 326/670] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:47:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:04.207404 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78961c4a-7eda-4db7-a56a-7de80a9d17ae None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.207953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25614e4-3215-4a7b-a431-8e64e85c5d5c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:04.209032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78961c4a-7eda-4db7-a56a-7de80a9d17ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:04.209511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78961c4a-7eda-4db7-a56a-7de80a9d17ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:04.210857 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78961c4a-7eda-4db7-a56a-7de80a9d17ae None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:04.223246 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 345/671] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:47:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:04.223246 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78961c4a-7eda-4db7-a56a-7de80a9d17ae None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:04.310887 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25614e4-3215-4a7b-a431-8e64e85c5d5c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:04.315490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78961c4a-7eda-4db7-a56a-7de80a9d17ae None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:04.343744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542d3ae-e90b-40d4-9558-b87ef893bb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:04.344558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542d3ae-e90b-40d4-9558-b87ef893bb12 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.344897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542d3ae-e90b-40d4-9558-b87ef893bb12 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.345172 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542d3ae-e90b-40d4-9558-b87ef893bb12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.347742 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad4e52-6356-4bf1-b2fa-725f3446aaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:04.348416 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad4e52-6356-4bf1-b2fa-725f3446aaf0 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.348697 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad4e52-6356-4bf1-b2fa-725f3446aaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.348968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad4e52-6356-4bf1-b2fa-725f3446aaf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.350351 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad4e52-6356-4bf1-b2fa-725f3446aaf0 None admin] RBAC: Adding query filter params (role.id=10053e4259ae4b3bbbdbefa96320c937, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=2d674fd1d6ab43ab982b66bb2349b625) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:04.350659 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad4e52-6356-4bf1-b2fa-725f3446aaf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:04.352070 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad4e52-6356-4bf1-b2fa-725f3446aaf0 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:04.353610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542d3ae-e90b-40d4-9558-b87ef893bb12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:04.355172 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542d3ae-e90b-40d4-9558-b87ef893bb12 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:04.357957 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 346/672] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:47:04 2022] GET /identity/v3/role_assignments?user.id=2d674fd1d6ab43ab982b66bb2349b625&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=10053e4259ae4b3bbbdbefa96320c937 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:04.358535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad4e52-6356-4bf1-b2fa-725f3446aaf0 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:04.369757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-6542d3ae-e90b-40d4-9558-b87ef893bb12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:04.369757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:04.369757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:04.369757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:04.369757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:04.369757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:04.369757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:04.369757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:04.369757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:04.369757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:04.369757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:04.369757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:04.369757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:04.369757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:04.369757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:04.370970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:04.370970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:04.370970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:04.370970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:04.370970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:04.370970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:04.370970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:04.370970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:04.370970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:04.370970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:04.370970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:04.370970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:04.370970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:04.370970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:04.370970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:04.370970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:04.370970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:04.372084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:04.372084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:04.372084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:04.372084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:04.372084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:04.372084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:04.372084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:04.372084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:04.375823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 327/673] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:04.376819 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542d3ae-e90b-40d4-9558-b87ef893bb12 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:04.489451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542d3ae-e90b-40d4-9558-b87ef893bb12 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:04.503263 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad4e52-6356-4bf1-b2fa-725f3446aaf0 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:04.527114 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16127c45-57d2-4576-aa93-09f8d6b28890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:04.528341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16127c45-57d2-4576-aa93-09f8d6b28890 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.528879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16127c45-57d2-4576-aa93-09f8d6b28890 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.529339 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16127c45-57d2-4576-aa93-09f8d6b28890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.540292 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe6a34-a0ba-4b36-8dc7-8a1c1b8ab708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:04.541140 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe6a34-a0ba-4b36-8dc7-8a1c1b8ab708 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.541424 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe6a34-a0ba-4b36-8dc7-8a1c1b8ab708 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.541695 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe6a34-a0ba-4b36-8dc7-8a1c1b8ab708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.542429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16127c45-57d2-4576-aa93-09f8d6b28890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:04.544123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16127c45-57d2-4576-aa93-09f8d6b28890 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:04.554248 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe6a34-a0ba-4b36-8dc7-8a1c1b8ab708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:04.555705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe6a34-a0ba-4b36-8dc7-8a1c1b8ab708 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:04.563057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-16127c45-57d2-4576-aa93-09f8d6b28890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:04.563057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:04.563057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:04.563057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:04.563057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:04.563057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:04.563057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:04.563057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:04.563057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:04.563057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:04.563057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:04.563057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:04.563057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:04.563057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:04.563057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:04.564032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:04.564032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:04.564032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:04.564032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:04.564032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:04.564032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:04.564032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:04.564032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:04.564032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:04.564032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:04.564032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:04.564032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:04.564032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:04.564032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:04.564032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:04.564032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:04.564032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:04.572811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:04.572811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:04.572811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:04.572811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:04.572811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 328/674] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:04.572811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16127c45-57d2-4576-aa93-09f8d6b28890 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:04.574917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-cbbe6a34-a0ba-4b36-8dc7-8a1c1b8ab708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:04.574917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:04.574917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:04.574917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:04.574917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:04.574917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:04.574917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:04.574917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:04.574917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:04.574917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:04.574917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:04.574917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:04.574917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:04.574917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:04.574917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:04.575998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:04.575998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:04.575998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:04.575998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:04.575998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:04.575998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:04.575998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:04.575998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:04.575998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:04.575998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:04.575998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:04.575998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:04.575998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:04.575998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:04.575998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:04.575998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:04.575998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:04.577071 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:04.577071 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:04.577071 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:04.577071 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:04.577071 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 347/675] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:04.577688 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe6a34-a0ba-4b36-8dc7-8a1c1b8ab708 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:04.697111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe6a34-a0ba-4b36-8dc7-8a1c1b8ab708 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:04.698180 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16127c45-57d2-4576-aa93-09f8d6b28890 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:04.732740 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d68833-da29-4bf8-a01a-0a043545666e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:04.733752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d68833-da29-4bf8-a01a-0a043545666e None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.734233 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d68833-da29-4bf8-a01a-0a043545666e None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.734702 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d68833-da29-4bf8-a01a-0a043545666e None admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.735797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d68833-da29-4bf8-a01a-0a043545666e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:04.736389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d68833-da29-4bf8-a01a-0a043545666e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:04.738245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d68833-da29-4bf8-a01a-0a043545666e None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:04.738734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04639936-0bef-4cec-947e-35ad50e142d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:04.739394 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04639936-0bef-4cec-947e-35ad50e142d0 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.739673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04639936-0bef-4cec-947e-35ad50e142d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.739979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04639936-0bef-4cec-947e-35ad50e142d0 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.740722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04639936-0bef-4cec-947e-35ad50e142d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:04.741023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04639936-0bef-4cec-947e-35ad50e142d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:04.742915 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04639936-0bef-4cec-947e-35ad50e142d0 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:04.752486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 329/676] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:04.753643 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d68833-da29-4bf8-a01a-0a043545666e None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:04.760722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 348/677] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:04.762408 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04639936-0bef-4cec-947e-35ad50e142d0 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:04.858654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d68833-da29-4bf8-a01a-0a043545666e None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:04.886449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04639936-0bef-4cec-947e-35ad50e142d0 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:04.894475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdbb69-62a1-4bb6-a333-344cfd8e178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:04.895397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdbb69-62a1-4bb6-a333-344cfd8e178f None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.895843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdbb69-62a1-4bb6-a333-344cfd8e178f None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.896621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdbb69-62a1-4bb6-a333-344cfd8e178f None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.897586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdbb69-62a1-4bb6-a333-344cfd8e178f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:04.898086 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdbb69-62a1-4bb6-a333-344cfd8e178f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:04.899886 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdbb69-62a1-4bb6-a333-344cfd8e178f None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:04.912600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 330/678] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:04.913861 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdbb69-62a1-4bb6-a333-344cfd8e178f None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:04.925525 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d44b8a-2d7c-441e-ba4c-8e214751dffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:04.926182 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44b8a-2d7c-441e-ba4c-8e214751dffe None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:04.926460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44b8a-2d7c-441e-ba4c-8e214751dffe None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:04.926730 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44b8a-2d7c-441e-ba4c-8e214751dffe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:04.928461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d44b8a-2d7c-441e-ba4c-8e214751dffe None admin] RBAC: Adding query filter params (role.id=10053e4259ae4b3bbbdbefa96320c937, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=930f350dad954c7783f479bbb25c1f46) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:04.928788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d44b8a-2d7c-441e-ba4c-8e214751dffe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:04.930622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d44b8a-2d7c-441e-ba4c-8e214751dffe None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:04.940237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 349/679] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:47:04 2022] GET /identity/v3/role_assignments?user.id=930f350dad954c7783f479bbb25c1f46&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=10053e4259ae4b3bbbdbefa96320c937 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:04.941311 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d44b8a-2d7c-441e-ba4c-8e214751dffe None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:05.103955 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdbb69-62a1-4bb6-a333-344cfd8e178f None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:05.132382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d44b8a-2d7c-441e-ba4c-8e214751dffe None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:05.174996 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebf29f-37c9-44df-b345-32fae0a6af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:05.175811 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebf29f-37c9-44df-b345-32fae0a6af4c None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.176088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebf29f-37c9-44df-b345-32fae0a6af4c None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.176383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebf29f-37c9-44df-b345-32fae0a6af4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.187118 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52065a-5248-4960-8390-86860cfd7ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:05.187916 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52065a-5248-4960-8390-86860cfd7ec8 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.188212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52065a-5248-4960-8390-86860cfd7ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.188493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52065a-5248-4960-8390-86860cfd7ec8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.189777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebf29f-37c9-44df-b345-32fae0a6af4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:05.191211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebf29f-37c9-44df-b345-32fae0a6af4c None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:05.206382 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52065a-5248-4960-8390-86860cfd7ec8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:05.207862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52065a-5248-4960-8390-86860cfd7ec8 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:05.209198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-87ebf29f-37c9-44df-b345-32fae0a6af4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:05.209198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:05.209198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:05.209198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:05.209198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:05.209198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:05.209198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:05.209198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:05.209198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:05.209198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:05.209198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:05.209198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:05.209198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:05.209198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:05.209198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:05.212547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:05.212547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:05.212547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:05.212547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:05.212547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:05.212547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:05.212547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:05.212547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:05.212547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:05.212547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:05.212547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:05.212547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:05.212547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:05.212547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:05.212547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:05.212547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:05.212547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:05.213687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:05.213687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:05.213687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:05.213687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:05.213687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:05.213687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:05.213687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:05.213687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:05.213687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 350/680] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:05.213687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efd0e2-86be-4d56-bc3c-a19a19f1b686 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.213687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efd0e2-86be-4d56-bc3c-a19a19f1b686 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.214419 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efd0e2-86be-4d56-bc3c-a19a19f1b686 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.214419 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 351/681] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:05.217982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efd0e2-86be-4d56-bc3c-a19a19f1b686 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:05.232031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-ac52065a-5248-4960-8390-86860cfd7ec8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:47:05.232031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:05.232031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:05.232031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:05.232031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:05.232031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:05.232031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:05.232031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:05.232031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:05.232031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:05.232031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:05.232031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:05.232031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:05.232031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:05.232031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:05.232031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:05.234415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:05.234415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:05.234415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:05.234415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:05.234415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:05.234415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:05.234415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:05.234415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:05.234415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:47:05.234415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:05.234415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 331/682] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 13:47:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:05.235153 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffc8f3-440a-466c-b1f4-8efc80389b4e None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.235234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffc8f3-440a-466c-b1f4-8efc80389b4e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.235728 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffc8f3-440a-466c-b1f4-8efc80389b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.256320 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-e2ffc8f3-440a-466c-b1f4-8efc80389b4e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:05.257736 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-e2ffc8f3-440a-466c-b1f4-8efc80389b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:05.333777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efd0e2-86be-4d56-bc3c-a19a19f1b686 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:05.349915 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 332/683] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:05.350985 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffc8f3-440a-466c-b1f4-8efc80389b4e None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:05.399655 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d812e45-a685-42ac-bff0-f11dd8761a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:05.400087 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d812e45-a685-42ac-bff0-f11dd8761a65 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.400397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d812e45-a685-42ac-bff0-f11dd8761a65 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.400672 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d812e45-a685-42ac-bff0-f11dd8761a65 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.401455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d812e45-a685-42ac-bff0-f11dd8761a65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:05.401761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d812e45-a685-42ac-bff0-f11dd8761a65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:05.403157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d812e45-a685-42ac-bff0-f11dd8761a65 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:05.417074 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 352/684] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:05.422421 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d812e45-a685-42ac-bff0-f11dd8761a65 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:05.464754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffc8f3-440a-466c-b1f4-8efc80389b4e None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:05.499145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a2f54-316a-4a7c-8947-539c9f0cdde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:05.500224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a2f54-316a-4a7c-8947-539c9f0cdde4 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.500704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a2f54-316a-4a7c-8947-539c9f0cdde4 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.501173 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a2f54-316a-4a7c-8947-539c9f0cdde4 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.502190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a2f54-316a-4a7c-8947-539c9f0cdde4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:05.502698 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a2f54-316a-4a7c-8947-539c9f0cdde4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:05.504343 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a2f54-316a-4a7c-8947-539c9f0cdde4 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:05.517480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d812e45-a685-42ac-bff0-f11dd8761a65 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:05.521884 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 333/685] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 13:47:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:05.522913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a2f54-316a-4a7c-8947-539c9f0cdde4 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:05.551682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b28df6-d7f3-4a2e-aa74-dbe5b1a9d9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:05.553089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b28df6-d7f3-4a2e-aa74-dbe5b1a9d9ab None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.553365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b28df6-d7f3-4a2e-aa74-dbe5b1a9d9ab None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.553707 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b28df6-d7f3-4a2e-aa74-dbe5b1a9d9ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.564060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b28df6-d7f3-4a2e-aa74-dbe5b1a9d9ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:05.572080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-c5b28df6-d7f3-4a2e-aa74-dbe5b1a9d9ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:05.572080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:05.572080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:05.572080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:05.572080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:05.572080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:05.572080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:05.572080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:05.572080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:05.572080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:05.572080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:05.572080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:05.572080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:05.572080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:05.572080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:05.572080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:05.573056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:05.573056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:05.573056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:05.573056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:05.573056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:05.573056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:05.573056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:05.573056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:05.573056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:05.573056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:05.573056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:05.573056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:05.573056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:05.573056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:05.573056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:05.573056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:05.573906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:05.573906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:05.573906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:05.573906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:05.573906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:05.573906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:05.573906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:05.573906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:05.573906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:05.573906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:05.573906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:05.573906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:05.578332 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 353/686] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:47:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:05.579038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b28df6-d7f3-4a2e-aa74-dbe5b1a9d9ab None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:05.631098 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a2f54-316a-4a7c-8947-539c9f0cdde4 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:05.675104 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddd132-6b9c-4d1a-bf18-be5ca4a9b97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:05.675680 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddd132-6b9c-4d1a-bf18-be5ca4a9b97d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.675963 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddd132-6b9c-4d1a-bf18-be5ca4a9b97d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.676295 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddd132-6b9c-4d1a-bf18-be5ca4a9b97d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.677875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddd132-6b9c-4d1a-bf18-be5ca4a9b97d None admin] RBAC: Adding query filter params (role.id=10053e4259ae4b3bbbdbefa96320c937, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=7fc8efc2d5134bdba361a5c7bcfc1ffc) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:05.678388 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddd132-6b9c-4d1a-bf18-be5ca4a9b97d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:05.680341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddd132-6b9c-4d1a-bf18-be5ca4a9b97d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:05.694529 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 334/687] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:47:05 2022] GET /identity/v3/role_assignments?user.id=7fc8efc2d5134bdba361a5c7bcfc1ffc&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=10053e4259ae4b3bbbdbefa96320c937 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:05.694529 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddd132-6b9c-4d1a-bf18-be5ca4a9b97d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:05.709732 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b28df6-d7f3-4a2e-aa74-dbe5b1a9d9ab None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:05.751249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02728ae7-502f-43cb-b7f3-c7e4c66c0aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:05.751902 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02728ae7-502f-43cb-b7f3-c7e4c66c0aff None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.752192 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02728ae7-502f-43cb-b7f3-c7e4c66c0aff None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.752474 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02728ae7-502f-43cb-b7f3-c7e4c66c0aff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.826906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02728ae7-502f-43cb-b7f3-c7e4c66c0aff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:05.828404 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02728ae7-502f-43cb-b7f3-c7e4c66c0aff None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:05.925897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddd132-6b9c-4d1a-bf18-be5ca4a9b97d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:05.961517 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 354/688] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:47:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:05.966786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02728ae7-502f-43cb-b7f3-c7e4c66c0aff None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:05.970958 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33b4a2-9fdf-4aa3-815d-78fe91ae1e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:05.971643 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33b4a2-9fdf-4aa3-815d-78fe91ae1e61 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:05.971923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33b4a2-9fdf-4aa3-815d-78fe91ae1e61 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:05.972231 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33b4a2-9fdf-4aa3-815d-78fe91ae1e61 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:05.972987 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33b4a2-9fdf-4aa3-815d-78fe91ae1e61 None admin] RBAC: Adding query filter params (name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:05.973292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33b4a2-9fdf-4aa3-815d-78fe91ae1e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:05.975625 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33b4a2-9fdf-4aa3-815d-78fe91ae1e61 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:05.984843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 335/689] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:47:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:05.990456 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33b4a2-9fdf-4aa3-815d-78fe91ae1e61 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:06.083625 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02728ae7-502f-43cb-b7f3-c7e4c66c0aff None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:06.094727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33b4a2-9fdf-4aa3-815d-78fe91ae1e61 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:06.121299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37d1d8-f525-49c7-846e-4c5d1c197ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:06.122114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37d1d8-f525-49c7-846e-4c5d1c197ef2 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:06.122402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37d1d8-f525-49c7-846e-4c5d1c197ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:06.122673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37d1d8-f525-49c7-846e-4c5d1c197ef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:06.129519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c21659-d075-4273-87cd-3558c8481d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:06.131021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c21659-d075-4273-87cd-3558c8481d58 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:06.131504 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c21659-d075-4273-87cd-3558c8481d58 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:06.131971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c21659-d075-4273-87cd-3558c8481d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:06.134607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37d1d8-f525-49c7-846e-4c5d1c197ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:06.136039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37d1d8-f525-49c7-846e-4c5d1c197ef2 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:06.143249 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c21659-d075-4273-87cd-3558c8481d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:06.144960 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c21659-d075-4273-87cd-3558c8481d58 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:06.153958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-ab37d1d8-f525-49c7-846e-4c5d1c197ef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:06.153958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:06.153958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:06.153958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:06.153958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:06.153958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:06.153958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:06.153958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:06.153958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:06.153958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:06.153958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:06.153958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:06.153958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:06.153958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:06.153958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:06.154874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:06.154874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:06.154874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:06.154874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:06.154874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:06.154874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:06.154874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:06.154874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:06.154874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:06.154874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:06.154874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:06.154874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:06.154874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:06.154874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:06.154874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:06.154874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:06.154874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:06.156073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:06.156073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:06.156073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:06.156073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:06.156073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 355/690] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:06.162646 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37d1d8-f525-49c7-846e-4c5d1c197ef2 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:06.166261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-23c21659-d075-4273-87cd-3558c8481d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:06.166261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:06.166261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:06.166261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:06.166261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:06.166261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:06.166261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:06.166261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:06.166261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:06.166261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:06.166261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:06.166261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:06.166261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:06.166261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:06.166261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:06.167192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:06.167192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:06.167192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:06.167192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:06.167192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:06.167192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:06.167192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:06.167192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:06.167192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:06.167192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:06.167192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:06.167192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:06.167192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:06.167192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:06.167192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:06.167192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:06.167192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:06.168112 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:06.168112 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:06.168112 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:06.168112 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:06.170359 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 336/691] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:06.181729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c21659-d075-4273-87cd-3558c8481d58 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:06.291095 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c21659-d075-4273-87cd-3558c8481d58 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:06.337527 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0da95-34c5-45b2-942e-51e60d9042d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:06.338562 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0da95-34c5-45b2-942e-51e60d9042d4 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:06.339060 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0da95-34c5-45b2-942e-51e60d9042d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:06.339543 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0da95-34c5-45b2-942e-51e60d9042d4 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:06.340478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0da95-34c5-45b2-942e-51e60d9042d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:06.340995 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0da95-34c5-45b2-942e-51e60d9042d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:06.342561 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0da95-34c5-45b2-942e-51e60d9042d4 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:06.368799 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 337/692] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:06.374590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0da95-34c5-45b2-942e-51e60d9042d4 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:06.383780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37d1d8-f525-49c7-846e-4c5d1c197ef2 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:06.429042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883841e-2fe9-41c6-aa9d-2c0824da43b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:06.430089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883841e-2fe9-41c6-aa9d-2c0824da43b6 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:06.430587 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883841e-2fe9-41c6-aa9d-2c0824da43b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:06.431057 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883841e-2fe9-41c6-aa9d-2c0824da43b6 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:06.432024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883841e-2fe9-41c6-aa9d-2c0824da43b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:06.432563 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883841e-2fe9-41c6-aa9d-2c0824da43b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:06.434130 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883841e-2fe9-41c6-aa9d-2c0824da43b6 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:06.459241 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 356/693] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:06.469843 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883841e-2fe9-41c6-aa9d-2c0824da43b6 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:06.532948 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0da95-34c5-45b2-942e-51e60d9042d4 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:06.576960 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aaecfc-85eb-43c2-998c-df496e22c15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:06.578146 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aaecfc-85eb-43c2-998c-df496e22c15f None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:06.578625 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aaecfc-85eb-43c2-998c-df496e22c15f None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:06.579102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aaecfc-85eb-43c2-998c-df496e22c15f None admin] PATH_INFO: `/v3/users/swift` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:06.596962 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aaecfc-85eb-43c2-998c-df496e22c15f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:06.598479 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aaecfc-85eb-43c2-998c-df496e22c15f None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:06.620122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-f7aaecfc-85eb-43c2-998c-df496e22c15f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 13:47:06.620122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:06.620122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:06.620122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:06.620122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:06.620122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:06.620122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:06.620122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:06.620122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:06.620122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:06.620122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:06.620122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:06.620122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:06.620122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:06.620122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:06.620122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:06.621149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:06.622092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:06.622092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:06.622092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:06.622092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:06.622092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:06.622092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:06.622092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:06.622092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:06.622092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 13:47:06.622092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:06.629732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 338/694] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:47:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:06.634985 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aaecfc-85eb-43c2-998c-df496e22c15f None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:06.643701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883841e-2fe9-41c6-aa9d-2c0824da43b6 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:06.687249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1fb60-e6c1-4be5-bc6a-cea1eb59b992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:06.688431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1fb60-e6c1-4be5-bc6a-cea1eb59b992 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:06.688907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1fb60-e6c1-4be5-bc6a-cea1eb59b992 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:06.689382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1fb60-e6c1-4be5-bc6a-cea1eb59b992 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:06.702728 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1fb60-e6c1-4be5-bc6a-cea1eb59b992 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:06.704452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1fb60-e6c1-4be5-bc6a-cea1eb59b992 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:06.726578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-a1d1fb60-e6c1-4be5-bc6a-cea1eb59b992 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:06.726578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:06.726578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:06.726578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:06.726578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:06.726578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:06.726578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:06.726578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:06.726578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:06.726578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:06.726578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:06.726578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:06.726578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:06.726578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:06.726578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:06.727521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:06.727521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:06.727521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:06.727521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:06.727521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:06.727521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:06.727521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:06.727521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:06.727521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:06.727521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:06.727521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:06.727521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:06.727521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:06.727521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:06.727521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:06.727521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:06.727521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:06.728459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:06.728459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:06.728459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:06.728459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:06.728459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:06.728459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:06.728459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:06.728459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:06.730869 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 357/695] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:06.741068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1fb60-e6c1-4be5-bc6a-cea1eb59b992 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:06.760533 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aaecfc-85eb-43c2-998c-df496e22c15f None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:06.802133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7249a-a4cf-4a1c-a28e-b148d8d6d111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:06.803277 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7249a-a4cf-4a1c-a28e-b148d8d6d111 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:06.803277 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7249a-a4cf-4a1c-a28e-b148d8d6d111 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:06.803552 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7249a-a4cf-4a1c-a28e-b148d8d6d111 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:06.804454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7249a-a4cf-4a1c-a28e-b148d8d6d111 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:06.804765 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7249a-a4cf-4a1c-a28e-b148d8d6d111 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:06.806242 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7249a-a4cf-4a1c-a28e-b148d8d6d111 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:06.837243 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 339/696] 10.222.0.49 () {56 vars in 1135 bytes} [Tue May 10 13:47:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:06.839258 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7249a-a4cf-4a1c-a28e-b148d8d6d111 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:06.863510 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1fb60-e6c1-4be5-bc6a-cea1eb59b992 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:06.909449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d92ff9-044b-4065-b366-fc77b3fc31d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:06.910582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d92ff9-044b-4065-b366-fc77b3fc31d7 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:06.911066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d92ff9-044b-4065-b366-fc77b3fc31d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:06.911563 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d92ff9-044b-4065-b366-fc77b3fc31d7 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:06.912564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d92ff9-044b-4065-b366-fc77b3fc31d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:06.913084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d92ff9-044b-4065-b366-fc77b3fc31d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:06.914692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d92ff9-044b-4065-b366-fc77b3fc31d7 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:06.935083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 358/697] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:06.939641 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7249a-a4cf-4a1c-a28e-b148d8d6d111 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:06.940766 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d92ff9-044b-4065-b366-fc77b3fc31d7 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:06.979628 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd543889-dd7a-4ad9-914c-74c36042c607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:06.980287 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd543889-dd7a-4ad9-914c-74c36042c607 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:06.980568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd543889-dd7a-4ad9-914c-74c36042c607 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:06.980844 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd543889-dd7a-4ad9-914c-74c36042c607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:07.078841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd543889-dd7a-4ad9-914c-74c36042c607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:07.080699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd543889-dd7a-4ad9-914c-74c36042c607 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:07.092159 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d92ff9-044b-4065-b366-fc77b3fc31d7 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:07.126313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160a8c3-3a8e-4e21-a29a-dffef25fd8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:07.127356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160a8c3-3a8e-4e21-a29a-dffef25fd8d6 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:07.127833 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160a8c3-3a8e-4e21-a29a-dffef25fd8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:07.128343 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160a8c3-3a8e-4e21-a29a-dffef25fd8d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:07.129387 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160a8c3-3a8e-4e21-a29a-dffef25fd8d6 None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=975f10f781b94bdaa8edee39a2b1bba4) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:07.129891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160a8c3-3a8e-4e21-a29a-dffef25fd8d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:07.132035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160a8c3-3a8e-4e21-a29a-dffef25fd8d6 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:07.138326 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 359/698] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:47:06 2022] GET /identity/v3/role_assignments?user.id=975f10f781b94bdaa8edee39a2b1bba4&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:07.139901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18380ea-0812-4ec1-82c0-659bc965e96d None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:07.140461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18380ea-0812-4ec1-82c0-659bc965e96d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:07.140936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18380ea-0812-4ec1-82c0-659bc965e96d None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:07.146959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 360/699] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:07.148839 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8df919-ca59-40ca-b0d9-c7066a8484d5 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:07.149344 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8df919-ca59-40ca-b0d9-c7066a8484d5 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:07.149831 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8df919-ca59-40ca-b0d9-c7066a8484d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:07.167631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-6a8df919-ca59-40ca-b0d9-c7066a8484d5 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:07.169187 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-6a8df919-ca59-40ca-b0d9-c7066a8484d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:07.215612 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 340/700] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:47:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 13:47:07.216910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd543889-dd7a-4ad9-914c-74c36042c607 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:07.251389 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 361/701] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:07.317509 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8df919-ca59-40ca-b0d9-c7066a8484d5 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:07.407077 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd543889-dd7a-4ad9-914c-74c36042c607 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:07.449810 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde0f1e-0496-4313-8157-e5bd90f1024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:07.450747 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde0f1e-0496-4313-8157-e5bd90f1024c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:07.451117 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde0f1e-0496-4313-8157-e5bd90f1024c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:07.451501 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde0f1e-0496-4313-8157-e5bd90f1024c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:07.455008 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8df919-ca59-40ca-b0d9-c7066a8484d5 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:07.462506 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde0f1e-0496-4313-8157-e5bd90f1024c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:07.463076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde0f1e-0496-4313-8157-e5bd90f1024c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:07.489852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-4dde0f1e-0496-4313-8157-e5bd90f1024c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:07.489852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:07.489852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:07.489852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:07.489852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:07.489852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:07.489852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:07.489852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:07.489852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:07.489852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:07.489852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:07.489852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:07.489852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:07.489852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:07.489852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:07.490785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:07.490785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:07.490785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:07.490785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:07.490785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:07.490785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:07.490785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:07.490785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:07.490785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:07.490785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:07.490785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:07.490785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:07.490785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:07.490785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:07.490785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:07.490785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:07.490785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:07.491699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:07.491699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:07.491699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:07.491699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:07.493032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 341/702] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:07.497146 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0999c1-0c10-4226-b19c-efab7accf976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:07.498226 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0999c1-0c10-4226-b19c-efab7accf976 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:07.498714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0999c1-0c10-4226-b19c-efab7accf976 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:07.499194 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0999c1-0c10-4226-b19c-efab7accf976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:07.509358 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde0f1e-0496-4313-8157-e5bd90f1024c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:07.527392 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0999c1-0c10-4226-b19c-efab7accf976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:07.529191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0999c1-0c10-4226-b19c-efab7accf976 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:07.558874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-ce0999c1-0c10-4226-b19c-efab7accf976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:07.558874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:07.558874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:07.558874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:07.558874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:07.558874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:07.558874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:07.558874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:07.558874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:07.558874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:07.558874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:07.558874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:07.558874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:07.558874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:07.558874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:07.559856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:07.559856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:07.559856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:07.559856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:07.559856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:07.559856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:07.559856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:07.559856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:07.559856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:07.559856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:07.559856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:07.559856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:07.559856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:07.559856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:07.559856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:07.559856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:07.559856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:07.560828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:07.560828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:07.560828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:07.560828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:07.571921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 362/703] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:07.578276 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0999c1-0c10-4226-b19c-efab7accf976 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:07.657007 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde0f1e-0496-4313-8157-e5bd90f1024c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:07.691042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0999c1-0c10-4226-b19c-efab7accf976 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:07.692047 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c755d-5eba-4bd4-ad07-61cf6b3f653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:07.692844 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c755d-5eba-4bd4-ad07-61cf6b3f653c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:07.693201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c755d-5eba-4bd4-ad07-61cf6b3f653c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:07.693480 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c755d-5eba-4bd4-ad07-61cf6b3f653c None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:07.694303 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c755d-5eba-4bd4-ad07-61cf6b3f653c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:07.695207 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c755d-5eba-4bd4-ad07-61cf6b3f653c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:07.696070 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c755d-5eba-4bd4-ad07-61cf6b3f653c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:07.711802 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 342/704] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:07.713271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3351e98-f222-4f1f-b353-2146cf3cc8df None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:07.713649 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3351e98-f222-4f1f-b353-2146cf3cc8df None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:07.713995 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3351e98-f222-4f1f-b353-2146cf3cc8df None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:07.719727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 343/705] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:07.720609 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3351e98-f222-4f1f-b353-2146cf3cc8df None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:07.729731 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c9dae-2303-4295-88f9-01d2b5b50a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:07.730701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c9dae-2303-4295-88f9-01d2b5b50a66 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:07.731187 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c9dae-2303-4295-88f9-01d2b5b50a66 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:07.731682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c9dae-2303-4295-88f9-01d2b5b50a66 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:07.732642 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c9dae-2303-4295-88f9-01d2b5b50a66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:07.733168 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c9dae-2303-4295-88f9-01d2b5b50a66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:07.734780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c9dae-2303-4295-88f9-01d2b5b50a66 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:07.747401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 363/706] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:07.749041 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f39d7-af50-470c-baa3-c481fa2b69cd None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:07.749553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f39d7-af50-470c-baa3-c481fa2b69cd None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:07.750037 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f39d7-af50-470c-baa3-c481fa2b69cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:07.767035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-744f39d7-af50-470c-baa3-c481fa2b69cd None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:07.768564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-744f39d7-af50-470c-baa3-c481fa2b69cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:07.831652 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3351e98-f222-4f1f-b353-2146cf3cc8df None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:07.848268 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 364/707] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:07.849528 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f39d7-af50-470c-baa3-c481fa2b69cd None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:07.889319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e13f52-b255-448f-9a2b-15230311312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:07.890750 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13f52-b255-448f-9a2b-15230311312a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:07.891271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13f52-b255-448f-9a2b-15230311312a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:07.891750 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13f52-b255-448f-9a2b-15230311312a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:07.902041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e13f52-b255-448f-9a2b-15230311312a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:07.903785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e13f52-b255-448f-9a2b-15230311312a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:07.919209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-b0e13f52-b255-448f-9a2b-15230311312a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:07.919209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:07.919209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:07.919209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:07.919209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:07.919209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:07.919209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:07.919209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:07.919209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:07.919209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:07.919209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:07.919209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:07.919209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:07.919209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:07.919209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:07.920202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:07.920202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:07.920202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:07.920202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:07.920202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:07.920202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:07.920202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:07.920202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:07.920202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:07.920202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:07.920202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:07.920202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:07.920202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:07.920202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:07.920202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:07.920202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:07.920202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:07.921140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:07.921140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:07.921140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:07.921140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:07.921140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:07.921140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:07.921140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:07.921140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:07.923579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 344/708] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:07.929587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e13f52-b255-448f-9a2b-15230311312a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:07.974510 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f39d7-af50-470c-baa3-c481fa2b69cd None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:08.010284 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c21331-42a1-4b62-bf48-5fe8590d4dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:08.011292 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c21331-42a1-4b62-bf48-5fe8590d4dbf None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:08.011796 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c21331-42a1-4b62-bf48-5fe8590d4dbf None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:08.012398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c21331-42a1-4b62-bf48-5fe8590d4dbf None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:08.013389 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c21331-42a1-4b62-bf48-5fe8590d4dbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:08.015023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c21331-42a1-4b62-bf48-5fe8590d4dbf None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:08.037905 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 365/709] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:47:07 2022] POST /identity/v3/users => generated 254 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:08.039245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c21331-42a1-4b62-bf48-5fe8590d4dbf None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:08.048383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e13f52-b255-448f-9a2b-15230311312a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:08.094276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95dc6f-9ac6-4254-a10c-70cddacfafb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:08.095507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95dc6f-9ac6-4254-a10c-70cddacfafb3 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:08.096427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95dc6f-9ac6-4254-a10c-70cddacfafb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:08.097072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95dc6f-9ac6-4254-a10c-70cddacfafb3 None admin] PATH_INFO: `/v3/services/network` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:08.098652 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95dc6f-9ac6-4254-a10c-70cddacfafb3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:08.101081 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95dc6f-9ac6-4254-a10c-70cddacfafb3 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:08.120569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-1b95dc6f-9ac6-4254-a10c-70cddacfafb3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:47:08.120569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:08.120569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:08.120569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:08.120569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:08.120569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:08.120569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:08.120569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:08.120569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:47:08.120569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:08.120569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:08.120569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:08.120569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:08.120569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:08.120569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:08.120569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:08.120569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:08.121717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:08.121717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:08.121717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:08.121717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:08.121717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:08.121717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:08.121717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:08.121717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:08.121717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:08.121717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:08.121717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:08.121717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:08.121717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:08.121717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:08.121717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:08.121717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:08.122631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:08.122631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:08.122631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:08.122631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:08.122631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:08.122631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:08.122631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:08.122631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:08.122631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:08.122631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:08.122631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:08.122631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:08.122631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:47:08.122631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:08.126087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 345/710] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:07 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:08.134214 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95dc6f-9ac6-4254-a10c-70cddacfafb3 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:08.184967 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c21331-42a1-4b62-bf48-5fe8590d4dbf None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:08.234626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b6987-a3a9-434a-a212-be0ef6ca5f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:08.235310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b6987-a3a9-434a-a212-be0ef6ca5f82 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:08.236472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b6987-a3a9-434a-a212-be0ef6ca5f82 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:08.236747 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b6987-a3a9-434a-a212-be0ef6ca5f82 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:08.237552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b6987-a3a9-434a-a212-be0ef6ca5f82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:08.237854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b6987-a3a9-434a-a212-be0ef6ca5f82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:08.239299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b6987-a3a9-434a-a212-be0ef6ca5f82 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:08.273780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 366/711] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:08.279807 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b6987-a3a9-434a-a212-be0ef6ca5f82 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:08.348740 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95dc6f-9ac6-4254-a10c-70cddacfafb3 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:08.401279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c88ebc-4400-49bc-94cc-c0b40f1f1e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:08.402292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c88ebc-4400-49bc-94cc-c0b40f1f1e3f None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:08.402734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c88ebc-4400-49bc-94cc-c0b40f1f1e3f None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:08.403156 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c88ebc-4400-49bc-94cc-c0b40f1f1e3f None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:08.404004 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c88ebc-4400-49bc-94cc-c0b40f1f1e3f None admin] RBAC: Adding query filter params (name=network) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:08.404534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c88ebc-4400-49bc-94cc-c0b40f1f1e3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:08.406364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c88ebc-4400-49bc-94cc-c0b40f1f1e3f None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:08.411147 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 346/712] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 13:47:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:08.412759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ff799-7ac5-41a1-b825-3b07f9f907da None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:08.413290 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b6987-a3a9-434a-a212-be0ef6ca5f82 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:08.413540 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ff799-7ac5-41a1-b825-3b07f9f907da None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:08.414043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ff799-7ac5-41a1-b825-3b07f9f907da None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:08.415765 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 347/713] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:08.420928 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01958a-616c-4252-8d5e-f1b75c1c27e1 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:08.421456 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01958a-616c-4252-8d5e-f1b75c1c27e1 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:08.421924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01958a-616c-4252-8d5e-f1b75c1c27e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:08.453293 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-6c01958a-616c-4252-8d5e-f1b75c1c27e1 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:08.454507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-6c01958a-616c-4252-8d5e-f1b75c1c27e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:08.456043 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49126e92-bb52-437e-9b8d-342c10edbd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:08.456798 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49126e92-bb52-437e-9b8d-342c10edbd62 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:08.457078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49126e92-bb52-437e-9b8d-342c10edbd62 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:08.457351 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49126e92-bb52-437e-9b8d-342c10edbd62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:08.458185 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49126e92-bb52-437e-9b8d-342c10edbd62 None admin] RBAC: Adding query filter params (role.id=10053e4259ae4b3bbbdbefa96320c937, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=d102155cd1bd4368ad272668da1651f4) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:08.459065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49126e92-bb52-437e-9b8d-342c10edbd62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:08.460563 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49126e92-bb52-437e-9b8d-342c10edbd62 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:08.470033 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 367/714] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:47:08 2022] GET /identity/v3/role_assignments?user.id=d102155cd1bd4368ad272668da1651f4&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=10053e4259ae4b3bbbdbefa96320c937 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:08.470854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49126e92-bb52-437e-9b8d-342c10edbd62 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:08.587290 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 348/715] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:08.617245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49126e92-bb52-437e-9b8d-342c10edbd62 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:08.617443 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01958a-616c-4252-8d5e-f1b75c1c27e1 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:08.659775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92927b0-6c57-4ed0-932f-85eeff275d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:08.660486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92927b0-6c57-4ed0-932f-85eeff275d09 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:08.660766 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92927b0-6c57-4ed0-932f-85eeff275d09 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:08.661038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92927b0-6c57-4ed0-932f-85eeff275d09 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:08.662325 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92927b0-6c57-4ed0-932f-85eeff275d09 None admin] RBAC: Adding query filter params (type=network) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:08.662629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92927b0-6c57-4ed0-932f-85eeff275d09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:08.663990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92927b0-6c57-4ed0-932f-85eeff275d09 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:08.670689 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 368/716] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 13:47:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:08.761765 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01958a-616c-4252-8d5e-f1b75c1c27e1 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:08.800570 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346eea20-967b-452e-a7cb-7b1fe0bf4636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:08.801392 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eea20-967b-452e-a7cb-7b1fe0bf4636 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:08.801673 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eea20-967b-452e-a7cb-7b1fe0bf4636 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:08.801942 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eea20-967b-452e-a7cb-7b1fe0bf4636 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:08.802701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346eea20-967b-452e-a7cb-7b1fe0bf4636 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:08.804154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346eea20-967b-452e-a7cb-7b1fe0bf4636 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:08.817251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-346eea20-967b-452e-a7cb-7b1fe0bf4636 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:47:08.817251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:08.817251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:08.817251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:08.817251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:08.817251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:08.817251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:08.817251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:08.817251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:47:08.817251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:08.817251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:08.817251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:08.817251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:08.817251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:08.817251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:08.817251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:08.818362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:08.818362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:08.818362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:08.818362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:08.818362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:08.818362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:08.818362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:08.818362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:08.818362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:08.818362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:08.818362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:08.818362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:08.818362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:08.818362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:08.818362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:08.818362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:08.819236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:08.819236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:08.819236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:08.819236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:08.819236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:08.819236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:08.819236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:08.819236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:08.819236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:08.819236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:08.819236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:08.819236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:08.819236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:08.819236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:47:08.819236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:08.819236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 349/717] 10.222.0.49 () {56 vars in 1129 bytes} [Tue May 10 13:47:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:08.824649 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92927b0-6c57-4ed0-932f-85eeff275d09 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:09.069939 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92927b0-6c57-4ed0-932f-85eeff275d09 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:09.105220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d26fa-89a8-4971-9765-e8ee9758d031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:09.105890 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d26fa-89a8-4971-9765-e8ee9758d031 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:09.106166 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d26fa-89a8-4971-9765-e8ee9758d031 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:09.106440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d26fa-89a8-4971-9765-e8ee9758d031 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:09.107146 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d26fa-89a8-4971-9765-e8ee9758d031 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:09.107445 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d26fa-89a8-4971-9765-e8ee9758d031 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:09.108859 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d26fa-89a8-4971-9765-e8ee9758d031 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:09.113803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 369/718] 10.222.0.49 () {56 vars in 1124 bytes} [Tue May 10 13:47:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:09.119099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346eea20-967b-452e-a7cb-7b1fe0bf4636 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:09.228659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346eea20-967b-452e-a7cb-7b1fe0bf4636 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:09.265765 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebf035-c441-40fe-9c5d-7171a14ff40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:09.266432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebf035-c441-40fe-9c5d-7171a14ff40b None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:09.266711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebf035-c441-40fe-9c5d-7171a14ff40b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:09.266985 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebf035-c441-40fe-9c5d-7171a14ff40b None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:09.267748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebf035-c441-40fe-9c5d-7171a14ff40b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:09.268061 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebf035-c441-40fe-9c5d-7171a14ff40b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:09.269570 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebf035-c441-40fe-9c5d-7171a14ff40b None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:09.276068 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 350/719] 10.222.0.49 () {56 vars in 1124 bytes} [Tue May 10 13:47:09 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:09.945223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdc05a-b412-4e2a-b72d-5adf7b8a1d65 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:09.945775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdc05a-b412-4e2a-b72d-5adf7b8a1d65 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:09.945775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdc05a-b412-4e2a-b72d-5adf7b8a1d65 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:09.947403 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 370/720] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:09.952333 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100cef5-604c-45fb-b89a-62710a08257a None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:09.952805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100cef5-604c-45fb-b89a-62710a08257a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:09.952986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100cef5-604c-45fb-b89a-62710a08257a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:09.969838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-9100cef5-604c-45fb-b89a-62710a08257a None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:09.971010 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-9100cef5-604c-45fb-b89a-62710a08257a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:10.059564 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 351/721] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:10.092561 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdc05a-b412-4e2a-b72d-5adf7b8a1d65 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:10.215097 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdc05a-b412-4e2a-b72d-5adf7b8a1d65 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:10.262817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2920c-1f68-499a-b650-a1bdf0cc84f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:10.263686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2920c-1f68-499a-b650-a1bdf0cc84f8 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:10.263961 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2920c-1f68-499a-b650-a1bdf0cc84f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:10.264310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2920c-1f68-499a-b650-a1bdf0cc84f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:10.277716 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2920c-1f68-499a-b650-a1bdf0cc84f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:10.285651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-e7c2920c-1f68-499a-b650-a1bdf0cc84f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:10.285651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:10.285651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:10.285651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:10.285651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:10.285651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:10.285651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:10.285651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:10.285651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:10.285651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:10.285651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:10.285651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:10.285651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:10.285651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:10.285651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:10.285651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:10.287216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:10.287216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:10.287216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:10.287216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:10.287216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:10.287216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:10.287216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:10.287216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:10.287216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:10.287216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:10.287216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:10.287216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:10.287216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:10.287216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:10.287216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:10.287216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:10.288066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:10.288066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:10.288066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:10.288066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:10.288066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:10.288066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:10.288066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:10.288066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:10.288066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:10.288066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:10.288066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:10.288066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:10.291824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 371/722] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:47:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:10.293076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100cef5-604c-45fb-b89a-62710a08257a None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:10.406989 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100cef5-604c-45fb-b89a-62710a08257a None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:10.440896 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cf1db-1853-4749-832a-391fbd496a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:10.441559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cf1db-1853-4749-832a-391fbd496a38 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:10.441836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cf1db-1853-4749-832a-391fbd496a38 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:10.442110 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cf1db-1853-4749-832a-391fbd496a38 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:10.442882 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cf1db-1853-4749-832a-391fbd496a38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:10.443183 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cf1db-1853-4749-832a-391fbd496a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:10.444569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cf1db-1853-4749-832a-391fbd496a38 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:10.452996 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 352/723] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:47:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:10.461527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2920c-1f68-499a-b650-a1bdf0cc84f8 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:10.582586 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2920c-1f68-499a-b650-a1bdf0cc84f8 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:10.627593 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312969bb-c5b8-4d39-8e1a-75f8398d2390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:10.628778 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312969bb-c5b8-4d39-8e1a-75f8398d2390 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:10.629256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312969bb-c5b8-4d39-8e1a-75f8398d2390 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:10.629743 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312969bb-c5b8-4d39-8e1a-75f8398d2390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:10.646362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312969bb-c5b8-4d39-8e1a-75f8398d2390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:10.648090 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312969bb-c5b8-4d39-8e1a-75f8398d2390 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:10.673825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-312969bb-c5b8-4d39-8e1a-75f8398d2390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:10.673825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:10.673825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:10.673825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:10.673825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:10.673825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:10.673825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:10.673825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:10.673825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:10.673825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:10.673825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:10.673825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:10.673825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:10.673825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:10.673825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:10.674755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:10.674755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:10.674755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:10.674755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:10.674755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:10.674755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:10.674755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:10.674755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:10.674755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:10.674755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:10.674755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:10.674755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:10.674755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:10.674755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:10.674755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:10.674755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:10.674755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:10.675644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:10.675644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:10.675644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:10.675644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:10.678063 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 372/724] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:10.689253 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cf1db-1853-4749-832a-391fbd496a38 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:10.780707 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ae71e-8800-4c01-8bbf-7c4af7cf3061 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:10.781355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ae71e-8800-4c01-8bbf-7c4af7cf3061 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:10.781845 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ae71e-8800-4c01-8bbf-7c4af7cf3061 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:10.783621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 373/725] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:10.789148 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844f14a-0b8b-41da-b88f-bfdda177e4fe None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:10.789650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844f14a-0b8b-41da-b88f-bfdda177e4fe None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:10.790121 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844f14a-0b8b-41da-b88f-bfdda177e4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:10.807328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-a844f14a-0b8b-41da-b88f-bfdda177e4fe None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:10.808835 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a844f14a-0b8b-41da-b88f-bfdda177e4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:10.816421 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cf1db-1853-4749-832a-391fbd496a38 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:10.858708 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6bcfc-f1ab-4aa5-a696-0e27030376d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:10.859296 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6bcfc-f1ab-4aa5-a696-0e27030376d2 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:10.859570 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6bcfc-f1ab-4aa5-a696-0e27030376d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:10.860003 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6bcfc-f1ab-4aa5-a696-0e27030376d2 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:10.860949 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6bcfc-f1ab-4aa5-a696-0e27030376d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:10.861398 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6bcfc-f1ab-4aa5-a696-0e27030376d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:10.863012 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6bcfc-f1ab-4aa5-a696-0e27030376d2 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:10.875871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 353/726] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:10.876195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 374/727] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 13:47:10.880884 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6bcfc-f1ab-4aa5-a696-0e27030376d2 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:10.899559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844f14a-0b8b-41da-b88f-bfdda177e4fe None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:10.982352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6bcfc-f1ab-4aa5-a696-0e27030376d2 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:11.001608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844f14a-0b8b-41da-b88f-bfdda177e4fe None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:11.018371 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191bb85-9687-4a09-ad62-d34328ccc809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:11.019510 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191bb85-9687-4a09-ad62-d34328ccc809 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.019991 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191bb85-9687-4a09-ad62-d34328ccc809 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.020491 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191bb85-9687-4a09-ad62-d34328ccc809 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.028631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191bb85-9687-4a09-ad62-d34328ccc809 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:11.030353 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191bb85-9687-4a09-ad62-d34328ccc809 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:11.037622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742a5fd-a50c-4917-b775-13616d30e2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:11.038652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742a5fd-a50c-4917-b775-13616d30e2e7 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.039073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742a5fd-a50c-4917-b775-13616d30e2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.039501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742a5fd-a50c-4917-b775-13616d30e2e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.047196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-8191bb85-9687-4a09-ad62-d34328ccc809 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:47:11.047196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:11.047196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:11.047196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:11.047196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:11.047196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:11.047196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:11.047196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:11.047196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:11.047196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:11.047196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:11.047196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:11.047196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:11.047196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:11.047196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:11.047196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:11.048391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:11.049482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:11.049482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:11.049482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:11.049482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:11.049482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:11.049482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:11.049482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:11.049482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:11.049482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:47:11.049482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:11.050808 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 354/728] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 13:47:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:11.053476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742a5fd-a50c-4917-b775-13616d30e2e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:11.061203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191bb85-9687-4a09-ad62-d34328ccc809 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:11.061709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-4742a5fd-a50c-4917-b775-13616d30e2e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:11.061709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:11.061709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:11.061709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:11.061709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:11.061709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:11.061709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:11.061709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:11.061709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:11.061709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:11.061709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:11.061709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:11.061709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:11.061709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:11.061709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:11.061709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:11.062626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:11.062626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:11.062626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:11.062626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:11.062626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:11.062626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:11.062626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:11.062626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:11.062626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:11.062626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:11.062626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:11.062626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:11.062626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:11.062626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:11.062626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:11.062626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:11.063478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:11.063478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:11.063478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:11.063478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:11.063478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:11.063478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:11.063478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:11.063478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:11.063478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:11.063478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:11.063478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:11.063478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:11.066250 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 375/729] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:47:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:11.072028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742a5fd-a50c-4917-b775-13616d30e2e7 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:11.170312 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191bb85-9687-4a09-ad62-d34328ccc809 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:11.174914 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742a5fd-a50c-4917-b775-13616d30e2e7 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:11.204478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be447e29-1373-4ae2-bcba-82c8fd99b557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:11.205457 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be447e29-1373-4ae2-bcba-82c8fd99b557 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.205885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be447e29-1373-4ae2-bcba-82c8fd99b557 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.206488 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be447e29-1373-4ae2-bcba-82c8fd99b557 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.207503 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be447e29-1373-4ae2-bcba-82c8fd99b557 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:11.207990 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be447e29-1373-4ae2-bcba-82c8fd99b557 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:11.210431 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be447e29-1373-4ae2-bcba-82c8fd99b557 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:11.210596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432e941-e220-40fb-9db1-ef11315d0eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:11.211348 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432e941-e220-40fb-9db1-ef11315d0eae None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.211690 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432e941-e220-40fb-9db1-ef11315d0eae None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.212026 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432e941-e220-40fb-9db1-ef11315d0eae None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.212850 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432e941-e220-40fb-9db1-ef11315d0eae None admin] RBAC: Adding query filter params (name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:11.213235 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432e941-e220-40fb-9db1-ef11315d0eae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:11.215052 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432e941-e220-40fb-9db1-ef11315d0eae None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:11.223143 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 376/730] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:47:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:11.230133 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432e941-e220-40fb-9db1-ef11315d0eae None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:11.241396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 355/731] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 13:47:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:11.242877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be447e29-1373-4ae2-bcba-82c8fd99b557 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:11.330241 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432e941-e220-40fb-9db1-ef11315d0eae None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:11.365786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60003bc5-9c72-4845-a2b1-9f75524c026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:11.366606 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60003bc5-9c72-4845-a2b1-9f75524c026a None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.366878 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60003bc5-9c72-4845-a2b1-9f75524c026a None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.367802 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60003bc5-9c72-4845-a2b1-9f75524c026a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.390172 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60003bc5-9c72-4845-a2b1-9f75524c026a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:11.390172 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60003bc5-9c72-4845-a2b1-9f75524c026a None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:11.444737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-60003bc5-9c72-4845-a2b1-9f75524c026a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:11.444737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:11.444737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:11.444737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:11.444737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:11.444737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:11.444737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:11.444737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:11.444737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:11.444737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:11.444737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:11.444737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:11.444737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:11.444737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:11.444737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:11.445702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:11.445702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:11.445702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:11.445702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:11.445702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:11.445702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:11.445702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:11.445702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:11.445702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:11.445702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:11.445702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:11.445702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:11.445702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:11.445702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:11.445702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:11.445702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:11.445702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:11.446644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:11.446644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:11.446644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:11.446644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:11.450806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 377/732] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:11.454242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60003bc5-9c72-4845-a2b1-9f75524c026a None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:11.469035 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be447e29-1373-4ae2-bcba-82c8fd99b557 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:11.506655 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecc130-f760-457a-a8e3-0de915df2428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:11.507821 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc130-f760-457a-a8e3-0de915df2428 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.508383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc130-f760-457a-a8e3-0de915df2428 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.508860 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc130-f760-457a-a8e3-0de915df2428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.519129 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecc130-f760-457a-a8e3-0de915df2428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:11.521523 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecc130-f760-457a-a8e3-0de915df2428 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:11.539839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-24ecc130-f760-457a-a8e3-0de915df2428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:11.539839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:11.539839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:11.539839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:11.539839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:11.539839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:11.539839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:11.539839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:11.539839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:11.539839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:11.539839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:11.539839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:11.539839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:11.539839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:11.539839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:11.540811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:11.540811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:11.540811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:11.540811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:11.540811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:11.540811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:11.540811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:11.540811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:11.540811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:11.540811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:11.540811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:11.540811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:11.540811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:11.540811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:11.540811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:11.540811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:11.540811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:11.541755 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:11.541755 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:11.541755 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:11.541755 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:11.548253 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 356/733] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:11.549690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecc130-f760-457a-a8e3-0de915df2428 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:11.638059 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60003bc5-9c72-4845-a2b1-9f75524c026a None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:11.648788 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecc130-f760-457a-a8e3-0de915df2428 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:11.669873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f266681-e392-44f8-8f9b-c1aa2fd634ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:11.670541 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f266681-e392-44f8-8f9b-c1aa2fd634ad None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.670821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f266681-e392-44f8-8f9b-c1aa2fd634ad None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.671119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f266681-e392-44f8-8f9b-c1aa2fd634ad None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.671838 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f266681-e392-44f8-8f9b-c1aa2fd634ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:11.672137 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f266681-e392-44f8-8f9b-c1aa2fd634ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:11.673508 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f266681-e392-44f8-8f9b-c1aa2fd634ad None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:11.681911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99368adf-673b-4b41-aa28-21fde553539e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:11.682566 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99368adf-673b-4b41-aa28-21fde553539e None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.682843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99368adf-673b-4b41-aa28-21fde553539e None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.683110 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99368adf-673b-4b41-aa28-21fde553539e None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.684326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99368adf-673b-4b41-aa28-21fde553539e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:11.684326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99368adf-673b-4b41-aa28-21fde553539e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:11.686218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99368adf-673b-4b41-aa28-21fde553539e None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:11.693573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 378/734] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:11.693573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3ad12-3c08-4070-ade7-a9a66cca6d7c None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.693573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3ad12-3c08-4070-ade7-a9a66cca6d7c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.693573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3ad12-3c08-4070-ade7-a9a66cca6d7c None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.693573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 379/735] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:11.694153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e4664-35b9-4df1-b7bc-72ef3e3edda5 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.694432 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e4664-35b9-4df1-b7bc-72ef3e3edda5 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.694701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e4664-35b9-4df1-b7bc-72ef3e3edda5 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.696106 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 380/736] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:11.696715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e4664-35b9-4df1-b7bc-72ef3e3edda5 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:11.708300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 357/737] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:11.708300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade55cb3-1f74-483b-a212-342286e5ff57 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.708300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade55cb3-1f74-483b-a212-342286e5ff57 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.708300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade55cb3-1f74-483b-a212-342286e5ff57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.723183 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-ade55cb3-1f74-483b-a212-342286e5ff57 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:11.724396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ade55cb3-1f74-483b-a212-342286e5ff57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:11.794223 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 358/738] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:11.795829 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189a30-5dbd-40c3-bd4c-3e50bc273a92 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.796243 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189a30-5dbd-40c3-bd4c-3e50bc273a92 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.796590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189a30-5dbd-40c3-bd4c-3e50bc273a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.806300 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e4664-35b9-4df1-b7bc-72ef3e3edda5 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:11.814620 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-f3189a30-5dbd-40c3-bd4c-3e50bc273a92 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:11.815868 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-f3189a30-5dbd-40c3-bd4c-3e50bc273a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:11.843457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422fc01-4313-4cf9-bc30-73e8176721fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:11.844292 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422fc01-4313-4cf9-bc30-73e8176721fd None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:11.844574 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422fc01-4313-4cf9-bc30-73e8176721fd None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:11.844845 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422fc01-4313-4cf9-bc30-73e8176721fd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:11.851928 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422fc01-4313-4cf9-bc30-73e8176721fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:11.853336 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422fc01-4313-4cf9-bc30-73e8176721fd None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:11.868390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-4422fc01-4313-4cf9-bc30-73e8176721fd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:47:11.868390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:11.868390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:11.868390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:11.868390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:11.868390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:11.868390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:11.868390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:11.868390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:11.868390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:11.868390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:11.868390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:11.868390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:11.868390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:11.868390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:11.868390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:11.869358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:11.874929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:11.874929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:11.874929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:11.874929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:11.874929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:11.874929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:11.874929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:11.874929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:11.874929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:47:11.874929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:11.874929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 381/739] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 13:47:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:11.874929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422fc01-4313-4cf9-bc30-73e8176721fd None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:11.891050 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 359/740] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:11.891968 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3189a30-5dbd-40c3-bd4c-3e50bc273a92 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:11.991234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3189a30-5dbd-40c3-bd4c-3e50bc273a92 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:11.992808 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422fc01-4313-4cf9-bc30-73e8176721fd None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:12.023431 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e5b79-42ad-48d6-8269-6d53276b1810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:12.024244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e5b79-42ad-48d6-8269-6d53276b1810 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.024491 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29b84a-aa33-4f88-a4ad-6051003b3979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:12.024934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e5b79-42ad-48d6-8269-6d53276b1810 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.024934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e5b79-42ad-48d6-8269-6d53276b1810 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.025327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29b84a-aa33-4f88-a4ad-6051003b3979 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.025553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29b84a-aa33-4f88-a4ad-6051003b3979 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.025802 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29b84a-aa33-4f88-a4ad-6051003b3979 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.032810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29b84a-aa33-4f88-a4ad-6051003b3979 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:12.034248 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29b84a-aa33-4f88-a4ad-6051003b3979 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:12.034947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e5b79-42ad-48d6-8269-6d53276b1810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:12.043037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-864e5b79-42ad-48d6-8269-6d53276b1810 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:12.043037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:12.043037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:12.043037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:12.043037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:12.043037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:12.043037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:12.043037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:12.043037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:12.043037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:12.043037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:12.043037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:12.043037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:12.043037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:12.043037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:12.043037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:12.044020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:12.044020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:12.044020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:12.044020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:12.044020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:12.044020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:12.044020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:12.044020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:12.044020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:12.044020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:12.044020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:12.044020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:12.044020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:12.044020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:12.044020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:12.044020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:12.045038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:12.045038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:12.045038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:12.045038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:12.045038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:12.045038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:12.045038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:12.045038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:12.045038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:12.045038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:12.045038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:12.045038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:12.047959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-fc29b84a-aa33-4f88-a4ad-6051003b3979 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:12.047959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:12.047959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:12.047959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:12.047959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:12.047959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:12.047959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:12.047959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:12.047959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:12.047959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:12.047959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:12.047959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:12.047959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:12.047959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:12.047959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:12.054631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:12.054631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:12.054631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:12.054631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:12.054631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:12.054631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:12.054631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:12.054631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:12.054631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:12.054631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:12.054631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:12.054631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:12.054631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:12.054631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:12.054631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:12.054631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:12.054631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:12.055559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:12.055559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:12.055559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:12.055559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:12.055559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:12.055559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:12.055559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:12.055559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:12.055995 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 360/741] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:47:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:12.056069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 382/742] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:12.056069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29b84a-aa33-4f88-a4ad-6051003b3979 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:12.056569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e5b79-42ad-48d6-8269-6d53276b1810 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:12.150331 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e5b79-42ad-48d6-8269-6d53276b1810 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:12.159927 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29b84a-aa33-4f88-a4ad-6051003b3979 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:12.183193 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee2623-e091-4894-9385-c1c204788960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:12.183857 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee2623-e091-4894-9385-c1c204788960 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.184145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee2623-e091-4894-9385-c1c204788960 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.184449 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee2623-e091-4894-9385-c1c204788960 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.185283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee2623-e091-4894-9385-c1c204788960 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:12.185592 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee2623-e091-4894-9385-c1c204788960 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:12.187016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee2623-e091-4894-9385-c1c204788960 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:12.195477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2964c-5518-41e0-a9fa-ac69cd66c7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:12.196111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2964c-5518-41e0-a9fa-ac69cd66c7a0 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.197012 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2964c-5518-41e0-a9fa-ac69cd66c7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.197012 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2964c-5518-41e0-a9fa-ac69cd66c7a0 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.197369 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2964c-5518-41e0-a9fa-ac69cd66c7a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:12.198717 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2964c-5518-41e0-a9fa-ac69cd66c7a0 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:12.205085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 361/743] 10.222.0.49 () {56 vars in 1149 bytes} [Tue May 10 13:47:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:12.205982 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee2623-e091-4894-9385-c1c204788960 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:12.218565 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 383/744] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 13:47:12 2022] POST /identity/v3/services => generated 240 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:12.219408 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2964c-5518-41e0-a9fa-ac69cd66c7a0 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:12.334882 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee2623-e091-4894-9385-c1c204788960 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:12.346832 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2964c-5518-41e0-a9fa-ac69cd66c7a0 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:12.374014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10434c91-2245-4c44-9e88-e9b5263aedef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:12.374693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10434c91-2245-4c44-9e88-e9b5263aedef None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.374971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10434c91-2245-4c44-9e88-e9b5263aedef None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.375433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10434c91-2245-4c44-9e88-e9b5263aedef None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.375991 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10434c91-2245-4c44-9e88-e9b5263aedef None admin] RBAC: Adding query filter params (name=admin) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:12.376319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10434c91-2245-4c44-9e88-e9b5263aedef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:12.377715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10434c91-2245-4c44-9e88-e9b5263aedef None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:12.391804 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 362/745] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:47:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:12.391804 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10434c91-2245-4c44-9e88-e9b5263aedef None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:12.392561 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34bb07-3760-4ddb-b0e0-523ec8f0177e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:12.393247 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34bb07-3760-4ddb-b0e0-523ec8f0177e None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.393525 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34bb07-3760-4ddb-b0e0-523ec8f0177e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.393799 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34bb07-3760-4ddb-b0e0-523ec8f0177e None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.394600 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34bb07-3760-4ddb-b0e0-523ec8f0177e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:12.394904 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34bb07-3760-4ddb-b0e0-523ec8f0177e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:12.396532 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34bb07-3760-4ddb-b0e0-523ec8f0177e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:12.409598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 384/746] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:12.410594 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1179f26-accc-4e93-aeb6-45cddf37c6b0 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.410878 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1179f26-accc-4e93-aeb6-45cddf37c6b0 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.411150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1179f26-accc-4e93-aeb6-45cddf37c6b0 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.412780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 385/747] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:12.413292 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1179f26-accc-4e93-aeb6-45cddf37c6b0 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:12.521815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1179f26-accc-4e93-aeb6-45cddf37c6b0 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:12.556779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4145451-43b7-42ae-80b8-86fee02cccd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:12.557571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145451-43b7-42ae-80b8-86fee02cccd1 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.557850 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145451-43b7-42ae-80b8-86fee02cccd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.558121 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145451-43b7-42ae-80b8-86fee02cccd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.569066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4145451-43b7-42ae-80b8-86fee02cccd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:12.570484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4145451-43b7-42ae-80b8-86fee02cccd1 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:12.589535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-f4145451-43b7-42ae-80b8-86fee02cccd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:12.589535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:12.589535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:12.589535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:12.589535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:12.589535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:12.589535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:12.589535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:12.589535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:12.589535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:12.589535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:12.589535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:12.589535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:12.589535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:12.589535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:12.590477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:12.590477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:12.590477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:12.590477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:12.590477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:12.590477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:12.590477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:12.590477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:12.590477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:12.590477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:12.590477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:12.590477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:12.590477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:12.590477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:12.590477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:12.590477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:12.590477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:12.591979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:12.591979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:12.591979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:12.591979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:12.591979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 386/748] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:12.595009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dbe78-22d3-4e39-b880-c5dab7ce8944 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.595009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dbe78-22d3-4e39-b880-c5dab7ce8944 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.595009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dbe78-22d3-4e39-b880-c5dab7ce8944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.610464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-8d7dbe78-22d3-4e39-b880-c5dab7ce8944 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:12.611813 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-8d7dbe78-22d3-4e39-b880-c5dab7ce8944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:12.615388 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10434c91-2245-4c44-9e88-e9b5263aedef None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:12.651369 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5b770-d146-438f-b46f-07f5c259ff02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:12.652283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5b770-d146-438f-b46f-07f5c259ff02 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.652703 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5b770-d146-438f-b46f-07f5c259ff02 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.653138 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5b770-d146-438f-b46f-07f5c259ff02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.677815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 387/749] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:12 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 13:47:12.678741 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7dbe78-22d3-4e39-b880-c5dab7ce8944 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:12.737038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5b770-d146-438f-b46f-07f5c259ff02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:12.738482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5b770-d146-438f-b46f-07f5c259ff02 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:12.775938 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7dbe78-22d3-4e39-b880-c5dab7ce8944 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:12.808150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d84098-a049-4d16-851a-5e2f95643775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:12.809061 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84098-a049-4d16-851a-5e2f95643775 None admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.809337 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84098-a049-4d16-851a-5e2f95643775 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.809608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84098-a049-4d16-851a-5e2f95643775 None admin] PATH_INFO: `/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/975f10f781b94bdaa8edee39a2b1bba4/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.811585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d84098-a049-4d16-851a-5e2f95643775 None admin] RBAC: Authorizing `identity:create_grant(project_id=9613de9a3bc9461d9d348e5b66b8d684, user_id=975f10f781b94bdaa8edee39a2b1bba4, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:12.813022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d84098-a049-4d16-851a-5e2f95643775 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:12.836240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 388/750] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:47:12 2022] PUT /identity/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/975f10f781b94bdaa8edee39a2b1bba4/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:47:12.836240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d84098-a049-4d16-851a-5e2f95643775 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:12.852725 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 363/751] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:47:12 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 13:47:12.853659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5b770-d146-438f-b46f-07f5c259ff02 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:12.945808 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d84098-a049-4d16-851a-5e2f95643775 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:12.982386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85634a4-dfc7-4347-8061-d91119caf580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:12.982898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5b770-d146-438f-b46f-07f5c259ff02 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:12.983082 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85634a4-dfc7-4347-8061-d91119caf580 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:12.983332 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85634a4-dfc7-4347-8061-d91119caf580 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:12.983603 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85634a4-dfc7-4347-8061-d91119caf580 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:12.984367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85634a4-dfc7-4347-8061-d91119caf580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:12.984670 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85634a4-dfc7-4347-8061-d91119caf580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:12.986079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85634a4-dfc7-4347-8061-d91119caf580 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:12.998648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 389/752] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:12.999614 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85634a4-dfc7-4347-8061-d91119caf580 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:13.020759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90df1aa-c97c-46bb-8f07-4d958060bbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:13.021944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90df1aa-c97c-46bb-8f07-4d958060bbee None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:13.022268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90df1aa-c97c-46bb-8f07-4d958060bbee None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:13.022538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90df1aa-c97c-46bb-8f07-4d958060bbee None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:13.023307 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90df1aa-c97c-46bb-8f07-4d958060bbee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:13.024704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90df1aa-c97c-46bb-8f07-4d958060bbee None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:13.042964 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 364/753] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 13:47:12 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:13.043932 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90df1aa-c97c-46bb-8f07-4d958060bbee None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:13.110322 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85634a4-dfc7-4347-8061-d91119caf580 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:13.153783 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0eb1f-3aa5-4dcd-a252-1a65ed888da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:13.154973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0eb1f-3aa5-4dcd-a252-1a65ed888da0 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:13.155726 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0eb1f-3aa5-4dcd-a252-1a65ed888da0 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:13.156260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0eb1f-3aa5-4dcd-a252-1a65ed888da0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:13.168607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0eb1f-3aa5-4dcd-a252-1a65ed888da0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:13.170417 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0eb1f-3aa5-4dcd-a252-1a65ed888da0 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:13.189366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-d7c0eb1f-3aa5-4dcd-a252-1a65ed888da0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:13.189366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:13.189366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:13.189366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:13.189366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:13.189366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:13.189366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:13.189366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:13.189366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:13.189366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:13.189366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:13.189366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:13.189366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:13.189366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:13.189366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:13.190333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:13.190333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:13.190333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:13.190333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:13.190333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:13.190333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:13.190333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:13.190333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:13.190333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:13.190333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:13.190333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:13.190333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:13.190333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:13.190333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:13.190333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:13.190333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:13.190333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:13.191328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:13.191328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:13.191328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:13.191328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:13.194204 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 390/754] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:13.206322 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0eb1f-3aa5-4dcd-a252-1a65ed888da0 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:13.228991 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90df1aa-c97c-46bb-8f07-4d958060bbee None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:13.270774 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4745ad9-f385-4add-92fa-9ed8ebe65a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:13.271572 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4745ad9-f385-4add-92fa-9ed8ebe65a0a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:13.271848 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4745ad9-f385-4add-92fa-9ed8ebe65a0a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:13.272115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4745ad9-f385-4add-92fa-9ed8ebe65a0a None admin] PATH_INFO: `/v3/users/swift` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:13.281925 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4745ad9-f385-4add-92fa-9ed8ebe65a0a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:13.283364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4745ad9-f385-4add-92fa-9ed8ebe65a0a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:13.300084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-d4745ad9-f385-4add-92fa-9ed8ebe65a0a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 13:47:13.300084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:13.300084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:13.300084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:13.300084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:13.300084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:13.300084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:13.300084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:13.300084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:13.300084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:13.300084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:13.300084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:13.300084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:13.300084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:13.300084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:13.300084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:13.301109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:13.302681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:13.302681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:13.302681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:13.302681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:13.302681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:13.302681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:13.302681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:13.302681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:13.302681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 13:47:13.302681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:13.302681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 365/755] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:47:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:13.309464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4745ad9-f385-4add-92fa-9ed8ebe65a0a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:13.331431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0eb1f-3aa5-4dcd-a252-1a65ed888da0 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:13.377011 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19127754-58b7-413c-927b-97b4c80c7096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:13.377675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19127754-58b7-413c-927b-97b4c80c7096 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:13.377949 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19127754-58b7-413c-927b-97b4c80c7096 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:13.378218 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19127754-58b7-413c-927b-97b4c80c7096 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:13.379397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19127754-58b7-413c-927b-97b4c80c7096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:13.379711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19127754-58b7-413c-927b-97b4c80c7096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:13.381985 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19127754-58b7-413c-927b-97b4c80c7096 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:13.398729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 391/756] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:13.405075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19127754-58b7-413c-927b-97b4c80c7096 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:13.433602 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4745ad9-f385-4add-92fa-9ed8ebe65a0a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:13.467258 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822544be-fe5b-4685-a2ec-bc5218467d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:13.468044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822544be-fe5b-4685-a2ec-bc5218467d82 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:13.468395 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822544be-fe5b-4685-a2ec-bc5218467d82 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:13.468737 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822544be-fe5b-4685-a2ec-bc5218467d82 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:13.469634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822544be-fe5b-4685-a2ec-bc5218467d82 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:13.470001 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822544be-fe5b-4685-a2ec-bc5218467d82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:13.471472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822544be-fe5b-4685-a2ec-bc5218467d82 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:13.490464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 366/757] 10.222.0.49 () {56 vars in 1135 bytes} [Tue May 10 13:47:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:13.495861 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822544be-fe5b-4685-a2ec-bc5218467d82 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:13.510902 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19127754-58b7-413c-927b-97b4c80c7096 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:13.546024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab098f0-2cea-4538-b263-456d9073c184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:13.547108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab098f0-2cea-4538-b263-456d9073c184 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:13.547536 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab098f0-2cea-4538-b263-456d9073c184 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:13.547951 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab098f0-2cea-4538-b263-456d9073c184 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:13.555744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab098f0-2cea-4538-b263-456d9073c184 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:13.557443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab098f0-2cea-4538-b263-456d9073c184 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:13.571800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-9ab098f0-2cea-4538-b263-456d9073c184 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:13.571800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:13.571800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:13.571800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:13.571800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:13.571800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:13.571800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:13.571800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:13.571800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:13.571800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:13.571800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:13.571800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:13.571800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:13.571800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:13.571800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:13.572953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:13.572953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:13.572953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:13.572953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:13.572953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:13.572953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:13.572953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:13.572953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:13.572953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:13.572953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:13.572953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:13.572953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:13.572953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:13.572953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:13.572953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:13.572953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:13.572953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:13.574002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:13.574002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:13.574002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:13.574002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:13.574002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:13.574002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:13.574002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:13.574002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:13.576108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 392/758] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:13.581815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab098f0-2cea-4538-b263-456d9073c184 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:13.596426 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822544be-fe5b-4685-a2ec-bc5218467d82 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:13.631271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f77672-581b-4cb6-8880-617b3a67c6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:13.632221 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f77672-581b-4cb6-8880-617b3a67c6de None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:13.632576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f77672-581b-4cb6-8880-617b3a67c6de None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:13.632913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f77672-581b-4cb6-8880-617b3a67c6de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:13.685734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab098f0-2cea-4538-b263-456d9073c184 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:13.715063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f77672-581b-4cb6-8880-617b3a67c6de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:13.716531 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f77672-581b-4cb6-8880-617b3a67c6de None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:13.719626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c3d73-06bc-43ed-ad1f-22ed055c1a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:13.720539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c3d73-06bc-43ed-ad1f-22ed055c1a9f None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:13.721014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c3d73-06bc-43ed-ad1f-22ed055c1a9f None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:13.721464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c3d73-06bc-43ed-ad1f-22ed055c1a9f None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:13.722438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c3d73-06bc-43ed-ad1f-22ed055c1a9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:13.722919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c3d73-06bc-43ed-ad1f-22ed055c1a9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:13.725454 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c3d73-06bc-43ed-ad1f-22ed055c1a9f None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:13.742429 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 393/759] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:13.748470 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c3d73-06bc-43ed-ad1f-22ed055c1a9f None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:13.834533 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 367/760] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:47:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 13:47:13.839815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f77672-581b-4cb6-8880-617b3a67c6de None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:13.854958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c3d73-06bc-43ed-ad1f-22ed055c1a9f None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:13.889777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34135640-b344-43d5-8127-ea5b380d518d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:13.890723 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34135640-b344-43d5-8127-ea5b380d518d None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:13.891202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34135640-b344-43d5-8127-ea5b380d518d None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:13.891651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34135640-b344-43d5-8127-ea5b380d518d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:13.892676 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34135640-b344-43d5-8127-ea5b380d518d None admin] RBAC: Adding query filter params (role.id=10053e4259ae4b3bbbdbefa96320c937, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=df5dcdfb4eda417ebc0af2432497617d) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:13.893165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34135640-b344-43d5-8127-ea5b380d518d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:13.895019 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34135640-b344-43d5-8127-ea5b380d518d None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:13.902621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 394/761] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:47:13 2022] GET /identity/v3/role_assignments?user.id=df5dcdfb4eda417ebc0af2432497617d&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=10053e4259ae4b3bbbdbefa96320c937 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:13.940195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f77672-581b-4cb6-8880-617b3a67c6de None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:13.983894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa44dc-06af-468e-af78-3532ccee5ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:13.984725 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa44dc-06af-468e-af78-3532ccee5ad3 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:13.985001 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa44dc-06af-468e-af78-3532ccee5ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:13.985272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa44dc-06af-468e-af78-3532ccee5ad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:14.001499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa44dc-06af-468e-af78-3532ccee5ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:14.002953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa44dc-06af-468e-af78-3532ccee5ad3 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:14.025066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-caaa44dc-06af-468e-af78-3532ccee5ad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:14.025066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:14.025066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:14.025066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:14.025066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:14.025066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:14.025066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:14.025066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:14.025066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:14.025066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:14.025066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:14.025066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:14.025066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:14.025066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:14.025066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:14.026468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:14.026468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:14.026468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:14.026468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:14.026468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:14.026468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:14.026468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:14.026468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:14.026468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:14.026468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:14.026468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:14.026468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:14.026468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:14.026468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:14.026468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:14.026468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:14.026468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:14.027373 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:14.027373 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:14.027373 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:14.027373 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:14.027373 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 368/762] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:14.032506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34135640-b344-43d5-8127-ea5b380d518d None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:14.153697 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34135640-b344-43d5-8127-ea5b380d518d None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:14.197953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878233a9-656e-49b9-b35b-3ac84dc7619a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:14.198629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878233a9-656e-49b9-b35b-3ac84dc7619a None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:14.198902 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878233a9-656e-49b9-b35b-3ac84dc7619a None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:14.199169 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878233a9-656e-49b9-b35b-3ac84dc7619a None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:14.199890 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878233a9-656e-49b9-b35b-3ac84dc7619a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:14.200204 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878233a9-656e-49b9-b35b-3ac84dc7619a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:14.201553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878233a9-656e-49b9-b35b-3ac84dc7619a None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:14.219847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa44dc-06af-468e-af78-3532ccee5ad3 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:14.220279 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 395/763] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:14.318645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa44dc-06af-468e-af78-3532ccee5ad3 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:14.355627 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c04f33-c7db-48f1-9705-90c09f3ef9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:14.356450 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c04f33-c7db-48f1-9705-90c09f3ef9eb None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:14.356732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c04f33-c7db-48f1-9705-90c09f3ef9eb None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:14.357005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c04f33-c7db-48f1-9705-90c09f3ef9eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:14.367490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c04f33-c7db-48f1-9705-90c09f3ef9eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:14.368949 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c04f33-c7db-48f1-9705-90c09f3ef9eb None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:14.385714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-10c04f33-c7db-48f1-9705-90c09f3ef9eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:14.385714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:14.385714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:14.385714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:14.385714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:14.385714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:14.385714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:14.385714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:14.385714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:14.385714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:14.385714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:14.385714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:14.385714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:14.385714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:14.385714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:14.386587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:14.386587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:14.386587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:14.386587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:14.386587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:14.386587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:14.386587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:14.386587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:14.386587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:14.386587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:14.386587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:14.386587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:14.386587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:14.386587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:14.386587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:14.386587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:14.386587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:14.387512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:14.387512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:14.387512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:14.387512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:14.387512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:14.387512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:14.387512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:14.387512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:14.387512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 369/764] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:14.394277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878233a9-656e-49b9-b35b-3ac84dc7619a None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:14.515446 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878233a9-656e-49b9-b35b-3ac84dc7619a None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:14.555961 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbeb00-6829-4f65-b5df-871c17b5bc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:14.556647 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbeb00-6829-4f65-b5df-871c17b5bc38 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:14.556924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbeb00-6829-4f65-b5df-871c17b5bc38 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:14.557197 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbeb00-6829-4f65-b5df-871c17b5bc38 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:14.557980 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbeb00-6829-4f65-b5df-871c17b5bc38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:14.558280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbeb00-6829-4f65-b5df-871c17b5bc38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:14.559681 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbeb00-6829-4f65-b5df-871c17b5bc38 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:14.571770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 396/765] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:14.580381 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c04f33-c7db-48f1-9705-90c09f3ef9eb None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:14.662911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30fc6d-c529-438e-b80e-74380d4c6797 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:14.663253 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30fc6d-c529-438e-b80e-74380d4c6797 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:14.663452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30fc6d-c529-438e-b80e-74380d4c6797 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:14.665395 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 397/766] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:14.671258 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da26dd9-9f6c-4b94-9330-17c6a985bf93 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:14.671495 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da26dd9-9f6c-4b94-9330-17c6a985bf93 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:14.671750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da26dd9-9f6c-4b94-9330-17c6a985bf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:14.689653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c04f33-c7db-48f1-9705-90c09f3ef9eb None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:14.705221 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-4da26dd9-9f6c-4b94-9330-17c6a985bf93 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:14.706425 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-4da26dd9-9f6c-4b94-9330-17c6a985bf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:14.736882 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb15b1-eead-4793-bdb8-96d02807487b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:14.737616 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb15b1-eead-4793-bdb8-96d02807487b None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:14.737898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb15b1-eead-4793-bdb8-96d02807487b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:14.738174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb15b1-eead-4793-bdb8-96d02807487b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:14.739059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb15b1-eead-4793-bdb8-96d02807487b None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=d102155cd1bd4368ad272668da1651f4) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:14.739411 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb15b1-eead-4793-bdb8-96d02807487b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:14.740861 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb15b1-eead-4793-bdb8-96d02807487b None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:14.746864 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 370/767] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:47:14 2022] GET /identity/v3/role_assignments?user.id=d102155cd1bd4368ad272668da1651f4&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:14.810983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 398/768] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:47:14.834357 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb15b1-eead-4793-bdb8-96d02807487b None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:14.979182 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb15b1-eead-4793-bdb8-96d02807487b None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:15.016009 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c8b02-ada1-45a9-a6c9-a6694720f32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:15.016890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c8b02-ada1-45a9-a6c9-a6694720f32b None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:15.017168 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c8b02-ada1-45a9-a6c9-a6694720f32b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:15.017436 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c8b02-ada1-45a9-a6c9-a6694720f32b None admin] PATH_INFO: `/v3/services/network` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:15.018139 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c8b02-ada1-45a9-a6c9-a6694720f32b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:15.019496 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c8b02-ada1-45a9-a6c9-a6694720f32b None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:15.036014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-c58c8b02-ada1-45a9-a6c9-a6694720f32b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:47:15.036014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:15.036014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:15.036014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:15.036014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:15.036014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:15.036014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:15.036014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:15.036014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:47:15.036014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:15.036014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:15.036014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:15.036014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:15.036014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:15.036014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:15.036014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:15.036014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:15.037507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:15.037507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:15.037507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:15.037507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:15.037507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:15.037507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:15.037507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:15.037507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:15.037507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:15.037507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:15.037507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:15.037507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:15.037507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:15.037507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:15.037507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:15.037507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:15.038364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:15.038364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:15.038364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:15.038364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:15.038364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:15.038364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:15.038364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:15.038364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:15.038364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:15.038364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:15.038364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:15.038364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:15.038364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:47:15.038364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:15.038364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 371/769] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:14 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:15.045459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da26dd9-9f6c-4b94-9330-17c6a985bf93 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:15.160260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da26dd9-9f6c-4b94-9330-17c6a985bf93 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:15.199704 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88305451-c048-4a6c-acda-e2e58b438d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:15.200398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88305451-c048-4a6c-acda-e2e58b438d3c None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:15.200674 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88305451-c048-4a6c-acda-e2e58b438d3c None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:15.200946 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88305451-c048-4a6c-acda-e2e58b438d3c None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:15.201650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88305451-c048-4a6c-acda-e2e58b438d3c None admin] RBAC: Adding query filter params (name=network) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:15.201951 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88305451-c048-4a6c-acda-e2e58b438d3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:15.203291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88305451-c048-4a6c-acda-e2e58b438d3c None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:15.208732 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 399/770] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 13:47:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:15.217235 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c8b02-ada1-45a9-a6c9-a6694720f32b None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:15.376547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c8b02-ada1-45a9-a6c9-a6694720f32b None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:15.440978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3e680-182e-47d2-a393-64a301a94f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:15.441575 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3e680-182e-47d2-a393-64a301a94f0d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:15.441859 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3e680-182e-47d2-a393-64a301a94f0d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:15.442135 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3e680-182e-47d2-a393-64a301a94f0d None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:15.443422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3e680-182e-47d2-a393-64a301a94f0d None admin] RBAC: Adding query filter params (type=network) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:15.443727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3e680-182e-47d2-a393-64a301a94f0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:15.445115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3e680-182e-47d2-a393-64a301a94f0d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:15.450556 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 372/771] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 13:47:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:15.456233 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88305451-c048-4a6c-acda-e2e58b438d3c None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:15.602421 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88305451-c048-4a6c-acda-e2e58b438d3c None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:15.653771 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd448d02-1023-494e-b49f-790293e32306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:15.654847 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd448d02-1023-494e-b49f-790293e32306 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:15.655628 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd448d02-1023-494e-b49f-790293e32306 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:15.656106 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd448d02-1023-494e-b49f-790293e32306 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:15.657150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd448d02-1023-494e-b49f-790293e32306 None admin] RBAC: Adding query filter params (interface=public, service_id=33eabac408a2465a8ec03b98ac37bb05, region_id=RegionOne) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:15.657684 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd448d02-1023-494e-b49f-790293e32306 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:15.659263 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd448d02-1023-494e-b49f-790293e32306 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:15.674099 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 400/772] 10.222.0.49 () {56 vars in 1251 bytes} [Tue May 10 13:47:15 2022] GET /identity/v3/endpoints?service_id=33eabac408a2465a8ec03b98ac37bb05&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:15.680270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3e680-182e-47d2-a393-64a301a94f0d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:15.821273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cf560-bb3e-48ec-ae2b-e7819d61d865 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:15.821617 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cf560-bb3e-48ec-ae2b-e7819d61d865 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:15.821798 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cf560-bb3e-48ec-ae2b-e7819d61d865 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:15.823242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 401/773] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:15.828203 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae889b0-e3b8-4c00-9f16-07c55f798fa8 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:15.828492 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae889b0-e3b8-4c00-9f16-07c55f798fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:15.828765 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae889b0-e3b8-4c00-9f16-07c55f798fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:15.837627 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3e680-182e-47d2-a393-64a301a94f0d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:15.858967 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-eae889b0-e3b8-4c00-9f16-07c55f798fa8 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:15.862828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-eae889b0-e3b8-4c00-9f16-07c55f798fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:15.886499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a1fbf-abd4-49b9-a792-f7f755b6e1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:15.887182 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a1fbf-abd4-49b9-a792-f7f755b6e1ee None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:15.887461 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a1fbf-abd4-49b9-a792-f7f755b6e1ee None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:15.887734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a1fbf-abd4-49b9-a792-f7f755b6e1ee None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:15.888458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a1fbf-abd4-49b9-a792-f7f755b6e1ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:15.889837 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a1fbf-abd4-49b9-a792-f7f755b6e1ee None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:15.895526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 373/774] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 13:47:15 2022] GET /identity/v3/services => generated 772 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:15.953216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 402/775] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:15.988071 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a1fbf-abd4-49b9-a792-f7f755b6e1ee None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:16.103656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0db77d-72be-49db-9e2e-0b5e290bba92 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:16.103958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0db77d-72be-49db-9e2e-0b5e290bba92 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:16.104122 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0db77d-72be-49db-9e2e-0b5e290bba92 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:16.105514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 403/776] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:16.105806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a1fbf-abd4-49b9-a792-f7f755b6e1ee None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:16.110928 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46259ec-bff0-4d8b-a980-4c3cfe523f8a None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:16.111227 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46259ec-bff0-4d8b-a980-4c3cfe523f8a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:16.111506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46259ec-bff0-4d8b-a980-4c3cfe523f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:16.139241 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-d46259ec-bff0-4d8b-a980-4c3cfe523f8a None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:16.140470 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d46259ec-bff0-4d8b-a980-4c3cfe523f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:16.147825 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c478a-0eae-497f-b51f-fd38e300b51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:16.148667 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c478a-0eae-497f-b51f-fd38e300b51f None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:16.148946 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c478a-0eae-497f-b51f-fd38e300b51f None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:16.149218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c478a-0eae-497f-b51f-fd38e300b51f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:16.173546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c478a-0eae-497f-b51f-fd38e300b51f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:16.182947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-014c478a-0eae-497f-b51f-fd38e300b51f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:16.182947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:16.182947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:16.182947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:16.182947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:16.182947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:16.182947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:16.182947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:16.182947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:16.182947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:16.182947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:16.182947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:16.182947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:16.182947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:16.182947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:16.182947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:16.184026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:16.184026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:16.184026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:16.184026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:16.184026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:16.184026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:16.184026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:16.184026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:16.184026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:16.184026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:16.184026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:16.184026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:16.184026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:16.184026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:16.184026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:16.184026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:16.184947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:16.184947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:16.184947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:16.184947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:16.184947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:16.184947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:16.184947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:16.184947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:16.184947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:16.184947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:16.184947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:16.184947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:16.185600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 374/777] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:47:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:16.193258 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c478a-0eae-497f-b51f-fd38e300b51f None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:16.254509 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 404/778] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:47:16.280936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46259ec-bff0-4d8b-a980-4c3cfe523f8a None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:16.390352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c478a-0eae-497f-b51f-fd38e300b51f None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:16.432090 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46259ec-bff0-4d8b-a980-4c3cfe523f8a None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:16.469489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db5c04-46a1-459b-aea9-ecdca09b8cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:16.470494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db5c04-46a1-459b-aea9-ecdca09b8cd2 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:16.470781 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db5c04-46a1-459b-aea9-ecdca09b8cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:16.471056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db5c04-46a1-459b-aea9-ecdca09b8cd2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:16.471711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db5c04-46a1-459b-aea9-ecdca09b8cd2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:16.473414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db5c04-46a1-459b-aea9-ecdca09b8cd2 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:16.488552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-80db5c04-46a1-459b-aea9-ecdca09b8cd2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:47:16.488552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:16.488552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:16.488552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:16.488552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:16.488552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:16.488552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:16.488552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:16.488552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:47:16.488552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:16.488552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:16.488552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:16.488552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:16.488552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:16.488552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:16.488552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:16.489550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:16.489550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:16.489550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:16.489550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:16.489550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:16.489550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:16.489550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:16.489550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:16.489550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:16.489550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:16.489550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:16.489550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:16.489550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:16.489550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:16.489550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:16.489550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:16.490414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:16.490414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:16.490414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:16.490414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:16.490414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:16.490414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:16.490414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:16.490414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:16.490414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:16.490414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:16.490414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:16.490414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:16.490414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:16.490414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:47:16.490414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:16.490414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 405/779] 10.222.0.49 () {56 vars in 1129 bytes} [Tue May 10 13:47:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:16.491290 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47518b-1762-41b8-a7e5-b8a4b4ba3104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:16.491897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47518b-1762-41b8-a7e5-b8a4b4ba3104 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:16.492082 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47518b-1762-41b8-a7e5-b8a4b4ba3104 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:16.496201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47518b-1762-41b8-a7e5-b8a4b4ba3104 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:16.496201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47518b-1762-41b8-a7e5-b8a4b4ba3104 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:16.496201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47518b-1762-41b8-a7e5-b8a4b4ba3104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:16.496201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47518b-1762-41b8-a7e5-b8a4b4ba3104 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:16.497019 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db5c04-46a1-459b-aea9-ecdca09b8cd2 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:16.511654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 375/780] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:47:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:16.512558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47518b-1762-41b8-a7e5-b8a4b4ba3104 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:16.671160 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db5c04-46a1-459b-aea9-ecdca09b8cd2 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:16.688113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47518b-1762-41b8-a7e5-b8a4b4ba3104 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:16.740545 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb928101-12e1-4bfe-90df-56db570daa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:16.741216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb928101-12e1-4bfe-90df-56db570daa9d None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:16.741495 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb928101-12e1-4bfe-90df-56db570daa9d None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:16.741769 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb928101-12e1-4bfe-90df-56db570daa9d None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:16.742472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb928101-12e1-4bfe-90df-56db570daa9d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:16.742778 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb928101-12e1-4bfe-90df-56db570daa9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:16.744733 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb928101-12e1-4bfe-90df-56db570daa9d None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:16.750490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 406/781] 10.222.0.49 () {56 vars in 1124 bytes} [Tue May 10 13:47:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:16.752141 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2e799-e388-4056-b29a-f65623c76474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:16.752971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2e799-e388-4056-b29a-f65623c76474 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:16.753249 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2e799-e388-4056-b29a-f65623c76474 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:16.753519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2e799-e388-4056-b29a-f65623c76474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:16.756978 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb928101-12e1-4bfe-90df-56db570daa9d None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:16.770438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2e799-e388-4056-b29a-f65623c76474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:16.772461 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2e799-e388-4056-b29a-f65623c76474 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:16.804499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-d5e2e799-e388-4056-b29a-f65623c76474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:16.804499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:16.804499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:16.804499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:16.804499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:16.804499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:16.804499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:16.804499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:16.804499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:16.804499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:16.804499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:16.804499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:16.804499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:16.804499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:16.804499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:16.805490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:16.805490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:16.805490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:16.805490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:16.805490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:16.805490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:16.805490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:16.805490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:16.805490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:16.805490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:16.805490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:16.805490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:16.805490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:16.805490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:16.805490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:16.805490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:16.805490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:16.806401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:16.806401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:16.806401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:16.806401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:16.806401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 376/782] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:16.811857 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2e799-e388-4056-b29a-f65623c76474 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:16.882076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb928101-12e1-4bfe-90df-56db570daa9d None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:16.919825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539dc93a-b014-4cb2-80dd-beedbe88a5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:16.920685 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dc93a-b014-4cb2-80dd-beedbe88a5b8 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:16.921016 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dc93a-b014-4cb2-80dd-beedbe88a5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:16.921344 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dc93a-b014-4cb2-80dd-beedbe88a5b8 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:16.922011 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539dc93a-b014-4cb2-80dd-beedbe88a5b8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:16.922314 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539dc93a-b014-4cb2-80dd-beedbe88a5b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:16.923680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539dc93a-b014-4cb2-80dd-beedbe88a5b8 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:16.934785 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 407/783] 10.222.0.49 () {56 vars in 1124 bytes} [Tue May 10 13:47:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:16.936038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539dc93a-b014-4cb2-80dd-beedbe88a5b8 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:17.003408 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2e799-e388-4056-b29a-f65623c76474 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:17.048884 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbfc39-d084-43f2-890d-d87df3358b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:17.049570 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbfc39-d084-43f2-890d-d87df3358b45 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.049863 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbfc39-d084-43f2-890d-d87df3358b45 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.050153 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbfc39-d084-43f2-890d-d87df3358b45 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.050883 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbfc39-d084-43f2-890d-d87df3358b45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:17.051190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbfc39-d084-43f2-890d-d87df3358b45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:17.053117 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbfc39-d084-43f2-890d-d87df3358b45 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:17.071798 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 377/784] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:17.077664 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbfc39-d084-43f2-890d-d87df3358b45 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:17.082924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539dc93a-b014-4cb2-80dd-beedbe88a5b8 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:17.116739 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed88fa2-8710-46dc-9ff2-edb5dce0035d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:17.117772 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed88fa2-8710-46dc-9ff2-edb5dce0035d None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.118255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed88fa2-8710-46dc-9ff2-edb5dce0035d None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.118728 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed88fa2-8710-46dc-9ff2-edb5dce0035d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.119706 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed88fa2-8710-46dc-9ff2-edb5dce0035d None admin] RBAC: Adding query filter params (interface=public, service_id=2461004e3ddd4ac2a7b64bcc3476db9e, region_id=RegionOne) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:17.120246 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed88fa2-8710-46dc-9ff2-edb5dce0035d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:17.121802 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed88fa2-8710-46dc-9ff2-edb5dce0035d None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:17.127318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 408/785] 10.222.0.49 () {56 vars in 1251 bytes} [Tue May 10 13:47:16 2022] GET /identity/v3/endpoints?service_id=2461004e3ddd4ac2a7b64bcc3476db9e&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:17.128740 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6e198-defa-4176-9298-c45053e2ed2a None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.129246 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6e198-defa-4176-9298-c45053e2ed2a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.129722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6e198-defa-4176-9298-c45053e2ed2a None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.135988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 409/786] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:17.137556 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0313817-2c34-4a7c-bff1-246c012a7f07 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.138044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0313817-2c34-4a7c-bff1-246c012a7f07 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.138521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0313817-2c34-4a7c-bff1-246c012a7f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.155123 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-d0313817-2c34-4a7c-bff1-246c012a7f07 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:17.156917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d0313817-2c34-4a7c-bff1-246c012a7f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:17.183694 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbfc39-d084-43f2-890d-d87df3358b45 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:17.217974 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62796491-2ece-4f84-ae54-41d7a32c683e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:17.218855 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62796491-2ece-4f84-ae54-41d7a32c683e None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.219060 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62796491-2ece-4f84-ae54-41d7a32c683e None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.219307 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62796491-2ece-4f84-ae54-41d7a32c683e None admin] PATH_INFO: `/v3/users/nova` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.232369 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62796491-2ece-4f84-ae54-41d7a32c683e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:17.232369 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62796491-2ece-4f84-ae54-41d7a32c683e None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:17.232742 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 410/787] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:17.233799 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0313817-2c34-4a7c-bff1-246c012a7f07 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:17.244389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-62796491-2ece-4f84-ae54-41d7a32c683e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:47:17.244389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:17.244389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:17.244389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:17.244389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:17.244389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:17.244389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:17.244389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:17.244389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:17.244389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:17.244389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:17.244389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:17.244389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:17.244389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:17.244389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:17.244389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:17.245425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:17.246468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:17.246468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:17.246468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:17.246468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:17.246468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:17.246468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:17.246468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:17.246468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:17.246468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:47:17.246468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:17.246468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 378/788] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 13:47:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:17.253985 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62796491-2ece-4f84-ae54-41d7a32c683e None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:17.357046 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0313817-2c34-4a7c-bff1-246c012a7f07 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:17.369143 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62796491-2ece-4f84-ae54-41d7a32c683e None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:17.403608 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d2daf-41ab-4917-bd54-a7a919a78c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:17.404267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b76f4-2377-4489-8598-96dbc9e645bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:17.404438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d2daf-41ab-4917-bd54-a7a919a78c30 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.404627 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d2daf-41ab-4917-bd54-a7a919a78c30 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.404853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d2daf-41ab-4917-bd54-a7a919a78c30 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.405955 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d2daf-41ab-4917-bd54-a7a919a78c30 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:17.406064 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b76f4-2377-4489-8598-96dbc9e645bf None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.406263 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d2daf-41ab-4917-bd54-a7a919a78c30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:17.406725 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b76f4-2377-4489-8598-96dbc9e645bf None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.407201 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b76f4-2377-4489-8598-96dbc9e645bf None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.407696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d2daf-41ab-4917-bd54-a7a919a78c30 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:17.408365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b76f4-2377-4489-8598-96dbc9e645bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:17.409902 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b76f4-2377-4489-8598-96dbc9e645bf None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:17.416156 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 411/789] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 13:47:17 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:17.417383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b76f4-2377-4489-8598-96dbc9e645bf None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:17.442988 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 379/790] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 13:47:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:17.453545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d2daf-41ab-4917-bd54-a7a919a78c30 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:17.547738 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b76f4-2377-4489-8598-96dbc9e645bf None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:17.586438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de74a4d-b470-41fc-8a4e-9a65bf223cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:17.587314 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de74a4d-b470-41fc-8a4e-9a65bf223cd0 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.587594 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de74a4d-b470-41fc-8a4e-9a65bf223cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.587917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de74a4d-b470-41fc-8a4e-9a65bf223cd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.592412 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d2daf-41ab-4917-bd54-a7a919a78c30 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:17.604649 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de74a4d-b470-41fc-8a4e-9a65bf223cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:17.612558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-6de74a4d-b470-41fc-8a4e-9a65bf223cd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:17.612558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:17.612558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:17.612558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:17.612558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:17.612558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:17.612558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:17.612558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:17.612558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:17.612558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:17.612558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:17.612558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:17.612558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:17.612558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:17.612558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:17.612558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:17.613520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:17.613520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:17.613520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:17.613520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:17.613520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:17.613520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:17.613520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:17.613520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:17.613520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:17.613520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:17.613520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:17.613520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:17.613520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:17.613520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:17.613520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:17.613520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:17.615331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:17.615331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:17.615331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:17.615331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:17.615331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:17.615331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:17.615331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:17.615331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:17.615331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:17.615331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:17.615331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:17.615331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:17.615331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 412/791] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:47:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:17.616436 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e04b3-cf4f-49cb-91fa-e145b493a60f None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.616436 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e04b3-cf4f-49cb-91fa-e145b493a60f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.616574 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e04b3-cf4f-49cb-91fa-e145b493a60f None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.617862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 413/792] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:17.622986 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e04b3-cf4f-49cb-91fa-e145b493a60f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:17.645135 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d58186-5cb4-4095-b3a1-0cd9a7b251fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:17.646414 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58186-5cb4-4095-b3a1-0cd9a7b251fd None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.646700 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58186-5cb4-4095-b3a1-0cd9a7b251fd None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.646975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58186-5cb4-4095-b3a1-0cd9a7b251fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.729607 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d58186-5cb4-4095-b3a1-0cd9a7b251fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:17.731713 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d58186-5cb4-4095-b3a1-0cd9a7b251fd None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:17.751296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e04b3-cf4f-49cb-91fa-e145b493a60f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:17.786796 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82346cd8-4e79-46aa-b599-e0de4ae3d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:17.787621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82346cd8-4e79-46aa-b599-e0de4ae3d64a None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.787997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82346cd8-4e79-46aa-b599-e0de4ae3d64a None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.788418 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82346cd8-4e79-46aa-b599-e0de4ae3d64a None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.789492 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82346cd8-4e79-46aa-b599-e0de4ae3d64a None admin] RBAC: Adding query filter params (name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:17.790032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82346cd8-4e79-46aa-b599-e0de4ae3d64a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:17.791406 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82346cd8-4e79-46aa-b599-e0de4ae3d64a None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:17.801588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 414/793] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:47:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:17.807670 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b8868-f649-4d9b-a802-95f4a57050ca None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:17.808019 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b8868-f649-4d9b-a802-95f4a57050ca None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:17.808411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b8868-f649-4d9b-a802-95f4a57050ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:17.825392 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-993b8868-f649-4d9b-a802-95f4a57050ca None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:17.826782 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-993b8868-f649-4d9b-a802-95f4a57050ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:17.858727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 380/794] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:47:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:47:17.858727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d58186-5cb4-4095-b3a1-0cd9a7b251fd None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:17.916790 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 415/795] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:17.917139 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b8868-f649-4d9b-a802-95f4a57050ca None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:17.993878 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d58186-5cb4-4095-b3a1-0cd9a7b251fd None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:18.035714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b8868-f649-4d9b-a802-95f4a57050ca None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:18.039906 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75656386-2350-4ac2-b402-6d8053946022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:18.040976 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656386-2350-4ac2-b402-6d8053946022 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.041472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656386-2350-4ac2-b402-6d8053946022 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.041977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656386-2350-4ac2-b402-6d8053946022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.055744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75656386-2350-4ac2-b402-6d8053946022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:18.058004 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75656386-2350-4ac2-b402-6d8053946022 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:18.069744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9d214-ba78-42b6-a76c-035c5a5c35ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:18.070588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9d214-ba78-42b6-a76c-035c5a5c35ac None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.070869 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9d214-ba78-42b6-a76c-035c5a5c35ac None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.071139 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9d214-ba78-42b6-a76c-035c5a5c35ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.081049 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9d214-ba78-42b6-a76c-035c5a5c35ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:18.082471 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9d214-ba78-42b6-a76c-035c5a5c35ac None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:18.082584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-75656386-2350-4ac2-b402-6d8053946022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:18.082584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:18.082584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:18.082584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:18.082584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:18.082584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:18.082584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:18.082584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:18.082584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:18.082584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:18.082584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:18.082584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:18.082584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:18.082584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:18.082584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:18.084054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:18.084054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:18.084054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:18.084054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:18.084054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:18.084054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:18.084054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:18.084054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:18.084054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:18.084054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:18.084054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:18.084054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:18.084054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:18.084054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:18.084054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:18.084054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:18.084054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:18.085043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:18.085043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:18.085043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:18.085043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:18.086220 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 381/796] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:18.086555 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75656386-2350-4ac2-b402-6d8053946022 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:18.109820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-35d9d214-ba78-42b6-a76c-035c5a5c35ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:18.109820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:18.109820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:18.109820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:18.109820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:18.109820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:18.109820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:18.109820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:18.109820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:18.109820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:18.109820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:18.109820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:18.109820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:18.109820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:18.109820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:18.110815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:18.110815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:18.110815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:18.110815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:18.110815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:18.110815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:18.110815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:18.110815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:18.110815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:18.110815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:18.110815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:18.110815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:18.110815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:18.110815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:18.110815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:18.110815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:18.110815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:18.111724 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:18.111724 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:18.111724 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:18.111724 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:18.118883 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 416/797] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:18.118883 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9d214-ba78-42b6-a76c-035c5a5c35ac None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:18.195222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75656386-2350-4ac2-b402-6d8053946022 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:18.233491 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235af26-4d39-429a-9d84-38ccc58b19a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:18.234296 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235af26-4d39-429a-9d84-38ccc58b19a3 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.234575 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235af26-4d39-429a-9d84-38ccc58b19a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.234850 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235af26-4d39-429a-9d84-38ccc58b19a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.247927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235af26-4d39-429a-9d84-38ccc58b19a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:18.250753 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9d214-ba78-42b6-a76c-035c5a5c35ac None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:18.256482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-3235af26-4d39-429a-9d84-38ccc58b19a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:18.256482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:18.256482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:18.256482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:18.256482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:18.256482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:18.256482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:18.256482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:18.256482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:18.256482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:18.256482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:18.256482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:18.256482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:18.256482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:18.256482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:18.256482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:18.257536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:18.257536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:18.257536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:18.257536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:18.257536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:18.257536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:18.257536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:18.257536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:18.257536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:18.257536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:18.257536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:18.257536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:18.257536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:18.257536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:18.257536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:18.257536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:18.258405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:18.258405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:18.258405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:18.258405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:18.258405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:18.258405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:18.258405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:18.258405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:18.258405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:18.258405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:18.258405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:18.258405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:18.262604 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 382/798] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:47:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:18.263464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235af26-4d39-429a-9d84-38ccc58b19a3 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:18.296999 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d11eca-e5f4-4071-b392-0a40715aa51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:18.298077 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d11eca-e5f4-4071-b392-0a40715aa51c None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.298747 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d11eca-e5f4-4071-b392-0a40715aa51c None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.300045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d11eca-e5f4-4071-b392-0a40715aa51c None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.301023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d11eca-e5f4-4071-b392-0a40715aa51c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:18.301544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d11eca-e5f4-4071-b392-0a40715aa51c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:18.303171 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d11eca-e5f4-4071-b392-0a40715aa51c None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:18.319152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 417/799] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:18.320375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d11eca-e5f4-4071-b392-0a40715aa51c None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:18.379106 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235af26-4d39-429a-9d84-38ccc58b19a3 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:18.416841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90852481-3c8e-4d9c-84df-c90f49f26a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:18.417676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90852481-3c8e-4d9c-84df-c90f49f26a51 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.417958 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90852481-3c8e-4d9c-84df-c90f49f26a51 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.418231 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90852481-3c8e-4d9c-84df-c90f49f26a51 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.418941 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90852481-3c8e-4d9c-84df-c90f49f26a51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:18.419244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90852481-3c8e-4d9c-84df-c90f49f26a51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:18.420644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90852481-3c8e-4d9c-84df-c90f49f26a51 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:18.437508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 383/800] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:18.438347 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90852481-3c8e-4d9c-84df-c90f49f26a51 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:18.441501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d11eca-e5f4-4071-b392-0a40715aa51c None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:18.477147 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae68da-f2ce-4c4c-8863-d5594a839786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:18.477816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae68da-f2ce-4c4c-8863-d5594a839786 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.478093 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae68da-f2ce-4c4c-8863-d5594a839786 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.478365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae68da-f2ce-4c4c-8863-d5594a839786 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.479108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae68da-f2ce-4c4c-8863-d5594a839786 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:18.479411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae68da-f2ce-4c4c-8863-d5594a839786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:18.480780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae68da-f2ce-4c4c-8863-d5594a839786 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:18.488640 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 418/801] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:47:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:18.490627 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fb72d-1e64-430d-9341-4758974f9175 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.491127 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fb72d-1e64-430d-9341-4758974f9175 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.491609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fb72d-1e64-430d-9341-4758974f9175 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.493280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 419/802] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:18.494199 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fb72d-1e64-430d-9341-4758974f9175 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:18.542252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90852481-3c8e-4d9c-84df-c90f49f26a51 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:18.575360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ce98d-c0c8-43f8-b62a-f4404a807dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:18.576189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ce98d-c0c8-43f8-b62a-f4404a807dc4 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.576489 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ce98d-c0c8-43f8-b62a-f4404a807dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.576751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ce98d-c0c8-43f8-b62a-f4404a807dc4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.584683 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ce98d-c0c8-43f8-b62a-f4404a807dc4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:18.586165 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ce98d-c0c8-43f8-b62a-f4404a807dc4 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:18.595056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fb72d-1e64-430d-9341-4758974f9175 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:18.602383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-259ce98d-c0c8-43f8-b62a-f4404a807dc4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:47:18.602383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:18.602383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:18.602383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:18.602383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:18.602383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:18.602383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:18.602383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:18.602383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:18.602383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:18.602383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:18.602383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:18.602383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:18.602383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:18.602383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:18.602383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:18.603341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:18.604337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:18.604337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:18.604337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:18.604337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:18.604337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:18.604337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:18.604337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:18.604337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:18.604337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:47:18.604337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:18.604337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 384/803] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 13:47:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:18.604945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ce98d-c0c8-43f8-b62a-f4404a807dc4 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:18.633677 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a09167-8f5b-4850-8b10-1b5e0fb1afc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:18.634476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a09167-8f5b-4850-8b10-1b5e0fb1afc8 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.634755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a09167-8f5b-4850-8b10-1b5e0fb1afc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.635032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a09167-8f5b-4850-8b10-1b5e0fb1afc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.641708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a09167-8f5b-4850-8b10-1b5e0fb1afc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:18.643133 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a09167-8f5b-4850-8b10-1b5e0fb1afc8 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:18.660190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-36a09167-8f5b-4850-8b10-1b5e0fb1afc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:18.660190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:18.660190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:18.660190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:18.660190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:18.660190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:18.660190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:18.660190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:18.660190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:18.660190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:18.660190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:18.660190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:18.660190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:18.660190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:18.660190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:18.661687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:18.661687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:18.661687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:18.661687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:18.661687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:18.661687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:18.661687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:18.661687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:18.661687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:18.661687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:18.661687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:18.661687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:18.661687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:18.661687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:18.661687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:18.661687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:18.661687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:18.662616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:18.662616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:18.662616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:18.662616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:18.662616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:18.662616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:18.662616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:18.662616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:18.662616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 420/804] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:18.663642 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17a032-6156-441f-bf36-7b561803c19b None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.663642 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17a032-6156-441f-bf36-7b561803c19b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.663642 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17a032-6156-441f-bf36-7b561803c19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.680892 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-fe17a032-6156-441f-bf36-7b561803c19b None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:18.682058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-fe17a032-6156-441f-bf36-7b561803c19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:18.711295 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ce98d-c0c8-43f8-b62a-f4404a807dc4 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:18.744116 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde8a63-58c8-4bb1-bcfb-b4105e26a008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:18.744932 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde8a63-58c8-4bb1-bcfb-b4105e26a008 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.745214 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde8a63-58c8-4bb1-bcfb-b4105e26a008 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.745487 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde8a63-58c8-4bb1-bcfb-b4105e26a008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.752307 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 421/805] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:18.753151 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17a032-6156-441f-bf36-7b561803c19b None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:18.762462 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde8a63-58c8-4bb1-bcfb-b4105e26a008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:18.763915 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde8a63-58c8-4bb1-bcfb-b4105e26a008 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:18.782634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-8bde8a63-58c8-4bb1-bcfb-b4105e26a008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:18.782634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:18.782634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:18.782634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:18.782634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:18.782634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:18.782634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:18.782634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:18.782634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:18.782634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:18.782634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:18.782634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:18.782634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:18.782634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:18.782634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:18.783569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:18.783569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:18.783569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:18.783569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:18.783569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:18.783569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:18.783569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:18.783569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:18.783569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:18.783569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:18.783569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:18.783569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:18.783569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:18.783569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:18.783569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:18.783569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:18.783569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:18.784962 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:18.784962 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:18.784962 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:18.784962 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:18.784962 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 385/806] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:18.784962 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde8a63-58c8-4bb1-bcfb-b4105e26a008 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:18.857538 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17a032-6156-441f-bf36-7b561803c19b None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:18.878227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde8a63-58c8-4bb1-bcfb-b4105e26a008 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:18.897189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4df78-3bc7-485e-9943-3a1ce854f7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:18.898128 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4df78-3bc7-485e-9943-3a1ce854f7ff None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.898243 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4df78-3bc7-485e-9943-3a1ce854f7ff None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.898550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4df78-3bc7-485e-9943-3a1ce854f7ff None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.899392 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4df78-3bc7-485e-9943-3a1ce854f7ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:18.899686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4df78-3bc7-485e-9943-3a1ce854f7ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:18.901290 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4df78-3bc7-485e-9943-3a1ce854f7ff None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:18.911751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05b593-3093-44e6-a388-8d4605782167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:18.912423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05b593-3093-44e6-a388-8d4605782167 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:18.912700 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05b593-3093-44e6-a388-8d4605782167 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:18.912970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05b593-3093-44e6-a388-8d4605782167 None admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:18.913737 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05b593-3093-44e6-a388-8d4605782167 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:18.914053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05b593-3093-44e6-a388-8d4605782167 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:18.915444 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05b593-3093-44e6-a388-8d4605782167 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:18.919039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 422/807] 10.222.0.49 () {56 vars in 1149 bytes} [Tue May 10 13:47:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:18.919981 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4df78-3bc7-485e-9943-3a1ce854f7ff None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:18.928234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 386/808] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:18.928234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05b593-3093-44e6-a388-8d4605782167 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:19.027041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05b593-3093-44e6-a388-8d4605782167 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:19.028057 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4df78-3bc7-485e-9943-3a1ce854f7ff None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:19.060317 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e9ebb-66e9-477d-8f6a-dcc8a61c47b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:19.060976 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e9ebb-66e9-477d-8f6a-dcc8a61c47b8 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:19.061256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e9ebb-66e9-477d-8f6a-dcc8a61c47b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:19.061528 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e9ebb-66e9-477d-8f6a-dcc8a61c47b8 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:19.062236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e9ebb-66e9-477d-8f6a-dcc8a61c47b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:19.062539 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e9ebb-66e9-477d-8f6a-dcc8a61c47b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:19.063900 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e9ebb-66e9-477d-8f6a-dcc8a61c47b8 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:19.070352 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b08c1a-4ede-4b38-9a7b-f4e5fe95e318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:19.071338 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b08c1a-4ede-4b38-9a7b-f4e5fe95e318 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:19.071767 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b08c1a-4ede-4b38-9a7b-f4e5fe95e318 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:19.072205 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b08c1a-4ede-4b38-9a7b-f4e5fe95e318 None admin] PATH_INFO: `/v3/services/network` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:19.072998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b08c1a-4ede-4b38-9a7b-f4e5fe95e318 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:19.074494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b08c1a-4ede-4b38-9a7b-f4e5fe95e318 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:19.075438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 387/809] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:19.076414 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e9ebb-66e9-477d-8f6a-dcc8a61c47b8 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:19.090705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-40b08c1a-4ede-4b38-9a7b-f4e5fe95e318 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:47:19.090705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:19.090705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:19.090705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:19.090705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:19.090705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:19.090705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:19.090705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:19.090705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:47:19.090705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:19.090705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:19.090705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:19.090705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:19.090705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:19.090705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:19.090705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:19.090705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:19.091942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:19.091942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:19.091942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:19.091942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:19.091942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:19.091942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:19.091942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:19.091942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:19.091942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:19.091942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:19.091942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:19.091942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:19.091942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:19.091942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:19.091942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:19.091942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:19.092959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:19.092959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:19.092959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:19.092959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:19.092959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:19.092959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:19.092959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:19.092959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:19.092959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:19.092959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:19.092959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:19.092959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:19.092959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 13:47:19.092959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:19.092959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 423/810] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:18 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:19.093818 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b08c1a-4ede-4b38-9a7b-f4e5fe95e318 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:19.181044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e9ebb-66e9-477d-8f6a-dcc8a61c47b8 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:19.190912 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b08c1a-4ede-4b38-9a7b-f4e5fe95e318 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:19.214046 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38ccca-40b6-43bd-a5c5-d670ff0dc346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:19.214820 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38ccca-40b6-43bd-a5c5-d670ff0dc346 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:19.215133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38ccca-40b6-43bd-a5c5-d670ff0dc346 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:19.215375 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38ccca-40b6-43bd-a5c5-d670ff0dc346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:19.223863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427ecba-cbaf-40e5-b9c3-e19c687ce6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:19.224536 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427ecba-cbaf-40e5-b9c3-e19c687ce6c1 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:19.224811 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427ecba-cbaf-40e5-b9c3-e19c687ce6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:19.225079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427ecba-cbaf-40e5-b9c3-e19c687ce6c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:19.225191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38ccca-40b6-43bd-a5c5-d670ff0dc346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:19.225891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427ecba-cbaf-40e5-b9c3-e19c687ce6c1 None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=975f10f781b94bdaa8edee39a2b1bba4) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:19.226193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427ecba-cbaf-40e5-b9c3-e19c687ce6c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:19.226566 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38ccca-40b6-43bd-a5c5-d670ff0dc346 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:19.227567 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427ecba-cbaf-40e5-b9c3-e19c687ce6c1 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:19.233820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 424/811] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:47:19 2022] GET /identity/v3/role_assignments?user.id=975f10f781b94bdaa8edee39a2b1bba4&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:19.235319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427ecba-cbaf-40e5-b9c3-e19c687ce6c1 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:19.244473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-2a38ccca-40b6-43bd-a5c5-d670ff0dc346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:19.244473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:19.244473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:19.244473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:19.244473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:19.244473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:19.244473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:19.244473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:19.244473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:19.244473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:19.244473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:19.244473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:19.244473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:19.244473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:19.244473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:19.245454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:19.245454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:19.245454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:19.245454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:19.245454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:19.245454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:19.245454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:19.245454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:19.245454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:19.245454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:19.245454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:19.245454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:19.245454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:19.245454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:19.245454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:19.245454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:19.245454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:19.246390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:19.246390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:19.246390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:19.246390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:19.250481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 388/812] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:19.251471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38ccca-40b6-43bd-a5c5-d670ff0dc346 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:19.361939 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38ccca-40b6-43bd-a5c5-d670ff0dc346 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:19.373627 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427ecba-cbaf-40e5-b9c3-e19c687ce6c1 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:19.399628 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3e756-5d09-48e0-b3ce-3db690faa841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:19.400346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3e756-5d09-48e0-b3ce-3db690faa841 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:19.400973 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3e756-5d09-48e0-b3ce-3db690faa841 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:19.400973 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3e756-5d09-48e0-b3ce-3db690faa841 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:19.401702 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3e756-5d09-48e0-b3ce-3db690faa841 None admin] RBAC: Adding query filter params (name=network) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:19.402011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3e756-5d09-48e0-b3ce-3db690faa841 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:19.403409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3e756-5d09-48e0-b3ce-3db690faa841 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:19.408997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 389/813] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 13:47:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:19.409913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3e756-5d09-48e0-b3ce-3db690faa841 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:19.421301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2dd58-3327-4f3a-92fa-6bcfe970290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:19.422208 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2dd58-3327-4f3a-92fa-6bcfe970290e None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:19.422561 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2dd58-3327-4f3a-92fa-6bcfe970290e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:19.423476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2dd58-3327-4f3a-92fa-6bcfe970290e None admin] PATH_INFO: `/v3/users/swift` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:19.433607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2dd58-3327-4f3a-92fa-6bcfe970290e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:19.435940 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2dd58-3327-4f3a-92fa-6bcfe970290e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:19.454488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-8ce2dd58-3327-4f3a-92fa-6bcfe970290e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 13:47:19.454488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:19.454488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:19.454488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:19.454488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:19.454488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:19.454488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:19.454488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:19.454488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:19.454488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:19.454488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:19.454488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:19.454488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:19.454488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:19.454488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:19.454488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:19.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:19.457174 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:19.457174 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:19.457174 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:19.457174 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:19.457174 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:19.457174 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:19.457174 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:19.457174 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:19.457174 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 13:47:19.457174 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:19.458190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 425/814] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:47:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:19.458349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2dd58-3327-4f3a-92fa-6bcfe970290e None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:19.537525 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3e756-5d09-48e0-b3ce-3db690faa841 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:19.570755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2dd58-3327-4f3a-92fa-6bcfe970290e None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:19.581502 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b073290-e1f0-468d-8461-4f18968387dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:19.582522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b073290-e1f0-468d-8461-4f18968387dd None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:19.582828 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b073290-e1f0-468d-8461-4f18968387dd None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:19.583109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b073290-e1f0-468d-8461-4f18968387dd None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:19.584119 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b073290-e1f0-468d-8461-4f18968387dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:19.584453 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b073290-e1f0-468d-8461-4f18968387dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:19.586008 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b073290-e1f0-468d-8461-4f18968387dd None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:19.601808 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 390/815] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:19.604672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b073290-e1f0-468d-8461-4f18968387dd None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:19.613460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165821d-cfe5-4237-9781-0fb5628eb9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:19.614746 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165821d-cfe5-4237-9781-0fb5628eb9e0 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:19.615029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165821d-cfe5-4237-9781-0fb5628eb9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:19.615303 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165821d-cfe5-4237-9781-0fb5628eb9e0 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:19.616013 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165821d-cfe5-4237-9781-0fb5628eb9e0 None admin] RBAC: Adding query filter params (type=network) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:19.616357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165821d-cfe5-4237-9781-0fb5628eb9e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:19.617719 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165821d-cfe5-4237-9781-0fb5628eb9e0 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:19.624684 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 426/816] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 13:47:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:19.625710 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165821d-cfe5-4237-9781-0fb5628eb9e0 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:19.713118 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b073290-e1f0-468d-8461-4f18968387dd None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:19.745369 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165821d-cfe5-4237-9781-0fb5628eb9e0 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:19.747590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b2e55-f62d-4284-989c-4be07cddb1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:19.748285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b2e55-f62d-4284-989c-4be07cddb1c2 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:19.748568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b2e55-f62d-4284-989c-4be07cddb1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:19.748840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b2e55-f62d-4284-989c-4be07cddb1c2 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:19.749666 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b2e55-f62d-4284-989c-4be07cddb1c2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:19.749969 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b2e55-f62d-4284-989c-4be07cddb1c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:19.751373 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b2e55-f62d-4284-989c-4be07cddb1c2 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:19.768404 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 391/817] 10.222.0.49 () {56 vars in 1135 bytes} [Tue May 10 13:47:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:19.769458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b2e55-f62d-4284-989c-4be07cddb1c2 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:19.783504 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f38d78-d946-4cfe-a690-6b7cadd82cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:19.784333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f38d78-d946-4cfe-a690-6b7cadd82cd5 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:19.784615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f38d78-d946-4cfe-a690-6b7cadd82cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:19.785111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f38d78-d946-4cfe-a690-6b7cadd82cd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:19.792089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f38d78-d946-4cfe-a690-6b7cadd82cd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:19.793635 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f38d78-d946-4cfe-a690-6b7cadd82cd5 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:19.808079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-e2f38d78-d946-4cfe-a690-6b7cadd82cd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:19.808079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:19.808079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:19.808079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:19.808079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:19.808079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:19.808079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:19.808079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:19.808079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:19.808079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:19.808079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:19.808079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:19.808079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:19.808079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:19.808079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:19.809007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:19.809007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:19.809007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:19.809007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:19.809007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:19.809007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:19.809007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:19.809007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:19.809007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:19.809007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:19.809007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:19.809007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:19.809007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:19.809007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:19.809007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:19.809007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:19.809007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:19.809921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:19.809921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:19.809921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:19.809921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:19.809921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:19.809921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:19.809921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:19.809921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:19.809921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 427/818] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:19.810885 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d3c68-e820-4017-be6a-8e8fdc6ac936 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:19.810885 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d3c68-e820-4017-be6a-8e8fdc6ac936 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:19.811124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d3c68-e820-4017-be6a-8e8fdc6ac936 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:19.816212 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 428/819] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:19.816212 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d3c68-e820-4017-be6a-8e8fdc6ac936 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:19.875482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b2e55-f62d-4284-989c-4be07cddb1c2 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:19.908915 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38dfe89-eba7-40db-8c46-e0675b356f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:19.909575 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38dfe89-eba7-40db-8c46-e0675b356f3a None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:19.909854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38dfe89-eba7-40db-8c46-e0675b356f3a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:19.910126 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38dfe89-eba7-40db-8c46-e0675b356f3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:19.910857 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38dfe89-eba7-40db-8c46-e0675b356f3a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:19.912264 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38dfe89-eba7-40db-8c46-e0675b356f3a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:19.933403 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 392/820] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 13:47:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:19.934212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38dfe89-eba7-40db-8c46-e0675b356f3a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:19.952223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d3c68-e820-4017-be6a-8e8fdc6ac936 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:19.990853 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2823a7-034c-43ef-97b4-5ab319327364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:19.992044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2823a7-034c-43ef-97b4-5ab319327364 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:19.992530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2823a7-034c-43ef-97b4-5ab319327364 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:19.992982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2823a7-034c-43ef-97b4-5ab319327364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:20.005546 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2823a7-034c-43ef-97b4-5ab319327364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:20.007477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2823a7-034c-43ef-97b4-5ab319327364 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:20.027035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-ec2823a7-034c-43ef-97b4-5ab319327364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:20.027035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:20.027035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:20.027035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:20.027035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:20.027035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:20.027035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:20.027035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:20.027035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:20.027035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:20.027035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:20.027035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:20.027035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:20.027035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:20.027035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:20.028009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:20.028009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:20.028009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:20.028009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:20.028009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:20.028009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:20.028009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:20.028009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:20.028009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:20.028009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:20.028009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:20.028009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:20.028009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:20.028009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:20.028009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:20.028009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:20.028009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:20.028946 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:20.028946 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:20.028946 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:20.028946 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:20.031694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 429/821] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:20.033294 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f01b72-f155-46d4-8b31-08119868f410 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:20.033769 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f01b72-f155-46d4-8b31-08119868f410 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:20.034283 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f01b72-f155-46d4-8b31-08119868f410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:20.053508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38dfe89-eba7-40db-8c46-e0675b356f3a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:20.055460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-21f01b72-f155-46d4-8b31-08119868f410 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:20.057062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-21f01b72-f155-46d4-8b31-08119868f410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:20.093133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf54c76-9090-43a1-8521-ea410e59dbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:20.094343 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf54c76-9090-43a1-8521-ea410e59dbce None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:20.094809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf54c76-9090-43a1-8521-ea410e59dbce None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:20.095283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf54c76-9090-43a1-8521-ea410e59dbce None admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:20.097488 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf54c76-9090-43a1-8521-ea410e59dbce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:20.098038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf54c76-9090-43a1-8521-ea410e59dbce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:20.099787 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf54c76-9090-43a1-8521-ea410e59dbce None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:20.121992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 393/822] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:20.123283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf54c76-9090-43a1-8521-ea410e59dbce None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:20.140253 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 430/823] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:20.141440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f01b72-f155-46d4-8b31-08119868f410 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:20.247705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f01b72-f155-46d4-8b31-08119868f410 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:20.254251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf54c76-9090-43a1-8521-ea410e59dbce None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:20.290605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c885e-81bb-4429-a93d-36a535302b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:20.290835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c443bf7-5c1a-43ae-96e5-086c2356d3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:20.291267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c443bf7-5c1a-43ae-96e5-086c2356d3c6 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:20.291489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c885e-81bb-4429-a93d-36a535302b32 None admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:20.291590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c443bf7-5c1a-43ae-96e5-086c2356d3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:20.291769 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c885e-81bb-4429-a93d-36a535302b32 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:20.291866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c443bf7-5c1a-43ae-96e5-086c2356d3c6 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:20.292038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c885e-81bb-4429-a93d-36a535302b32 None admin] PATH_INFO: `/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/df5dcdfb4eda417ebc0af2432497617d/roles/10053e4259ae4b3bbbdbefa96320c937` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:20.292538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c443bf7-5c1a-43ae-96e5-086c2356d3c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:20.292838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c443bf7-5c1a-43ae-96e5-086c2356d3c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:20.294192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c443bf7-5c1a-43ae-96e5-086c2356d3c6 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:20.306288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 394/824] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:20.306879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c443bf7-5c1a-43ae-96e5-086c2356d3c6 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:20.309039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c885e-81bb-4429-a93d-36a535302b32 None admin] RBAC: Authorizing `identity:create_grant(project_id=9613de9a3bc9461d9d348e5b66b8d684, user_id=df5dcdfb4eda417ebc0af2432497617d, role_id=10053e4259ae4b3bbbdbefa96320c937)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:20.311582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c885e-81bb-4429-a93d-36a535302b32 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:20.326430 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 431/825] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:47:20 2022] PUT /identity/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/df5dcdfb4eda417ebc0af2432497617d/roles/10053e4259ae4b3bbbdbefa96320c937 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:47:20.327211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c885e-81bb-4429-a93d-36a535302b32 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:20.433484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c885e-81bb-4429-a93d-36a535302b32 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:20.465166 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c443bf7-5c1a-43ae-96e5-086c2356d3c6 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:20.477105 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edb2dd-dde0-4141-b776-e1d6af4f4ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:20.478812 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edb2dd-dde0-4141-b776-e1d6af4f4ee1 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:20.479377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edb2dd-dde0-4141-b776-e1d6af4f4ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:20.479978 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edb2dd-dde0-4141-b776-e1d6af4f4ee1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:20.488719 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edb2dd-dde0-4141-b776-e1d6af4f4ee1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:20.490585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edb2dd-dde0-4141-b776-e1d6af4f4ee1 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:20.503208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350b6bc-2228-4280-8b50-12bf4fd13769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:20.504110 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350b6bc-2228-4280-8b50-12bf4fd13769 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:20.504506 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350b6bc-2228-4280-8b50-12bf4fd13769 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:20.505393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350b6bc-2228-4280-8b50-12bf4fd13769 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:20.506137 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350b6bc-2228-4280-8b50-12bf4fd13769 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:20.507600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350b6bc-2228-4280-8b50-12bf4fd13769 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:20.510867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-b1edb2dd-dde0-4141-b776-e1d6af4f4ee1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:20.510867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:20.510867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:20.510867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:20.510867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:20.510867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:20.510867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:20.510867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:20.510867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:20.510867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:20.510867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:20.510867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:20.510867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:20.510867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:20.510867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:20.511810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:20.511810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:20.511810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:20.511810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:20.511810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:20.511810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:20.511810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:20.511810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:20.511810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:20.511810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:20.511810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:20.511810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:20.511810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:20.511810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:20.511810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:20.511810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:20.511810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:20.512745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:20.512745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:20.512745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:20.512745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:20.512745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:20.512745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:20.512745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:20.512745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:20.516323 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 432/826] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:20.519827 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edb2dd-dde0-4141-b776-e1d6af4f4ee1 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:20.528895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-5350b6bc-2228-4280-8b50-12bf4fd13769 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:47:20.528895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:20.528895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:20.528895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:20.528895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:20.528895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:20.528895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:20.528895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:20.528895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:47:20.528895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:20.528895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:20.528895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:20.528895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:20.528895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:20.528895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:20.528895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:20.529892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:20.529892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:20.529892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:20.529892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:20.529892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:20.529892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:20.529892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:20.529892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:20.529892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:20.529892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:20.529892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:20.529892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:20.529892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:20.529892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:20.529892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:20.529892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:20.531011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:20.531011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:20.531011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:20.531011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:20.531011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:20.531011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:20.531011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:20.531011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:20.531011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:20.531011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:20.531011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:20.531011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:20.531011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:20.531011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 13:47:20.531011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:20.531879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 395/827] 10.222.0.49 () {56 vars in 1129 bytes} [Tue May 10 13:47:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:20.541199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350b6bc-2228-4280-8b50-12bf4fd13769 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:20.641525 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edb2dd-dde0-4141-b776-e1d6af4f4ee1 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:20.662573 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350b6bc-2228-4280-8b50-12bf4fd13769 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:20.679589 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225780e-ba3a-4446-b05a-f3dc59cc2f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:20.680423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225780e-ba3a-4446-b05a-f3dc59cc2f1e None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:20.680772 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225780e-ba3a-4446-b05a-f3dc59cc2f1e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:20.681112 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225780e-ba3a-4446-b05a-f3dc59cc2f1e None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:20.682025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225780e-ba3a-4446-b05a-f3dc59cc2f1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:20.682400 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225780e-ba3a-4446-b05a-f3dc59cc2f1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:20.683900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225780e-ba3a-4446-b05a-f3dc59cc2f1e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:20.697562 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 433/828] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:20.702019 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4573055-96e6-4a90-9c95-81357f01ac40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:20.702689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4573055-96e6-4a90-9c95-81357f01ac40 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:20.702969 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4573055-96e6-4a90-9c95-81357f01ac40 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:20.703240 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4573055-96e6-4a90-9c95-81357f01ac40 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:20.703354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225780e-ba3a-4446-b05a-f3dc59cc2f1e None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:20.703936 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4573055-96e6-4a90-9c95-81357f01ac40 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:20.704268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4573055-96e6-4a90-9c95-81357f01ac40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:20.705762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4573055-96e6-4a90-9c95-81357f01ac40 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:20.711653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 396/829] 10.222.0.49 () {56 vars in 1124 bytes} [Tue May 10 13:47:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:20.716973 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4573055-96e6-4a90-9c95-81357f01ac40 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:20.803519 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225780e-ba3a-4446-b05a-f3dc59cc2f1e None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:20.815396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4573055-96e6-4a90-9c95-81357f01ac40 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:20.838395 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53652cd6-4127-4737-bcfa-d23bf63d5d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:20.839322 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53652cd6-4127-4737-bcfa-d23bf63d5d4f None admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:20.839603 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53652cd6-4127-4737-bcfa-d23bf63d5d4f None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:20.839878 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53652cd6-4127-4737-bcfa-d23bf63d5d4f None admin] PATH_INFO: `/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/d102155cd1bd4368ad272668da1651f4/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:20.842110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53652cd6-4127-4737-bcfa-d23bf63d5d4f None admin] RBAC: Authorizing `identity:create_grant(project_id=9613de9a3bc9461d9d348e5b66b8d684, user_id=d102155cd1bd4368ad272668da1651f4, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:20.843599 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53652cd6-4127-4737-bcfa-d23bf63d5d4f None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:20.849925 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e6eae-7851-4060-b17a-a88cd3eeb400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:20.850639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e6eae-7851-4060-b17a-a88cd3eeb400 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:20.850981 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e6eae-7851-4060-b17a-a88cd3eeb400 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:20.851184 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e6eae-7851-4060-b17a-a88cd3eeb400 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:20.851888 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e6eae-7851-4060-b17a-a88cd3eeb400 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:20.852194 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e6eae-7851-4060-b17a-a88cd3eeb400 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:20.853662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e6eae-7851-4060-b17a-a88cd3eeb400 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:20.863547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 397/831] 10.222.0.49 () {56 vars in 1124 bytes} [Tue May 10 13:47:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:20.863844 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 434/831] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:47:20 2022] PUT /identity/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/d102155cd1bd4368ad272668da1651f4/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 13:47:20.865201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e6eae-7851-4060-b17a-a88cd3eeb400 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:20.977150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e6eae-7851-4060-b17a-a88cd3eeb400 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:21.021763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17866e42-bd73-4ef2-84ca-a8c25b07456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:21.022443 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17866e42-bd73-4ef2-84ca-a8c25b07456b None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:21.022734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17866e42-bd73-4ef2-84ca-a8c25b07456b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:21.022991 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17866e42-bd73-4ef2-84ca-a8c25b07456b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:21.023738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17866e42-bd73-4ef2-84ca-a8c25b07456b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:21.025129 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17866e42-bd73-4ef2-84ca-a8c25b07456b None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:21.051125 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 398/832] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 13:47:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:21.624315 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec77b8-1cb3-44c4-bfb9-c01a78d31af9 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:21.625034 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec77b8-1cb3-44c4-bfb9-c01a78d31af9 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:21.625034 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec77b8-1cb3-44c4-bfb9-c01a78d31af9 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:21.626498 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 435/833] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:21.632041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad566a88-2d16-4f97-b7ec-8f0c71b8063a None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:21.632548 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad566a88-2d16-4f97-b7ec-8f0c71b8063a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:21.632700 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad566a88-2d16-4f97-b7ec-8f0c71b8063a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:21.651344 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-ad566a88-2d16-4f97-b7ec-8f0c71b8063a None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:21.652484 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ad566a88-2d16-4f97-b7ec-8f0c71b8063a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:21.732807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 399/834] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:47:21.754384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec77b8-1cb3-44c4-bfb9-c01a78d31af9 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:21.855803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec77b8-1cb3-44c4-bfb9-c01a78d31af9 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:21.889594 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e941e9-ffd1-448b-a680-faf2105da934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:21.890404 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e941e9-ffd1-448b-a680-faf2105da934 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:21.890686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e941e9-ffd1-448b-a680-faf2105da934 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:21.890960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e941e9-ffd1-448b-a680-faf2105da934 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:21.891610 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e941e9-ffd1-448b-a680-faf2105da934 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:21.892996 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e941e9-ffd1-448b-a680-faf2105da934 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:21.906138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-82e941e9-ffd1-448b-a680-faf2105da934 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:47:21.906138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:21.906138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:21.906138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:21.906138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:21.906138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:21.906138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:21.906138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:21.906138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:47:21.906138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:21.906138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:21.906138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:21.906138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:21.906138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:21.906138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:21.906138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:21.908319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:21.908319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:21.908319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:21.908319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:21.908319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:21.908319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:21.908319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:21.908319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:21.908319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:21.908319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:21.908319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:21.908319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:21.908319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:21.908319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:21.908319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:21.908319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:21.910256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:21.910256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:21.910256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:21.910256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:21.910256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:21.910256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:21.910256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:21.910256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:21.910256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:21.910256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:21.910256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:21.910256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:21.910256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:21.910256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:47:21.910256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:21.916213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 436/835] 10.222.0.49 () {56 vars in 1132 bytes} [Tue May 10 13:47:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:21.921251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad566a88-2d16-4f97-b7ec-8f0c71b8063a None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:22.019107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad566a88-2d16-4f97-b7ec-8f0c71b8063a None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:22.059014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1834f43-f23a-49db-a5c9-831f0b8c70ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:22.059684 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1834f43-f23a-49db-a5c9-831f0b8c70ec None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:22.059961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1834f43-f23a-49db-a5c9-831f0b8c70ec None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:22.060267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1834f43-f23a-49db-a5c9-831f0b8c70ec None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:22.060971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1834f43-f23a-49db-a5c9-831f0b8c70ec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:22.061272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1834f43-f23a-49db-a5c9-831f0b8c70ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:22.062632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1834f43-f23a-49db-a5c9-831f0b8c70ec None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:22.068197 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 400/836] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 13:47:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:22.073718 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e941e9-ffd1-448b-a680-faf2105da934 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:22.185062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e941e9-ffd1-448b-a680-faf2105da934 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:22.221597 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcef3b5-a91f-4c77-841a-2de7bb0b38e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:22.222711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcef3b5-a91f-4c77-841a-2de7bb0b38e2 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:22.223199 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcef3b5-a91f-4c77-841a-2de7bb0b38e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:22.223822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcef3b5-a91f-4c77-841a-2de7bb0b38e2 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:22.224756 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcef3b5-a91f-4c77-841a-2de7bb0b38e2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:22.225266 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcef3b5-a91f-4c77-841a-2de7bb0b38e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:22.226880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcef3b5-a91f-4c77-841a-2de7bb0b38e2 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:22.236375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 437/837] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 13:47:22 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:22.684126 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc0d99-ff54-4a57-b11a-d9218eeb93a6 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:22.684664 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc0d99-ff54-4a57-b11a-d9218eeb93a6 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:22.684745 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc0d99-ff54-4a57-b11a-d9218eeb93a6 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:22.686338 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 401/838] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:22.691827 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e1381-3f45-47af-863b-84bb82457582 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:22.692800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e1381-3f45-47af-863b-84bb82457582 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:22.692976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e1381-3f45-47af-863b-84bb82457582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:22.710281 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-d64e1381-3f45-47af-863b-84bb82457582 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:22.711470 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d64e1381-3f45-47af-863b-84bb82457582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:22.778600 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 438/839] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:22.801792 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc0d99-ff54-4a57-b11a-d9218eeb93a6 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:22.909866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc0d99-ff54-4a57-b11a-d9218eeb93a6 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:22.944732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e122b-78cf-4b08-9e17-e4564d016eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:22.945485 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e122b-78cf-4b08-9e17-e4564d016eaf None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:22.945769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e122b-78cf-4b08-9e17-e4564d016eaf None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:22.946041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e122b-78cf-4b08-9e17-e4564d016eaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:22.956502 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e122b-78cf-4b08-9e17-e4564d016eaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:22.964319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-ef9e122b-78cf-4b08-9e17-e4564d016eaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:22.964319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:22.964319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:22.964319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:22.964319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:22.964319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:22.964319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:22.964319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:22.964319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:22.964319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:22.964319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:22.964319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:22.964319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:22.964319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:22.964319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:22.964319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:22.965289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:22.965289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:22.965289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:22.965289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:22.965289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:22.965289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:22.965289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:22.965289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:22.965289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:22.965289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:22.965289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:22.965289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:22.965289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:22.965289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:22.965289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:22.965289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:22.966415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:22.966415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:22.966415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:22.966415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:22.966415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:22.966415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:22.966415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:22.966415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:22.966415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:22.966415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:22.966415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:47:22.966415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:22.966415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 402/840] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:47:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:22.971923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e1381-3f45-47af-863b-84bb82457582 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:23.081659 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e1381-3f45-47af-863b-84bb82457582 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:23.116737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a04881-4add-4fde-8bb1-ab1abd372e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:23.117864 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a04881-4add-4fde-8bb1-ab1abd372e56 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:23.118332 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a04881-4add-4fde-8bb1-ab1abd372e56 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:23.118786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a04881-4add-4fde-8bb1-ab1abd372e56 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:23.119759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a04881-4add-4fde-8bb1-ab1abd372e56 None admin] RBAC: Adding query filter params (name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:23.120302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a04881-4add-4fde-8bb1-ab1abd372e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:23.121934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a04881-4add-4fde-8bb1-ab1abd372e56 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:23.132565 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 439/841] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:47:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:23.144197 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e122b-78cf-4b08-9e17-e4564d016eaf None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:23.199950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d3f46-461e-4c0f-b5ac-d5f6367ec42d None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:23.200591 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d3f46-461e-4c0f-b5ac-d5f6367ec42d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:23.200870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d3f46-461e-4c0f-b5ac-d5f6367ec42d None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:23.202359 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 440/842] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:23.209309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f16a3-139c-4d58-8220-ef32d4a7563d None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:23.210025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f16a3-139c-4d58-8220-ef32d4a7563d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:23.210454 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f16a3-139c-4d58-8220-ef32d4a7563d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:23.231951 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f10f16a3-139c-4d58-8220-ef32d4a7563d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:23.233544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f10f16a3-139c-4d58-8220-ef32d4a7563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:23.255227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e122b-78cf-4b08-9e17-e4564d016eaf None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:23.295589 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce37a0c-e250-4ab1-876b-711612c5b16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:23.296758 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce37a0c-e250-4ab1-876b-711612c5b16e None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:23.297118 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce37a0c-e250-4ab1-876b-711612c5b16e None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:23.297463 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce37a0c-e250-4ab1-876b-711612c5b16e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:23.312621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce37a0c-e250-4ab1-876b-711612c5b16e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:23.314265 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce37a0c-e250-4ab1-876b-711612c5b16e None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:23.314541 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 441/843] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:47:23.318569 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6a51d-32d6-483c-a2b8-4c581ebde46f None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:23.318569 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6a51d-32d6-483c-a2b8-4c581ebde46f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:23.318569 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6a51d-32d6-483c-a2b8-4c581ebde46f None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:23.319430 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 442/844] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:23.325202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39895e-4920-4eea-a75b-2d65ccefe15c None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:23.325793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39895e-4920-4eea-a75b-2d65ccefe15c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:23.325793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39895e-4920-4eea-a75b-2d65ccefe15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:23.336341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-5ce37a0c-e250-4ab1-876b-711612c5b16e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:23.336341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:23.336341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:23.336341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:23.336341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:23.336341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:23.336341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:23.336341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:23.336341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:23.336341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:23.336341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:23.336341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:23.336341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:23.336341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:23.336341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:23.338030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:23.338030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:23.338030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:23.338030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:23.338030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:23.338030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:23.338030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:23.338030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:23.338030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:23.338030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:23.338030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:23.338030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:23.338030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:23.338030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:23.338030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:23.338030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:23.338030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:23.339326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:23.339326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:23.339326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:23.339326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:23.339326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 403/845] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:23.344369 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce37a0c-e250-4ab1-876b-711612c5b16e None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:23.346590 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-ff39895e-4920-4eea-a75b-2d65ccefe15c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:23.348057 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ff39895e-4920-4eea-a75b-2d65ccefe15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:23.436604 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 443/846] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:23.436604 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39895e-4920-4eea-a75b-2d65ccefe15c None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:23.465903 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce37a0c-e250-4ab1-876b-711612c5b16e None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:23.502557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aae26a-ac9a-47f3-a89a-2a25c1e614b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:23.503222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aae26a-ac9a-47f3-a89a-2a25c1e614b4 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:23.503502 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aae26a-ac9a-47f3-a89a-2a25c1e614b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:23.503774 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aae26a-ac9a-47f3-a89a-2a25c1e614b4 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:23.504554 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aae26a-ac9a-47f3-a89a-2a25c1e614b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:23.504867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aae26a-ac9a-47f3-a89a-2a25c1e614b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:23.506227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aae26a-ac9a-47f3-a89a-2a25c1e614b4 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:23.522885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 404/847] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:23.522885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aae26a-ac9a-47f3-a89a-2a25c1e614b4 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:23.536582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39895e-4920-4eea-a75b-2d65ccefe15c None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:23.577615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f135fd-5741-40d2-b8f1-84e992cc19fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:23.578561 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f135fd-5741-40d2-b8f1-84e992cc19fa None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:23.579142 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f135fd-5741-40d2-b8f1-84e992cc19fa None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:23.579550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f135fd-5741-40d2-b8f1-84e992cc19fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:23.592055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f135fd-5741-40d2-b8f1-84e992cc19fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:23.602346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-b2f135fd-5741-40d2-b8f1-84e992cc19fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:23.602346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:23.602346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:23.602346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:23.602346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:23.602346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:23.602346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:23.602346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:23.602346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:23.602346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:23.602346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:23.602346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:23.602346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:23.602346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:23.602346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:23.602346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:23.603335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:23.603335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:23.603335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:23.603335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:23.603335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:23.603335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:23.603335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:23.603335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:23.603335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:23.603335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:23.603335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:23.603335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:23.603335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:23.603335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:23.603335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:23.603335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:23.604232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:23.604232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:23.604232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:23.604232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:23.604232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:23.604232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:23.604232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:23.604232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:23.604232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:23.604232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:23.604232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:23.604232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:23.604894 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 444/848] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:47:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:23.605449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f135fd-5741-40d2-b8f1-84e992cc19fa None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:23.621645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aae26a-ac9a-47f3-a89a-2a25c1e614b4 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:23.655546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381279a-0876-45c9-a9d6-007a1466d2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:23.656603 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381279a-0876-45c9-a9d6-007a1466d2b2 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:23.657086 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381279a-0876-45c9-a9d6-007a1466d2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:23.657530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381279a-0876-45c9-a9d6-007a1466d2b2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:23.658360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381279a-0876-45c9-a9d6-007a1466d2b2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:23.659699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381279a-0876-45c9-a9d6-007a1466d2b2 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:23.671490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-9381279a-0876-45c9-a9d6-007a1466d2b2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:47:23.671490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:23.671490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:23.671490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:23.671490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:23.671490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:23.671490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:23.671490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:23.671490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:47:23.671490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:23.671490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:23.671490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:23.671490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:23.671490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:23.671490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:23.671490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:23.671490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:23.672640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:23.672640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:23.672640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:23.672640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:23.672640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:23.672640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:23.672640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:23.672640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:23.672640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:23.672640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:23.672640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:23.672640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:23.672640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:23.672640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:23.672640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:23.672640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:23.673785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:23.673785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:23.673785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:23.673785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:23.673785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:23.673785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:23.673785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:23.673785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:23.673785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:23.673785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:23.673785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:23.673785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:23.673785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:47:23.673785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:23.677484 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 405/849] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:47:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:23.678201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381279a-0876-45c9-a9d6-007a1466d2b2 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:23.708826 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f135fd-5741-40d2-b8f1-84e992cc19fa None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:23.741884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60db549-0877-4ec9-bac4-6708f6036b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:23.742624 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60db549-0877-4ec9-bac4-6708f6036b93 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:23.742905 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60db549-0877-4ec9-bac4-6708f6036b93 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:23.743178 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60db549-0877-4ec9-bac4-6708f6036b93 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:23.750571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60db549-0877-4ec9-bac4-6708f6036b93 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:23.751991 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60db549-0877-4ec9-bac4-6708f6036b93 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:23.766402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-f60db549-0877-4ec9-bac4-6708f6036b93 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:47:23.766402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:23.766402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:23.766402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:23.766402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:23.766402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:23.766402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:23.766402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:23.766402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:23.766402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:23.766402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:23.766402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:23.766402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:23.766402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:23.766402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:23.766402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:23.767357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:23.768353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:23.768353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:23.768353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:23.768353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:23.768353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:23.768353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:23.768353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:23.768353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:23.768353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:47:23.768353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:23.768353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 445/850] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 13:47:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:23.768950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60db549-0877-4ec9-bac4-6708f6036b93 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:23.780074 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381279a-0876-45c9-a9d6-007a1466d2b2 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:23.816621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9500f-587f-4563-a4a7-cc1f1d932f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:23.817289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9500f-587f-4563-a4a7-cc1f1d932f22 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:23.817568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9500f-587f-4563-a4a7-cc1f1d932f22 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:23.817841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9500f-587f-4563-a4a7-cc1f1d932f22 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:23.818572 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9500f-587f-4563-a4a7-cc1f1d932f22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:23.818875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9500f-587f-4563-a4a7-cc1f1d932f22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:23.820255 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9500f-587f-4563-a4a7-cc1f1d932f22 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:23.828251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 406/851] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:47:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:23.833867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9500f-587f-4563-a4a7-cc1f1d932f22 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:23.865377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60db549-0877-4ec9-bac4-6708f6036b93 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:23.901221 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920d8be-b653-4820-bd2d-c99423f7d615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:23.901889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920d8be-b653-4820-bd2d-c99423f7d615 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:23.902164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920d8be-b653-4820-bd2d-c99423f7d615 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:23.902434 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920d8be-b653-4820-bd2d-c99423f7d615 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:23.903135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920d8be-b653-4820-bd2d-c99423f7d615 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:23.903434 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920d8be-b653-4820-bd2d-c99423f7d615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:23.904809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920d8be-b653-4820-bd2d-c99423f7d615 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:23.909468 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 446/852] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:47:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:23.910227 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920d8be-b653-4820-bd2d-c99423f7d615 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:23.939836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9500f-587f-4563-a4a7-cc1f1d932f22 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:23.974226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75026a-de06-45dc-8585-0771e2cf8a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:23.975166 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75026a-de06-45dc-8585-0771e2cf8a2b None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:23.975448 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75026a-de06-45dc-8585-0771e2cf8a2b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:23.975718 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75026a-de06-45dc-8585-0771e2cf8a2b None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:23.976734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75026a-de06-45dc-8585-0771e2cf8a2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:23.977781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75026a-de06-45dc-8585-0771e2cf8a2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:23.979197 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75026a-de06-45dc-8585-0771e2cf8a2b None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:23.996635 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 407/853] 10.222.0.49 () {56 vars in 1149 bytes} [Tue May 10 13:47:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:23.997376 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75026a-de06-45dc-8585-0771e2cf8a2b None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:24.010366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920d8be-b653-4820-bd2d-c99423f7d615 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:24.042840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f7bd2-0182-4dd0-89e6-7863f1de3d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:24.043633 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f7bd2-0182-4dd0-89e6-7863f1de3d21 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.043906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f7bd2-0182-4dd0-89e6-7863f1de3d21 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.044194 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f7bd2-0182-4dd0-89e6-7863f1de3d21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.054328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f7bd2-0182-4dd0-89e6-7863f1de3d21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:24.055747 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f7bd2-0182-4dd0-89e6-7863f1de3d21 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:24.073222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-400f7bd2-0182-4dd0-89e6-7863f1de3d21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:24.073222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:24.073222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:24.073222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:24.073222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:24.073222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:24.073222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:24.073222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:24.073222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:24.073222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:24.073222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:24.073222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:24.073222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:24.073222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:24.073222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:24.074165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:24.074165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:24.074165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:24.074165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:24.074165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:24.074165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:24.074165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:24.074165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:24.074165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:24.074165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:24.074165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:24.074165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:24.074165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:24.074165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:24.074165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:24.074165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:24.074165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:24.075084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:24.075084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:24.075084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:24.075084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:24.075084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 447/854] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:24.075948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f7bd2-0182-4dd0-89e6-7863f1de3d21 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:24.100979 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75026a-de06-45dc-8585-0771e2cf8a2b None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:24.137672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f109f-ca7f-4a90-91a4-f61e36b79e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:24.138330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f109f-ca7f-4a90-91a4-f61e36b79e63 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.138609 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f109f-ca7f-4a90-91a4-f61e36b79e63 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.138888 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f109f-ca7f-4a90-91a4-f61e36b79e63 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.139581 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f109f-ca7f-4a90-91a4-f61e36b79e63 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:24.139880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f109f-ca7f-4a90-91a4-f61e36b79e63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:24.141268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f109f-ca7f-4a90-91a4-f61e36b79e63 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:24.156464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 408/855] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:47:23 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:24.156464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f109f-ca7f-4a90-91a4-f61e36b79e63 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:24.195666 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f7bd2-0182-4dd0-89e6-7863f1de3d21 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:24.234297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987093d-d5b5-42d2-b409-1937fbaca1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:24.235011 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987093d-d5b5-42d2-b409-1937fbaca1bf None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.235291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987093d-d5b5-42d2-b409-1937fbaca1bf None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.235612 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987093d-d5b5-42d2-b409-1937fbaca1bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.272157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f109f-ca7f-4a90-91a4-f61e36b79e63 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:24.308645 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987093d-d5b5-42d2-b409-1937fbaca1bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:24.310189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987093d-d5b5-42d2-b409-1937fbaca1bf None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:24.318079 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f958d61-f8e9-4bfe-a901-8a50314af633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:24.318749 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f958d61-f8e9-4bfe-a901-8a50314af633 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.319592 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f958d61-f8e9-4bfe-a901-8a50314af633 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.319873 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f958d61-f8e9-4bfe-a901-8a50314af633 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.320634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f958d61-f8e9-4bfe-a901-8a50314af633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:24.320941 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f958d61-f8e9-4bfe-a901-8a50314af633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:24.323081 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f958d61-f8e9-4bfe-a901-8a50314af633 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:24.339912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 409/856] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:24.346194 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f958d61-f8e9-4bfe-a901-8a50314af633 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:24.441830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 448/857] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:47:24 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:47:24.443364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987093d-d5b5-42d2-b409-1937fbaca1bf None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:24.480717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f958d61-f8e9-4bfe-a901-8a50314af633 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:24.526741 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50447721-fcce-450d-96ff-77051c920453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:24.528145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50447721-fcce-450d-96ff-77051c920453 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.528672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50447721-fcce-450d-96ff-77051c920453 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.529186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50447721-fcce-450d-96ff-77051c920453 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.540396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50447721-fcce-450d-96ff-77051c920453 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:24.541849 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987093d-d5b5-42d2-b409-1937fbaca1bf None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:24.542369 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50447721-fcce-450d-96ff-77051c920453 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:24.557738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-50447721-fcce-450d-96ff-77051c920453 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 13:47:24.557738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:24.557738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:24.557738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:24.557738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:24.557738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:24.557738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:24.557738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:24.557738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:24.557738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:24.557738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:24.557738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:24.557738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:24.557738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:24.557738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:24.557738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:24.558739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:24.559715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:24.559715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:24.559715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:24.559715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:24.559715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:24.559715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:24.559715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:24.559715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:24.559715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 13:47:24.559715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:24.559715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 410/858] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:47:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:24.560845 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d2bb0-adeb-454f-8663-303e1daa3d32 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.560845 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d2bb0-adeb-454f-8663-303e1daa3d32 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.560989 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d2bb0-adeb-454f-8663-303e1daa3d32 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.562280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 411/859] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:24.564668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d2bb0-adeb-454f-8663-303e1daa3d32 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:24.581236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7379d75-ac94-448c-82be-d1cb0fea11eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:24.582030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379d75-ac94-448c-82be-d1cb0fea11eb None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.582309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379d75-ac94-448c-82be-d1cb0fea11eb None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.582603 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379d75-ac94-448c-82be-d1cb0fea11eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.592578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7379d75-ac94-448c-82be-d1cb0fea11eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:24.594121 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7379d75-ac94-448c-82be-d1cb0fea11eb None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:24.610954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-e7379d75-ac94-448c-82be-d1cb0fea11eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:24.610954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:24.610954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:24.610954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:24.610954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:24.610954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:24.610954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:24.610954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:24.610954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:24.610954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:24.610954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:24.610954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:24.610954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:24.610954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:24.610954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:24.611872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:24.611872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:24.611872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:24.611872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:24.611872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:24.611872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:24.611872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:24.611872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:24.611872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:24.611872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:24.611872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:24.611872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:24.611872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:24.611872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:24.611872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:24.611872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:24.611872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:24.613168 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:24.613168 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:24.613168 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:24.613168 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:24.613168 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 449/860] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:24.613455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df179b-8fc6-4451-8260-34f767454d75 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.613745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df179b-8fc6-4451-8260-34f767454d75 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.614383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df179b-8fc6-4451-8260-34f767454d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.630636 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f0df179b-8fc6-4451-8260-34f767454d75 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:24.631791 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f0df179b-8fc6-4451-8260-34f767454d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:24.668089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d2bb0-adeb-454f-8663-303e1daa3d32 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:24.699934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 450/861] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:24.701164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df179b-8fc6-4451-8260-34f767454d75 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:24.712573 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4658f5-e65e-4d18-8a31-81430ea99395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:24.713766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4658f5-e65e-4d18-8a31-81430ea99395 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.714245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4658f5-e65e-4d18-8a31-81430ea99395 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.714954 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4658f5-e65e-4d18-8a31-81430ea99395 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.716742 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4658f5-e65e-4d18-8a31-81430ea99395 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:24.717271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4658f5-e65e-4d18-8a31-81430ea99395 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:24.719468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4658f5-e65e-4d18-8a31-81430ea99395 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:24.745165 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 412/862] 10.222.0.49 () {56 vars in 1135 bytes} [Tue May 10 13:47:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:24.746860 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4658f5-e65e-4d18-8a31-81430ea99395 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:24.808310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df179b-8fc6-4451-8260-34f767454d75 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:24.841153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661482a-8cb5-44ea-b8b6-addc3fbb7be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:24.841812 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661482a-8cb5-44ea-b8b6-addc3fbb7be1 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.842094 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661482a-8cb5-44ea-b8b6-addc3fbb7be1 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.842370 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661482a-8cb5-44ea-b8b6-addc3fbb7be1 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.843132 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661482a-8cb5-44ea-b8b6-addc3fbb7be1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:24.843439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661482a-8cb5-44ea-b8b6-addc3fbb7be1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:24.844815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661482a-8cb5-44ea-b8b6-addc3fbb7be1 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:24.846157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4658f5-e65e-4d18-8a31-81430ea99395 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:24.860563 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 451/863] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:24.860563 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661482a-8cb5-44ea-b8b6-addc3fbb7be1 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:24.879967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf36f16-f3eb-4589-9bea-dfea46ef35d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:24.880659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf36f16-f3eb-4589-9bea-dfea46ef35d6 None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:24.880947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf36f16-f3eb-4589-9bea-dfea46ef35d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:24.881224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf36f16-f3eb-4589-9bea-dfea46ef35d6 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:24.881944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf36f16-f3eb-4589-9bea-dfea46ef35d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:24.883295 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf36f16-f3eb-4589-9bea-dfea46ef35d6 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:24.896319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 413/864] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 13:47:24 2022] POST /identity/v3/services => generated 269 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:24.897115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf36f16-f3eb-4589-9bea-dfea46ef35d6 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:24.978992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661482a-8cb5-44ea-b8b6-addc3fbb7be1 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:25.012742 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf36f16-f3eb-4589-9bea-dfea46ef35d6 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:25.015538 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503e10d-17ae-48c2-b818-16ba96d1c09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:25.016388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503e10d-17ae-48c2-b818-16ba96d1c09e None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:25.016772 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503e10d-17ae-48c2-b818-16ba96d1c09e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:25.017150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503e10d-17ae-48c2-b818-16ba96d1c09e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:25.059107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf5b56-be7e-4adf-9287-97fbeab2f29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:25.059107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf5b56-be7e-4adf-9287-97fbeab2f29d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:25.059107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf5b56-be7e-4adf-9287-97fbeab2f29d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:25.059107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf5b56-be7e-4adf-9287-97fbeab2f29d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:25.068448 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf5b56-be7e-4adf-9287-97fbeab2f29d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:25.070806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf5b56-be7e-4adf-9287-97fbeab2f29d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:25.090744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-3bcf5b56-be7e-4adf-9287-97fbeab2f29d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:25.090744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:25.090744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:25.090744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:25.090744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:25.090744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:25.090744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:25.090744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:25.090744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:25.090744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:25.090744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:25.090744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:25.090744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:25.090744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:25.090744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:25.091748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:25.091748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:25.091748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:25.091748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:25.091748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:25.091748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:25.091748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:25.091748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:25.091748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:25.091748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:25.091748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:25.091748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:25.091748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:25.091748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:25.091748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:25.091748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:25.091748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:25.092726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:25.092726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:25.092726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:25.092726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:25.092726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:25.092726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:25.092726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:25.092726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:25.093196 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503e10d-17ae-48c2-b818-16ba96d1c09e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:25.093272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 414/865] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:25.094093 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503e10d-17ae-48c2-b818-16ba96d1c09e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:25.100374 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf5b56-be7e-4adf-9287-97fbeab2f29d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:25.206130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf5b56-be7e-4adf-9287-97fbeab2f29d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:25.212009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 452/866] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:47:24 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:47:25.214164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503e10d-17ae-48c2-b818-16ba96d1c09e None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:25.261199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa92626-d5a8-46ca-9d87-687ced79e4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:25.262148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa92626-d5a8-46ca-9d87-687ced79e4b5 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:25.262575 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa92626-d5a8-46ca-9d87-687ced79e4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:25.262982 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa92626-d5a8-46ca-9d87-687ced79e4b5 None admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:25.263907 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa92626-d5a8-46ca-9d87-687ced79e4b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:25.264391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa92626-d5a8-46ca-9d87-687ced79e4b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:25.265963 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa92626-d5a8-46ca-9d87-687ced79e4b5 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:25.284132 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 415/867] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:25.285233 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa92626-d5a8-46ca-9d87-687ced79e4b5 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:25.337759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503e10d-17ae-48c2-b818-16ba96d1c09e None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:25.376136 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d045ca-4a82-41eb-88f1-2d51a9a23e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:25.383718 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d045ca-4a82-41eb-88f1-2d51a9a23e60 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:25.383718 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d045ca-4a82-41eb-88f1-2d51a9a23e60 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:25.383864 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d045ca-4a82-41eb-88f1-2d51a9a23e60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:25.399095 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d045ca-4a82-41eb-88f1-2d51a9a23e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:25.400706 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d045ca-4a82-41eb-88f1-2d51a9a23e60 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:25.419908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa92626-d5a8-46ca-9d87-687ced79e4b5 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:25.423161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-c5d045ca-4a82-41eb-88f1-2d51a9a23e60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:25.423161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:25.423161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:25.423161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:25.423161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:25.423161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:25.423161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:25.423161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:25.423161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:25.423161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:25.423161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:25.423161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:25.423161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:25.423161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:25.423161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:25.424078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:25.424078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:25.424078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:25.424078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:25.424078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:25.424078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:25.424078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:25.424078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:25.424078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:25.424078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:25.424078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:25.424078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:25.424078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:25.424078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:25.424078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:25.424078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:25.424078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:25.425030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:25.425030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:25.425030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:25.425030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:25.425030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 453/868] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:25.433466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d045ca-4a82-41eb-88f1-2d51a9a23e60 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:25.462596 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c9c1a-7383-46be-8f53-c89709eb1606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:25.463889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c9c1a-7383-46be-8f53-c89709eb1606 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:25.464616 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c9c1a-7383-46be-8f53-c89709eb1606 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:25.465108 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c9c1a-7383-46be-8f53-c89709eb1606 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:25.466589 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c9c1a-7383-46be-8f53-c89709eb1606 None admin] RBAC: Adding query filter params (role.id=10053e4259ae4b3bbbdbefa96320c937, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=df5dcdfb4eda417ebc0af2432497617d) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:25.467234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c9c1a-7383-46be-8f53-c89709eb1606 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:25.469807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c9c1a-7383-46be-8f53-c89709eb1606 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:25.484976 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 416/869] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:47:25 2022] GET /identity/v3/role_assignments?user.id=df5dcdfb4eda417ebc0af2432497617d&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=10053e4259ae4b3bbbdbefa96320c937 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:25.548443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d045ca-4a82-41eb-88f1-2d51a9a23e60 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:25.585554 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77e0d3-3bfb-421b-8e22-ef73bb494554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:25.586238 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77e0d3-3bfb-421b-8e22-ef73bb494554 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:25.586520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77e0d3-3bfb-421b-8e22-ef73bb494554 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:25.586795 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77e0d3-3bfb-421b-8e22-ef73bb494554 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:25.587523 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77e0d3-3bfb-421b-8e22-ef73bb494554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:25.587881 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77e0d3-3bfb-421b-8e22-ef73bb494554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:25.589236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77e0d3-3bfb-421b-8e22-ef73bb494554 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:25.606164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 454/870] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:25.607699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c9c1a-7383-46be-8f53-c89709eb1606 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:25.713830 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c9c1a-7383-46be-8f53-c89709eb1606 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:25.749138 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c44c8-f27d-4233-921d-01702506c7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:25.749939 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c44c8-f27d-4233-921d-01702506c7f0 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:25.750224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c44c8-f27d-4233-921d-01702506c7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:25.750500 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c44c8-f27d-4233-921d-01702506c7f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:25.759666 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c44c8-f27d-4233-921d-01702506c7f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:25.761463 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c44c8-f27d-4233-921d-01702506c7f0 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:25.776239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-8f5c44c8-f27d-4233-921d-01702506c7f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:25.776239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:25.776239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:25.776239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:25.776239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:25.776239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:25.776239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:25.776239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:25.776239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:25.776239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:25.776239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:25.776239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:25.776239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:25.776239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:25.776239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:25.777226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:25.777226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:25.777226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:25.777226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:25.777226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:25.777226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:25.777226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:25.777226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:25.777226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:25.777226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:25.777226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:25.777226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:25.777226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:25.777226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:25.777226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:25.777226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:25.777226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:25.778401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:25.778401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:25.778401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:25.778401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:25.778401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:25.778401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:25.778401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:25.778401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:25.778401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 417/871] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:25.785285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77e0d3-3bfb-421b-8e22-ef73bb494554 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:25.890472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77e0d3-3bfb-421b-8e22-ef73bb494554 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:25.925265 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a252ef-5c33-450d-af38-35e94cc3f667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:25.925929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a252ef-5c33-450d-af38-35e94cc3f667 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:25.926213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a252ef-5c33-450d-af38-35e94cc3f667 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:25.927027 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a252ef-5c33-450d-af38-35e94cc3f667 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:25.927811 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a252ef-5c33-450d-af38-35e94cc3f667 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:25.928115 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a252ef-5c33-450d-af38-35e94cc3f667 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:25.929544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a252ef-5c33-450d-af38-35e94cc3f667 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:25.941828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 455/872] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:25.948619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c44c8-f27d-4233-921d-01702506c7f0 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:26.049307 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c44c8-f27d-4233-921d-01702506c7f0 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:26.085970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb0ea7-5bcb-4e49-832a-64934035a246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:26.086981 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0ea7-5bcb-4e49-832a-64934035a246 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:26.087491 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0ea7-5bcb-4e49-832a-64934035a246 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:26.087970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0ea7-5bcb-4e49-832a-64934035a246 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:26.089042 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb0ea7-5bcb-4e49-832a-64934035a246 None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=d102155cd1bd4368ad272668da1651f4) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:26.089576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb0ea7-5bcb-4e49-832a-64934035a246 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:26.091195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb0ea7-5bcb-4e49-832a-64934035a246 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:26.104313 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 418/873] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:47:25 2022] GET /identity/v3/role_assignments?user.id=d102155cd1bd4368ad272668da1651f4&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:26.424011 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea9a8a-2758-453d-9af4-bc3afcfd9c6c None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:26.424367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea9a8a-2758-453d-9af4-bc3afcfd9c6c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:26.424592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea9a8a-2758-453d-9af4-bc3afcfd9c6c None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:26.426247 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 456/874] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:26.431572 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10b91-301d-4c03-ac69-18fbe9404ed8 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:26.431858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10b91-301d-4c03-ac69-18fbe9404ed8 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:26.432133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10b91-301d-4c03-ac69-18fbe9404ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:26.449001 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-6ba10b91-301d-4c03-ac69-18fbe9404ed8 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:26.450151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-6ba10b91-301d-4c03-ac69-18fbe9404ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:26.514212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 419/875] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:26 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:26.537144 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea9a8a-2758-453d-9af4-bc3afcfd9c6c None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:26.642102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea9a8a-2758-453d-9af4-bc3afcfd9c6c None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:26.676770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85797602-1a5c-42f9-9d9e-dda5f1e010fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:26.677500 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85797602-1a5c-42f9-9d9e-dda5f1e010fe None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:26.677780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85797602-1a5c-42f9-9d9e-dda5f1e010fe None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:26.678050 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85797602-1a5c-42f9-9d9e-dda5f1e010fe None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:26.678770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85797602-1a5c-42f9-9d9e-dda5f1e010fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:26.680110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85797602-1a5c-42f9-9d9e-dda5f1e010fe None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:26.695995 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 457/876] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 13:47:26 2022] POST /identity/v3/services => generated 251 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:27.311216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d0123-ad81-4908-939a-f9cfa291a95e None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:27.311738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d0123-ad81-4908-939a-f9cfa291a95e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:27.311738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d0123-ad81-4908-939a-f9cfa291a95e None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:27.313258 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 420/877] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:27.318738 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2096621-7a95-4a62-bbc4-4f9670b5203c None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:27.319544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2096621-7a95-4a62-bbc4-4f9670b5203c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:27.320024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2096621-7a95-4a62-bbc4-4f9670b5203c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:27.337818 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-a2096621-7a95-4a62-bbc4-4f9670b5203c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:27.339315 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a2096621-7a95-4a62-bbc4-4f9670b5203c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:27.415756 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 458/878] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:27.439722 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d0123-ad81-4908-939a-f9cfa291a95e None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:27.545078 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d0123-ad81-4908-939a-f9cfa291a95e None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:27.579037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265eaa73-8c60-4478-84a1-da0371b2e929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:27.579764 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265eaa73-8c60-4478-84a1-da0371b2e929 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:27.580043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265eaa73-8c60-4478-84a1-da0371b2e929 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:27.580348 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265eaa73-8c60-4478-84a1-da0371b2e929 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:27.580997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265eaa73-8c60-4478-84a1-da0371b2e929 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:27.582363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265eaa73-8c60-4478-84a1-da0371b2e929 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:27.594834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-265eaa73-8c60-4478-84a1-da0371b2e929 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:47:27.594834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:27.594834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:27.594834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:27.594834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:27.594834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:27.594834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:27.594834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:27.594834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:47:27.594834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:27.594834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:27.594834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:27.594834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:27.594834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:27.594834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:27.594834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:27.595754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:27.595754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:27.595754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:27.595754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:27.595754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:27.595754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:27.595754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:27.595754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:27.595754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:27.595754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:27.595754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:27.595754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:27.595754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:27.595754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:27.595754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:27.595754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:27.596629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:27.596629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:27.596629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:27.596629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:27.596629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:27.596629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:27.596629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:27.596629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:27.596629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:27.596629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:27.596629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:27.596629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:27.596629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:27.596629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:47:27.596629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:27.596629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 421/879] 10.222.0.49 () {56 vars in 1132 bytes} [Tue May 10 13:47:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:27.602554 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2096621-7a95-4a62-bbc4-4f9670b5203c None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:27.705395 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2096621-7a95-4a62-bbc4-4f9670b5203c None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:27.739621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb733b-43c1-40e2-8aee-ca9faea4cc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:27.740316 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb733b-43c1-40e2-8aee-ca9faea4cc04 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:27.740598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb733b-43c1-40e2-8aee-ca9faea4cc04 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:27.740872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb733b-43c1-40e2-8aee-ca9faea4cc04 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:27.741571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb733b-43c1-40e2-8aee-ca9faea4cc04 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:27.741868 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb733b-43c1-40e2-8aee-ca9faea4cc04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:27.743216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb733b-43c1-40e2-8aee-ca9faea4cc04 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:27.748105 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 459/880] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 13:47:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:27.757242 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265eaa73-8c60-4478-84a1-da0371b2e929 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:27.825622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b68b6-2595-492c-870c-b65b1c461f1b None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:27.826251 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b68b6-2595-492c-870c-b65b1c461f1b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:27.826727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b68b6-2595-492c-870c-b65b1c461f1b None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:27.828565 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 460/881] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:27.838239 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44a109-ec3b-41bb-8ed6-4e055aad627b None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:27.838883 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44a109-ec3b-41bb-8ed6-4e055aad627b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:27.839358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44a109-ec3b-41bb-8ed6-4e055aad627b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:27.856412 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-cf44a109-ec3b-41bb-8ed6-4e055aad627b None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:27.858013 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cf44a109-ec3b-41bb-8ed6-4e055aad627b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:27.858133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265eaa73-8c60-4478-84a1-da0371b2e929 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:27.896101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593afa3e-16d9-4590-86f2-b01208124966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:27.897076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593afa3e-16d9-4590-86f2-b01208124966 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:27.897076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593afa3e-16d9-4590-86f2-b01208124966 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:27.897263 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593afa3e-16d9-4590-86f2-b01208124966 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:27.897879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593afa3e-16d9-4590-86f2-b01208124966 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:27.898294 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593afa3e-16d9-4590-86f2-b01208124966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:27.899470 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593afa3e-16d9-4590-86f2-b01208124966 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:27.909262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 422/882] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 13:47:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:27.912711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593afa3e-16d9-4590-86f2-b01208124966 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:27.947842 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 461/883] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:47:27.971571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44a109-ec3b-41bb-8ed6-4e055aad627b None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:28.034634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593afa3e-16d9-4590-86f2-b01208124966 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:28.080375 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3231c-1cc0-4a8d-88c0-00787267c219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:28.081402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3231c-1cc0-4a8d-88c0-00787267c219 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.081730 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44a109-ec3b-41bb-8ed6-4e055aad627b None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:28.082147 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3231c-1cc0-4a8d-88c0-00787267c219 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.083223 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3231c-1cc0-4a8d-88c0-00787267c219 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.085176 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3231c-1cc0-4a8d-88c0-00787267c219 None admin] RBAC: Adding query filter params (interface=public, service_id=c66d364bfc8c41389c078fb3f747e166, region_id=RegionOne) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:28.085713 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3231c-1cc0-4a8d-88c0-00787267c219 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:28.087266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3231c-1cc0-4a8d-88c0-00787267c219 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:28.097637 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 423/884] 10.222.0.49 () {56 vars in 1251 bytes} [Tue May 10 13:47:27 2022] GET /identity/v3/endpoints?service_id=c66d364bfc8c41389c078fb3f747e166&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:28.103652 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3231c-1cc0-4a8d-88c0-00787267c219 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:28.120081 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5cd30-6aa7-4528-9445-9fe5a5976425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:28.120952 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5cd30-6aa7-4528-9445-9fe5a5976425 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.121230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5cd30-6aa7-4528-9445-9fe5a5976425 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.121586 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5cd30-6aa7-4528-9445-9fe5a5976425 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.132138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5cd30-6aa7-4528-9445-9fe5a5976425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:28.140310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-f8e5cd30-6aa7-4528-9445-9fe5a5976425 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:47:28.140310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:28.140310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:28.140310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:28.140310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:28.140310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:28.140310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:28.140310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:28.140310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:28.140310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:28.140310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:28.140310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:28.140310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:28.140310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:28.140310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:28.140310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:28.141237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:28.141237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:28.141237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:28.141237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:28.141237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:28.141237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:28.141237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:28.141237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:28.141237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:28.141237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:28.141237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:28.141237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:28.141237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:28.141237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:28.141237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:28.141237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:28.142111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:28.142111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:28.142111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:28.142111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:28.142111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:28.142111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:28.142111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:28.142111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:28.142111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:28.142111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:28.142111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:47:28.142111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:28.146494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 462/885] 10.222.0.49 () {56 vars in 1120 bytes} [Tue May 10 13:47:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:28.147437 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5cd30-6aa7-4528-9445-9fe5a5976425 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:28.224552 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3231c-1cc0-4a8d-88c0-00787267c219 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:28.258584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131c9f4-90c3-4432-bac1-75114102f390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:28.259265 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131c9f4-90c3-4432-bac1-75114102f390 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.259542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131c9f4-90c3-4432-bac1-75114102f390 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.259813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131c9f4-90c3-4432-bac1-75114102f390 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.260397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5cd30-6aa7-4528-9445-9fe5a5976425 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:28.260598 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131c9f4-90c3-4432-bac1-75114102f390 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:28.262041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131c9f4-90c3-4432-bac1-75114102f390 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:28.276663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 424/886] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 13:47:28 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 13:47:28.302309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d395c-7427-45b8-900b-daf5c531e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:28.303432 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d395c-7427-45b8-900b-daf5c531e349 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.303942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d395c-7427-45b8-900b-daf5c531e349 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.304454 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d395c-7427-45b8-900b-daf5c531e349 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.305422 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d395c-7427-45b8-900b-daf5c531e349 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:28.305932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d395c-7427-45b8-900b-daf5c531e349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:28.307515 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d395c-7427-45b8-900b-daf5c531e349 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:28.318096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 463/887] 10.222.0.49 () {56 vars in 1115 bytes} [Tue May 10 13:47:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:28.323511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131c9f4-90c3-4432-bac1-75114102f390 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:28.437192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131c9f4-90c3-4432-bac1-75114102f390 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:28.462062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01accd91-9e04-4834-9d75-5d8b64607cf2 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.462618 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01accd91-9e04-4834-9d75-5d8b64607cf2 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.462618 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01accd91-9e04-4834-9d75-5d8b64607cf2 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.464225 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 464/888] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:28.470015 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203a11b-d3dc-4414-bde7-b5ed8546387f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.470305 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203a11b-d3dc-4414-bde7-b5ed8546387f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.470575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203a11b-d3dc-4414-bde7-b5ed8546387f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.474712 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30849f91-6370-466c-800d-121094aa2f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:28.475602 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30849f91-6370-466c-800d-121094aa2f27 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.475880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30849f91-6370-466c-800d-121094aa2f27 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.476149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30849f91-6370-466c-800d-121094aa2f27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.488815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-c203a11b-d3dc-4414-bde7-b5ed8546387f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:28.490535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c203a11b-d3dc-4414-bde7-b5ed8546387f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:28.490645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30849f91-6370-466c-800d-121094aa2f27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:28.492078 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30849f91-6370-466c-800d-121094aa2f27 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:28.511729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-30849f91-6370-466c-800d-121094aa2f27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:28.511729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:28.511729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:28.511729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:28.511729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:28.511729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:28.511729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:28.511729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:28.511729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:28.511729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:28.511729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:28.511729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:28.511729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:28.511729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:28.511729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:28.512732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:28.512732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:28.512732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:28.512732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:28.512732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:28.512732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:28.512732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:28.512732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:28.512732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:28.512732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:28.512732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:28.512732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:28.512732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:28.512732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:28.512732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:28.512732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:28.512732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:28.513649 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:28.513649 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:28.513649 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:28.513649 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:28.513649 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 425/889] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:28.518794 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30849f91-6370-466c-800d-121094aa2f27 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:28.569266 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 465/890] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:47:28.592194 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203a11b-d3dc-4414-bde7-b5ed8546387f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:28.637779 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30849f91-6370-466c-800d-121094aa2f27 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:28.683186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171eba0e-af63-4d22-bd72-a63a006f0300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:28.684231 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171eba0e-af63-4d22-bd72-a63a006f0300 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.684738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171eba0e-af63-4d22-bd72-a63a006f0300 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.685631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171eba0e-af63-4d22-bd72-a63a006f0300 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.686560 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171eba0e-af63-4d22-bd72-a63a006f0300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:28.687406 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171eba0e-af63-4d22-bd72-a63a006f0300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:28.689576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171eba0e-af63-4d22-bd72-a63a006f0300 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:28.704547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 426/891] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:28.709558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171eba0e-af63-4d22-bd72-a63a006f0300 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:28.715238 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203a11b-d3dc-4414-bde7-b5ed8546387f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:28.764389 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781302d2-6c6e-4708-8063-3747f381a1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:28.765965 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781302d2-6c6e-4708-8063-3747f381a1db None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.766757 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781302d2-6c6e-4708-8063-3747f381a1db None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.767368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781302d2-6c6e-4708-8063-3747f381a1db None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.768464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781302d2-6c6e-4708-8063-3747f381a1db None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:28.770600 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781302d2-6c6e-4708-8063-3747f381a1db None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:28.787157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-781302d2-6c6e-4708-8063-3747f381a1db None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:47:28.787157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:28.787157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:28.787157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:28.787157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:28.787157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:28.787157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:28.787157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:28.787157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:47:28.787157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:28.787157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:28.787157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:28.787157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:28.787157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:28.787157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:28.787157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:28.787157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:28.788296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:28.788296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:28.788296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:28.788296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:28.788296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:28.788296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:28.788296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:28.788296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:28.788296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:28.788296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:28.788296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:28.788296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:28.788296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:28.788296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:28.788296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:28.788296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:28.789210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:28.789210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:28.789210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:28.789210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:28.789210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:28.789210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:28.789210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:28.789210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:28.789210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:28.789210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:28.789210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:28.789210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:28.789210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:47:28.789210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:28.792327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 466/892] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 13:47:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:28.800642 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781302d2-6c6e-4708-8063-3747f381a1db None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:28.836809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171eba0e-af63-4d22-bd72-a63a006f0300 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:28.881869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dccfe8-4223-4bd3-862e-32bbc6b53845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:28.883398 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dccfe8-4223-4bd3-862e-32bbc6b53845 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.884198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dccfe8-4223-4bd3-862e-32bbc6b53845 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.884942 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dccfe8-4223-4bd3-862e-32bbc6b53845 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.894299 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dccfe8-4223-4bd3-862e-32bbc6b53845 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:28.896943 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dccfe8-4223-4bd3-862e-32bbc6b53845 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:28.910520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781302d2-6c6e-4708-8063-3747f381a1db None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:28.914838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-39dccfe8-4223-4bd3-862e-32bbc6b53845 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:47:28.914838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:28.914838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:28.914838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:28.914838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:28.914838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:28.914838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:28.914838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:28.914838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:28.914838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:28.914838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:28.914838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:28.914838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:28.914838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:28.914838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:28.914838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:28.915807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:28.916823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:28.916823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:28.916823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:28.916823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:28.916823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:28.916823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:28.916823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:28.916823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:28.916823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:47:28.916823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:28.920704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 427/893] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 13:47:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:28.921529 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dccfe8-4223-4bd3-862e-32bbc6b53845 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:28.955875 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2819f53-eca3-4672-80a5-d2f9b01c9448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:28.956936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2819f53-eca3-4672-80a5-d2f9b01c9448 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:28.957966 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2819f53-eca3-4672-80a5-d2f9b01c9448 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:28.958444 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2819f53-eca3-4672-80a5-d2f9b01c9448 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:28.959351 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2819f53-eca3-4672-80a5-d2f9b01c9448 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:28.959858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2819f53-eca3-4672-80a5-d2f9b01c9448 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:28.961654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2819f53-eca3-4672-80a5-d2f9b01c9448 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:28.971400 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 467/894] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 13:47:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:28.972387 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2819f53-eca3-4672-80a5-d2f9b01c9448 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:29.024083 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dccfe8-4223-4bd3-862e-32bbc6b53845 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:29.062447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9659d0a-9ab4-4746-afbd-d214957fd5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:29.063228 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9659d0a-9ab4-4746-afbd-d214957fd5ba None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.063421 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9659d0a-9ab4-4746-afbd-d214957fd5ba None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.063643 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9659d0a-9ab4-4746-afbd-d214957fd5ba None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.064497 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9659d0a-9ab4-4746-afbd-d214957fd5ba None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:29.064800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9659d0a-9ab4-4746-afbd-d214957fd5ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:29.066352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9659d0a-9ab4-4746-afbd-d214957fd5ba None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:29.074590 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2819f53-eca3-4672-80a5-d2f9b01c9448 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:29.083375 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 428/895] 10.222.0.49 () {56 vars in 1149 bytes} [Tue May 10 13:47:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:29.084835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7863a5-db60-403b-ade6-60ab3f346944 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.085194 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7863a5-db60-403b-ade6-60ab3f346944 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.085539 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7863a5-db60-403b-ade6-60ab3f346944 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.087011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 429/896] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:29.088811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7863a5-db60-403b-ade6-60ab3f346944 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:29.113699 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329a699-1c9e-4e13-a2fa-8c95298a3627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:29.114362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329a699-1c9e-4e13-a2fa-8c95298a3627 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.114636 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329a699-1c9e-4e13-a2fa-8c95298a3627 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.114902 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329a699-1c9e-4e13-a2fa-8c95298a3627 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.115596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329a699-1c9e-4e13-a2fa-8c95298a3627 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:29.115892 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329a699-1c9e-4e13-a2fa-8c95298a3627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:29.117257 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329a699-1c9e-4e13-a2fa-8c95298a3627 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:29.130375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 468/897] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 13:47:28 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:29.130375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d9151-779a-41ba-9639-c9b58dba0cef None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.130375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d9151-779a-41ba-9639-c9b58dba0cef None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.130375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d9151-779a-41ba-9639-c9b58dba0cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.152933 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-660d9151-779a-41ba-9639-c9b58dba0cef None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:29.154189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-660d9151-779a-41ba-9639-c9b58dba0cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:29.212308 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7863a5-db60-403b-ade6-60ab3f346944 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:29.246342 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 469/898] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:29.258342 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4382ce2-3ab8-4c98-bb7b-4b168d2a22a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:29.259141 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4382ce2-3ab8-4c98-bb7b-4b168d2a22a0 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.259546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4382ce2-3ab8-4c98-bb7b-4b168d2a22a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.259915 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4382ce2-3ab8-4c98-bb7b-4b168d2a22a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.271484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d9151-779a-41ba-9639-c9b58dba0cef None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:29.344974 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4382ce2-3ab8-4c98-bb7b-4b168d2a22a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:29.346419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4382ce2-3ab8-4c98-bb7b-4b168d2a22a0 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:29.395610 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d9151-779a-41ba-9639-c9b58dba0cef None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:29.436673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c482c02-e560-4585-889f-12cfe5744da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:29.437402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c482c02-e560-4585-889f-12cfe5744da7 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.437682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c482c02-e560-4585-889f-12cfe5744da7 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.437957 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c482c02-e560-4585-889f-12cfe5744da7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.438801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c482c02-e560-4585-889f-12cfe5744da7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:29.440742 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c482c02-e560-4585-889f-12cfe5744da7 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:29.462001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-0c482c02-e560-4585-889f-12cfe5744da7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:47:29.462001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:29.462001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:29.462001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:29.462001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:29.462001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:29.462001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:29.462001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:29.462001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:47:29.462001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:29.462001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:29.462001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:29.462001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:29.462001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:29.462001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:29.462001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:29.462001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:29.463501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:29.463501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:29.463501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:29.463501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:29.463501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:29.463501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:29.463501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:29.463501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:29.463501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:29.463501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:29.463501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:29.463501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:29.463501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:29.463501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:29.463501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:29.463501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:29.464809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:29.464809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:29.464809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:29.464809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:29.464809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:29.464809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:29.464809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:29.464809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:29.464809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:29.464809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:29.464809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:29.464809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:29.464809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:47:29.464809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:29.468867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 470/899] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:47:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:29.470283 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c482c02-e560-4585-889f-12cfe5744da7 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:29.482698 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 430/900] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:47:29 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 13:47:29.487787 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4382ce2-3ab8-4c98-bb7b-4b168d2a22a0 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:29.599178 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4382ce2-3ab8-4c98-bb7b-4b168d2a22a0 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:29.600272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c482c02-e560-4585-889f-12cfe5744da7 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:29.635269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c281cf6-cbd5-47de-b416-e270735a03b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:29.636730 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c281cf6-cbd5-47de-b416-e270735a03b8 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.637453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c281cf6-cbd5-47de-b416-e270735a03b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.637991 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c281cf6-cbd5-47de-b416-e270735a03b8 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.638946 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c281cf6-cbd5-47de-b416-e270735a03b8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:29.639390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c281cf6-cbd5-47de-b416-e270735a03b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:29.641127 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c281cf6-cbd5-47de-b416-e270735a03b8 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:29.641731 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a40ad-e756-4b33-8921-c8702b359e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:29.642803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a40ad-e756-4b33-8921-c8702b359e3c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.643185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a40ad-e756-4b33-8921-c8702b359e3c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.643873 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a40ad-e756-4b33-8921-c8702b359e3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.647544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 471/901] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:47:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:29.653457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c281cf6-cbd5-47de-b416-e270735a03b8 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:29.660653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a40ad-e756-4b33-8921-c8702b359e3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:29.662117 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a40ad-e756-4b33-8921-c8702b359e3c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:29.685451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-c44a40ad-e756-4b33-8921-c8702b359e3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:29.685451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:29.685451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:29.685451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:29.685451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:29.685451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:29.685451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:29.685451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:29.685451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:29.685451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:29.685451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:29.685451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:29.685451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:29.685451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:29.685451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:29.686442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:29.686442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:29.686442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:29.686442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:29.686442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:29.686442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:29.686442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:29.686442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:29.686442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:29.686442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:29.686442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:29.686442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:29.686442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:29.686442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:29.686442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:29.686442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:29.686442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:29.687397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:29.687397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:29.687397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:29.687397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:29.691350 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 431/902] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:29.693137 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a40ad-e756-4b33-8921-c8702b359e3c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:29.776860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c281cf6-cbd5-47de-b416-e270735a03b8 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:29.809886 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a40ad-e756-4b33-8921-c8702b359e3c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:29.810470 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63a26d-ef70-46aa-91de-c635d83b271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:29.811395 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63a26d-ef70-46aa-91de-c635d83b271c None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.811880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63a26d-ef70-46aa-91de-c635d83b271c None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.812384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63a26d-ef70-46aa-91de-c635d83b271c None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.813308 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63a26d-ef70-46aa-91de-c635d83b271c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:29.813813 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63a26d-ef70-46aa-91de-c635d83b271c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:29.815364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63a26d-ef70-46aa-91de-c635d83b271c None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:29.825887 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 472/903] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:47:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:29.827011 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63a26d-ef70-46aa-91de-c635d83b271c None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:29.849650 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a78fc-1b6b-4c15-8322-ea5d91bf9d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:29.850323 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a78fc-1b6b-4c15-8322-ea5d91bf9d5f None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.850609 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a78fc-1b6b-4c15-8322-ea5d91bf9d5f None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.850914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a78fc-1b6b-4c15-8322-ea5d91bf9d5f None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.851880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a78fc-1b6b-4c15-8322-ea5d91bf9d5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:29.852209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a78fc-1b6b-4c15-8322-ea5d91bf9d5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:29.854067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a78fc-1b6b-4c15-8322-ea5d91bf9d5f None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:29.872236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 432/904] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:29.875962 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a78fc-1b6b-4c15-8322-ea5d91bf9d5f None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:29.933847 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63a26d-ef70-46aa-91de-c635d83b271c None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:29.967616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd43f1-792c-49a7-8b91-6779ad467554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:29.968207 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd43f1-792c-49a7-8b91-6779ad467554 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:29.968488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd43f1-792c-49a7-8b91-6779ad467554 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:29.968754 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd43f1-792c-49a7-8b91-6779ad467554 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:29.969530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd43f1-792c-49a7-8b91-6779ad467554 None admin] RBAC: Adding query filter params (interface=public, service_id=edac4d032ee042f39008b33622decbf2, region_id=RegionOne) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:29.969830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd43f1-792c-49a7-8b91-6779ad467554 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:29.971340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd43f1-792c-49a7-8b91-6779ad467554 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:29.981611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 473/905] 10.222.0.49 () {56 vars in 1251 bytes} [Tue May 10 13:47:29 2022] GET /identity/v3/endpoints?service_id=edac4d032ee042f39008b33622decbf2&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:29.982624 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd43f1-792c-49a7-8b91-6779ad467554 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:29.984609 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a78fc-1b6b-4c15-8322-ea5d91bf9d5f None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:30.018956 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa96b3d-3c43-4fde-bc3d-42a49f2728bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:30.020270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa96b3d-3c43-4fde-bc3d-42a49f2728bf None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:30.020783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa96b3d-3c43-4fde-bc3d-42a49f2728bf None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:30.021265 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa96b3d-3c43-4fde-bc3d-42a49f2728bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:30.030692 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa96b3d-3c43-4fde-bc3d-42a49f2728bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:30.032867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa96b3d-3c43-4fde-bc3d-42a49f2728bf None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:30.052805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-caa96b3d-3c43-4fde-bc3d-42a49f2728bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:30.052805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:30.052805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:30.052805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:30.052805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:30.052805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:30.052805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:30.052805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:30.052805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:30.052805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:30.052805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:30.052805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:30.052805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:30.052805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:30.052805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:30.053759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:30.053759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:30.053759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:30.053759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:30.053759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:30.053759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:30.053759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:30.053759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:30.053759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:30.053759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:30.053759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:30.053759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:30.053759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:30.053759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:30.053759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:30.053759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:30.053759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:30.054674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:30.054674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:30.054674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:30.054674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:30.054674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:30.054674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:30.054674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:30.054674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:30.062497 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 433/906] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:30.064403 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa96b3d-3c43-4fde-bc3d-42a49f2728bf None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:30.090934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd43f1-792c-49a7-8b91-6779ad467554 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:30.134804 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fda22-da12-417e-bdac-29a8775d1755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:30.135869 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fda22-da12-417e-bdac-29a8775d1755 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:30.136418 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fda22-da12-417e-bdac-29a8775d1755 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:30.137299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fda22-da12-417e-bdac-29a8775d1755 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:30.138214 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fda22-da12-417e-bdac-29a8775d1755 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:30.140451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fda22-da12-417e-bdac-29a8775d1755 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:30.148229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 474/907] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 13:47:29 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 13:47:30.172510 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa96b3d-3c43-4fde-bc3d-42a49f2728bf None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:30.211166 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212f51a-b36c-4d66-b662-1cffbe2e5a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:30.212268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212f51a-b36c-4d66-b662-1cffbe2e5a31 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:30.212799 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212f51a-b36c-4d66-b662-1cffbe2e5a31 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:30.213282 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212f51a-b36c-4d66-b662-1cffbe2e5a31 None admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:30.214318 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212f51a-b36c-4d66-b662-1cffbe2e5a31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:30.214928 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212f51a-b36c-4d66-b662-1cffbe2e5a31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:30.216720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212f51a-b36c-4d66-b662-1cffbe2e5a31 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:30.236008 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 434/908] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:30.237793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fda22-da12-417e-bdac-29a8775d1755 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:30.348682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fda22-da12-417e-bdac-29a8775d1755 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:30.394182 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faada6-f41c-48a8-94a9-62b8aeda6db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:30.395874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faada6-f41c-48a8-94a9-62b8aeda6db2 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:30.396470 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faada6-f41c-48a8-94a9-62b8aeda6db2 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:30.396977 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faada6-f41c-48a8-94a9-62b8aeda6db2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:30.398954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6faada6-f41c-48a8-94a9-62b8aeda6db2 None admin] RBAC: Adding query filter params (role.id=76799389aacd44d5a8d92e1df6f89e12, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=df5dcdfb4eda417ebc0af2432497617d) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:30.399503 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6faada6-f41c-48a8-94a9-62b8aeda6db2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:30.401268 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6faada6-f41c-48a8-94a9-62b8aeda6db2 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:30.408318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 475/909] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:47:30 2022] GET /identity/v3/role_assignments?user.id=df5dcdfb4eda417ebc0af2432497617d&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=76799389aacd44d5a8d92e1df6f89e12 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:30.634561 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d745630-155f-4da5-8aa5-cf23044513eb None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:30.635089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d745630-155f-4da5-8aa5-cf23044513eb None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:30.635089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d745630-155f-4da5-8aa5-cf23044513eb None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:30.636733 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 435/910] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:30.642142 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccd546-f92a-41b0-abf3-ee709711e7aa None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:30.642566 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccd546-f92a-41b0-abf3-ee709711e7aa None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:30.642759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccd546-f92a-41b0-abf3-ee709711e7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:30.662263 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-6eccd546-f92a-41b0-abf3-ee709711e7aa None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:30.663795 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-6eccd546-f92a-41b0-abf3-ee709711e7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:30.730290 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 476/911] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:30.752889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d745630-155f-4da5-8aa5-cf23044513eb None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:30.858526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d745630-155f-4da5-8aa5-cf23044513eb None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:30.892956 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4579f2f-53a2-4f94-864a-c18cbddc39d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:30.893688 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4579f2f-53a2-4f94-864a-c18cbddc39d3 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:30.893970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4579f2f-53a2-4f94-864a-c18cbddc39d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:30.894246 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4579f2f-53a2-4f94-864a-c18cbddc39d3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:30.894964 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4579f2f-53a2-4f94-864a-c18cbddc39d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:30.896872 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4579f2f-53a2-4f94-864a-c18cbddc39d3 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:30.909522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-a4579f2f-53a2-4f94-864a-c18cbddc39d3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:47:30.909522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:30.909522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:30.909522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:30.909522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:30.909522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:30.909522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:30.909522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:30.909522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:47:30.909522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:30.909522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:30.909522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:30.909522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:30.909522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:30.909522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:30.909522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:30.910579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:30.910579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:30.910579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:30.910579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:30.910579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:30.910579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:30.910579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:30.910579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:30.910579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:30.910579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:30.910579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:30.910579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:30.910579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:30.910579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:30.910579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:30.910579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:30.911458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:30.911458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:30.911458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:30.911458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:30.911458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:30.911458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:30.911458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:30.911458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:30.911458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:30.911458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:30.911458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:30.911458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:30.911458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:30.911458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 13:47:30.911458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:30.911458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 436/912] 10.222.0.49 () {56 vars in 1132 bytes} [Tue May 10 13:47:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:30.918835 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccd546-f92a-41b0-abf3-ee709711e7aa None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:31.017442 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccd546-f92a-41b0-abf3-ee709711e7aa None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:31.051458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91730b84-8947-414c-a933-42076cee4a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:31.052125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91730b84-8947-414c-a933-42076cee4a79 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:31.052433 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91730b84-8947-414c-a933-42076cee4a79 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:31.052710 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91730b84-8947-414c-a933-42076cee4a79 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:31.053414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91730b84-8947-414c-a933-42076cee4a79 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:31.053717 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91730b84-8947-414c-a933-42076cee4a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:31.055069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91730b84-8947-414c-a933-42076cee4a79 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:31.060262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 477/913] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 13:47:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:31.069241 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4579f2f-53a2-4f94-864a-c18cbddc39d3 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:31.177452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4579f2f-53a2-4f94-864a-c18cbddc39d3 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:31.212150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096ee72-7a1f-4870-86fb-a96c1c125d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:31.212857 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096ee72-7a1f-4870-86fb-a96c1c125d9d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:31.213137 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096ee72-7a1f-4870-86fb-a96c1c125d9d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:31.213414 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096ee72-7a1f-4870-86fb-a96c1c125d9d None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:31.214143 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096ee72-7a1f-4870-86fb-a96c1c125d9d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:31.214448 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096ee72-7a1f-4870-86fb-a96c1c125d9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:31.215871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096ee72-7a1f-4870-86fb-a96c1c125d9d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:31.222063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 437/914] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 13:47:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:31.229323 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91730b84-8947-414c-a933-42076cee4a79 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:31.335572 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91730b84-8947-414c-a933-42076cee4a79 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:31.369500 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f73bcd-0589-42c1-8291-af5630558de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:31.370518 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f73bcd-0589-42c1-8291-af5630558de8 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:31.370999 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f73bcd-0589-42c1-8291-af5630558de8 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:31.371486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f73bcd-0589-42c1-8291-af5630558de8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:31.372484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f73bcd-0589-42c1-8291-af5630558de8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:31.374033 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f73bcd-0589-42c1-8291-af5630558de8 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:31.405698 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91646c81-fc6e-4b2b-9ef4-06734f7b28ed None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:31.406027 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91646c81-fc6e-4b2b-9ef4-06734f7b28ed None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:31.406297 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91646c81-fc6e-4b2b-9ef4-06734f7b28ed None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:31.407989 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 438/915] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:31.409749 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 478/916] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 13:47:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:31.421734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c383218-1f1b-4a8d-93bb-21ab72b3de47 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:31.421734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c383218-1f1b-4a8d-93bb-21ab72b3de47 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:31.421734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c383218-1f1b-4a8d-93bb-21ab72b3de47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:31.433558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-7c383218-1f1b-4a8d-93bb-21ab72b3de47 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:31.434891 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-7c383218-1f1b-4a8d-93bb-21ab72b3de47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:31.527200 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 439/917] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:31.549693 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f73bcd-0589-42c1-8291-af5630558de8 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:31.655399 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f73bcd-0589-42c1-8291-af5630558de8 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:31.690576 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d2973-3e96-4f96-aeab-b2c0309aa688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:31.691167 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d2973-3e96-4f96-aeab-b2c0309aa688 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:31.691453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d2973-3e96-4f96-aeab-b2c0309aa688 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:31.692295 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d2973-3e96-4f96-aeab-b2c0309aa688 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:31.693021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d2973-3e96-4f96-aeab-b2c0309aa688 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:31.694377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d2973-3e96-4f96-aeab-b2c0309aa688 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:31.710062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 479/918] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 13:47:31 2022] POST /identity/v3/services => generated 241 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:32.561966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971ab4a-cd2f-41fa-bcb7-08a798707a7d None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:32.562516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971ab4a-cd2f-41fa-bcb7-08a798707a7d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:32.562516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971ab4a-cd2f-41fa-bcb7-08a798707a7d None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:32.564300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 440/919] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:32.570238 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf5d05-13ce-481f-b554-854f6a60dd5e None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:32.570522 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf5d05-13ce-481f-b554-854f6a60dd5e None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:32.570798 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf5d05-13ce-481f-b554-854f6a60dd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:32.587754 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-dccf5d05-13ce-481f-b554-854f6a60dd5e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:32.588964 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-dccf5d05-13ce-481f-b554-854f6a60dd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:32.663273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 480/920] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:32.685296 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971ab4a-cd2f-41fa-bcb7-08a798707a7d None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:32.752840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6175215-81f0-415f-9233-e09b93bc77b1 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:32.753184 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6175215-81f0-415f-9233-e09b93bc77b1 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:32.753404 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6175215-81f0-415f-9233-e09b93bc77b1 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:32.756260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 481/921] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:32.760630 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae398c-e8a6-4a8e-b907-3e0960bc26cd None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:32.760914 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae398c-e8a6-4a8e-b907-3e0960bc26cd None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:32.761192 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae398c-e8a6-4a8e-b907-3e0960bc26cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:32.777734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-25ae398c-e8a6-4a8e-b907-3e0960bc26cd None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:32.778909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-25ae398c-e8a6-4a8e-b907-3e0960bc26cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:32.792490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971ab4a-cd2f-41fa-bcb7-08a798707a7d None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:32.826555 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf09bc0-0179-47c8-bc8d-60f0579916e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:32.827707 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf09bc0-0179-47c8-bc8d-60f0579916e1 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:32.828244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf09bc0-0179-47c8-bc8d-60f0579916e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:32.828718 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf09bc0-0179-47c8-bc8d-60f0579916e1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:32.829605 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf09bc0-0179-47c8-bc8d-60f0579916e1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:32.831201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf09bc0-0179-47c8-bc8d-60f0579916e1 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:32.843809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-ebf09bc0-0179-47c8-bc8d-60f0579916e1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:47:32.843809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:32.843809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:32.843809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:32.843809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:32.843809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:32.843809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:32.843809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:32.843809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:47:32.843809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:32.843809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:32.843809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:32.843809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:32.843809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:32.843809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:32.843809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:32.843809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:32.844901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:32.844901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:32.844901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:32.844901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:32.844901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:32.844901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:32.844901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:32.844901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:32.844901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:32.844901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:32.844901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:32.844901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:32.844901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:32.844901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:32.844901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:32.844901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:32.845751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:32.845751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:32.845751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:32.845751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:32.845751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:32.845751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:32.845751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:32.845751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:32.845751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:32.845751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:32.845751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:32.845751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:32.845751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 13:47:32.845751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:32.848700 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 441/923] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:47:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:32.853113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 482/923] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:47:32.854216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf09bc0-0179-47c8-bc8d-60f0579916e1 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:32.873488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae398c-e8a6-4a8e-b907-3e0960bc26cd None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:32.953670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf09bc0-0179-47c8-bc8d-60f0579916e1 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:32.971944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae398c-e8a6-4a8e-b907-3e0960bc26cd None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:32.987553 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7ae78-9584-4388-9168-d4a23512a0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:32.989157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7ae78-9584-4388-9168-d4a23512a0cc None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:32.989657 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7ae78-9584-4388-9168-d4a23512a0cc None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:32.990136 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7ae78-9584-4388-9168-d4a23512a0cc None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:32.991019 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7ae78-9584-4388-9168-d4a23512a0cc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:32.991533 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7ae78-9584-4388-9168-d4a23512a0cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:32.993101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7ae78-9584-4388-9168-d4a23512a0cc None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:32.998306 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 442/924] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:47:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:33.006868 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1230b-3e1f-4539-86b6-ec2eb2f13f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:33.007681 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1230b-3e1f-4539-86b6-ec2eb2f13f5b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:33.007967 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1230b-3e1f-4539-86b6-ec2eb2f13f5b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:33.008277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1230b-3e1f-4539-86b6-ec2eb2f13f5b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:33.008799 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7ae78-9584-4388-9168-d4a23512a0cc None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:33.018374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1230b-3e1f-4539-86b6-ec2eb2f13f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:33.026557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-54a1230b-3e1f-4539-86b6-ec2eb2f13f5b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:47:33.026557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:33.026557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:33.026557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:33.026557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:33.026557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:33.026557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:33.026557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:33.026557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:33.026557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:33.026557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:33.026557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:33.026557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:33.026557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:33.026557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:33.026557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:33.027564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:33.027564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:33.027564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:33.027564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:33.027564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:33.027564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:33.027564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:33.027564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:33.027564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:33.027564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:33.027564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:33.027564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:33.027564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:33.027564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:33.027564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:33.027564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:33.028514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:33.028514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:33.028514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:33.028514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:33.028514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:33.028514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:33.028514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:33.028514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:33.028514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:33.028514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:33.028514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:47:33.028514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:33.032883 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 483/925] 10.222.0.49 () {56 vars in 1120 bytes} [Tue May 10 13:47:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:33.034183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1230b-3e1f-4539-86b6-ec2eb2f13f5b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:33.139540 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7ae78-9584-4388-9168-d4a23512a0cc None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:33.141304 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1230b-3e1f-4539-86b6-ec2eb2f13f5b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:33.174930 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ef5ad-d53a-4439-87c3-dcd0b40d3f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:33.175603 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ef5ad-d53a-4439-87c3-dcd0b40d3f36 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:33.175883 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ef5ad-d53a-4439-87c3-dcd0b40d3f36 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:33.176742 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ef5ad-d53a-4439-87c3-dcd0b40d3f36 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:33.177488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ef5ad-d53a-4439-87c3-dcd0b40d3f36 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:33.177794 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ef5ad-d53a-4439-87c3-dcd0b40d3f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:33.179146 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ef5ad-d53a-4439-87c3-dcd0b40d3f36 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:33.179256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5374a-6657-4eab-b3a7-a3a4ea18c3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:33.179884 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5374a-6657-4eab-b3a7-a3a4ea18c3fd None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:33.180161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5374a-6657-4eab-b3a7-a3a4ea18c3fd None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:33.180621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5374a-6657-4eab-b3a7-a3a4ea18c3fd None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:33.181638 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5374a-6657-4eab-b3a7-a3a4ea18c3fd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:33.181938 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5374a-6657-4eab-b3a7-a3a4ea18c3fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:33.183279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5374a-6657-4eab-b3a7-a3a4ea18c3fd None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:33.192266 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 484/926] 10.222.0.49 () {56 vars in 1115 bytes} [Tue May 10 13:47:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:33.195110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ef5ad-d53a-4439-87c3-dcd0b40d3f36 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:33.196267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 443/927] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 13:47:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:33.201513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5374a-6657-4eab-b3a7-a3a4ea18c3fd None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:33.300394 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5374a-6657-4eab-b3a7-a3a4ea18c3fd None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:33.318563 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ef5ad-d53a-4439-87c3-dcd0b40d3f36 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:33.335427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98c7db-5d02-452f-9e15-05a18c02bbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:33.336424 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98c7db-5d02-452f-9e15-05a18c02bbfb None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:33.336919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98c7db-5d02-452f-9e15-05a18c02bbfb None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:33.337395 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98c7db-5d02-452f-9e15-05a18c02bbfb None admin] PATH_INFO: `/v3/endpoints` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:33.338387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98c7db-5d02-452f-9e15-05a18c02bbfb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:33.340022 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98c7db-5d02-452f-9e15-05a18c02bbfb None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:33.357712 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8b1a2-8373-46b2-b798-84d6274763c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:33.358900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8b1a2-8373-46b2-b798-84d6274763c3 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:33.359441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8b1a2-8373-46b2-b798-84d6274763c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:33.360047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8b1a2-8373-46b2-b798-84d6274763c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:33.364219 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 444/928] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 13:47:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:47:33.388231 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8b1a2-8373-46b2-b798-84d6274763c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:33.388231 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8b1a2-8373-46b2-b798-84d6274763c3 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:33.405701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-a8d8b1a2-8373-46b2-b798-84d6274763c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:33.405701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:33.405701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:33.405701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:33.405701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:33.405701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:33.405701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:33.405701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:33.405701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:33.405701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:33.405701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:33.405701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:33.405701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:33.405701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:33.405701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:33.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:33.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:33.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:33.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:33.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:33.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:33.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:33.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:33.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:33.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:33.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:33.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:33.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:33.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:33.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:33.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:33.406708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:33.407616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:33.407616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:33.407616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:33.407616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:33.407616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 485/929] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:33.417694 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98c7db-5d02-452f-9e15-05a18c02bbfb None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:33.538724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98c7db-5d02-452f-9e15-05a18c02bbfb None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:33.576936 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec3c03-d3eb-4e79-a3fb-1a5ce3b58b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:33.577573 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec3c03-d3eb-4e79-a3fb-1a5ce3b58b9f None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:33.577841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec3c03-d3eb-4e79-a3fb-1a5ce3b58b9f None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:33.578063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec3c03-d3eb-4e79-a3fb-1a5ce3b58b9f None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:33.578798 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec3c03-d3eb-4e79-a3fb-1a5ce3b58b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:33.579104 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec3c03-d3eb-4e79-a3fb-1a5ce3b58b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:33.580540 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec3c03-d3eb-4e79-a3fb-1a5ce3b58b9f None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:33.594773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 445/930] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:33.600753 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8b1a2-8373-46b2-b798-84d6274763c3 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:33.702335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8b1a2-8373-46b2-b798-84d6274763c3 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:33.736386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617dfea-f2e9-433c-8b47-7d0d95a412de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:33.737200 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617dfea-f2e9-433c-8b47-7d0d95a412de None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:33.737480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617dfea-f2e9-433c-8b47-7d0d95a412de None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:33.737757 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617dfea-f2e9-433c-8b47-7d0d95a412de None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:33.745535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617dfea-f2e9-433c-8b47-7d0d95a412de None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:33.746965 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617dfea-f2e9-433c-8b47-7d0d95a412de None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:33.758691 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b31d5-b247-4936-a10f-be0bcfea90fd None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:33.759264 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b31d5-b247-4936-a10f-be0bcfea90fd None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:33.759782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b31d5-b247-4936-a10f-be0bcfea90fd None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:33.761630 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 446/931] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:33.765009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-2617dfea-f2e9-433c-8b47-7d0d95a412de None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:47:33.765009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:33.765009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:33.765009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:33.765009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:33.765009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:33.765009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:33.765009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:33.765009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:33.765009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:33.765009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:33.765009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:33.765009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:33.765009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:33.765009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:33.765009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:33.765968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:33.766943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:33.766943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:33.766943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:33.766943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:33.766943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:33.766943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:33.766943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:33.766943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:33.766943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:47:33.766943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:33.766943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 486/932] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 13:47:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:33.769293 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ab69b-163a-4afe-937c-39ba18d66880 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:33.769580 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ab69b-163a-4afe-937c-39ba18d66880 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:33.770431 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ab69b-163a-4afe-937c-39ba18d66880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:33.774143 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617dfea-f2e9-433c-8b47-7d0d95a412de None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:33.787850 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-5b9ab69b-163a-4afe-937c-39ba18d66880 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:33.789360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-5b9ab69b-163a-4afe-937c-39ba18d66880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:33.876206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 447/933] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:33.900074 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ab69b-163a-4afe-937c-39ba18d66880 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:33.906051 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617dfea-f2e9-433c-8b47-7d0d95a412de None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:33.949147 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ffc3d-f580-40b0-abe9-8008e565c190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:33.950656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ffc3d-f580-40b0-abe9-8008e565c190 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:33.951187 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ffc3d-f580-40b0-abe9-8008e565c190 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:33.951623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ffc3d-f580-40b0-abe9-8008e565c190 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:33.952815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ffc3d-f580-40b0-abe9-8008e565c190 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:33.953627 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ffc3d-f580-40b0-abe9-8008e565c190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:33.955458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ffc3d-f580-40b0-abe9-8008e565c190 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:33.980694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 487/934] 10.222.0.49 () {56 vars in 1149 bytes} [Tue May 10 13:47:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:33.986509 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ffc3d-f580-40b0-abe9-8008e565c190 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:34.022538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ab69b-163a-4afe-937c-39ba18d66880 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:34.055925 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4043a22-d3d1-406c-908e-19dfc0ff4d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:34.056737 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4043a22-d3d1-406c-908e-19dfc0ff4d68 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.057013 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4043a22-d3d1-406c-908e-19dfc0ff4d68 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.057284 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4043a22-d3d1-406c-908e-19dfc0ff4d68 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.057931 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4043a22-d3d1-406c-908e-19dfc0ff4d68 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:34.059290 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4043a22-d3d1-406c-908e-19dfc0ff4d68 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:34.071330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-f4043a22-d3d1-406c-908e-19dfc0ff4d68 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:47:34.071330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:34.071330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:34.071330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:34.071330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:34.071330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:34.071330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:34.071330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:34.071330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:47:34.071330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:34.071330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:34.071330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:34.071330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:34.071330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:34.071330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:34.071330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:34.071330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:34.072481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:34.072481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:34.072481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:34.072481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:34.072481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:34.072481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:34.072481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:34.072481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:34.072481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:34.072481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:34.072481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:34.072481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:34.072481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:34.072481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:34.072481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:34.072481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:34.073336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:34.073336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:34.073336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:34.073336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:34.073336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:34.073336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:34.073336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:34.073336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:34.073336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:34.073336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:34.073336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:34.073336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:34.073336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:47:34.073336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:34.073336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 448/935] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:34.074144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ce98e-d3c8-43b6-a65f-0ab7e3bbe554 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.074144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ce98e-d3c8-43b6-a65f-0ab7e3bbe554 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.074266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ce98e-d3c8-43b6-a65f-0ab7e3bbe554 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.075699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 449/936] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:34.078643 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ce98e-d3c8-43b6-a65f-0ab7e3bbe554 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:34.088195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ffc3d-f580-40b0-abe9-8008e565c190 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:34.120729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c7882-b1b2-481b-bc19-1599e41353cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:34.121511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c7882-b1b2-481b-bc19-1599e41353cd None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.121784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c7882-b1b2-481b-bc19-1599e41353cd None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.122070 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c7882-b1b2-481b-bc19-1599e41353cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.133003 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c7882-b1b2-481b-bc19-1599e41353cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:34.135008 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c7882-b1b2-481b-bc19-1599e41353cd None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:34.154102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-af7c7882-b1b2-481b-bc19-1599e41353cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:34.154102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:34.154102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:34.154102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:34.154102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:34.154102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:34.154102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:34.154102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:34.154102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:34.154102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:34.154102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:34.154102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:34.154102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:34.154102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:34.154102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:34.155423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:34.155423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:34.155423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:34.155423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:34.155423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:34.155423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:34.155423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:34.155423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:34.155423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:34.155423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:34.155423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:34.155423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:34.155423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:34.155423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:34.155423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:34.155423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:34.155423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:34.156388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:34.156388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:34.156388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:34.156388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:34.156388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 488/937] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:34.157097 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c6f9c-351a-4a60-8902-05a96147d0fc None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.157376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c6f9c-351a-4a60-8902-05a96147d0fc None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.157651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c6f9c-351a-4a60-8902-05a96147d0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.173912 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-bd0c6f9c-351a-4a60-8902-05a96147d0fc None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:34.175073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-bd0c6f9c-351a-4a60-8902-05a96147d0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:34.182988 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ce98e-d3c8-43b6-a65f-0ab7e3bbe554 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:34.215760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919fa388-ac0e-4303-b048-e5ff7509f075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:34.216450 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fa388-ac0e-4303-b048-e5ff7509f075 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.216727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fa388-ac0e-4303-b048-e5ff7509f075 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.216997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fa388-ac0e-4303-b048-e5ff7509f075 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.217703 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919fa388-ac0e-4303-b048-e5ff7509f075 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:34.218003 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919fa388-ac0e-4303-b048-e5ff7509f075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:34.219353 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919fa388-ac0e-4303-b048-e5ff7509f075 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:34.223998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 450/938] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 13:47:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:34.224783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919fa388-ac0e-4303-b048-e5ff7509f075 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:34.264199 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 489/939] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:34.264199 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c6f9c-351a-4a60-8902-05a96147d0fc None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:34.338319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919fa388-ac0e-4303-b048-e5ff7509f075 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:34.353808 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c6f9c-351a-4a60-8902-05a96147d0fc None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:34.370794 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382955a-218c-433c-ae6b-a7c56a46d09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:34.371451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382955a-218c-433c-ae6b-a7c56a46d09e None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.371724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382955a-218c-433c-ae6b-a7c56a46d09e None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.371995 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382955a-218c-433c-ae6b-a7c56a46d09e None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.372728 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382955a-218c-433c-ae6b-a7c56a46d09e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:34.373028 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382955a-218c-433c-ae6b-a7c56a46d09e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:34.374372 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382955a-218c-433c-ae6b-a7c56a46d09e None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:34.390905 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 451/940] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:34.390905 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382955a-218c-433c-ae6b-a7c56a46d09e None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:34.402715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952575e9-84c9-44f8-b444-8e778b2f6cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:34.403551 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952575e9-84c9-44f8-b444-8e778b2f6cc6 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.404256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952575e9-84c9-44f8-b444-8e778b2f6cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.404544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952575e9-84c9-44f8-b444-8e778b2f6cc6 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.405667 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952575e9-84c9-44f8-b444-8e778b2f6cc6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:34.405974 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952575e9-84c9-44f8-b444-8e778b2f6cc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:34.407319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952575e9-84c9-44f8-b444-8e778b2f6cc6 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:34.412115 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 490/941] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 13:47:34 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:34.412902 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952575e9-84c9-44f8-b444-8e778b2f6cc6 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:34.507516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382955a-218c-433c-ae6b-a7c56a46d09e None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:34.520434 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952575e9-84c9-44f8-b444-8e778b2f6cc6 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:34.546262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6679274-6c62-4ebc-aef2-5596f5b65411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:34.547335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6679274-6c62-4ebc-aef2-5596f5b65411 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.547766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6679274-6c62-4ebc-aef2-5596f5b65411 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.548245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6679274-6c62-4ebc-aef2-5596f5b65411 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.549057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6679274-6c62-4ebc-aef2-5596f5b65411 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:34.550603 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6679274-6c62-4ebc-aef2-5596f5b65411 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:34.557200 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38a7b2-697d-4a7e-88e6-6546c9a9cd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:34.558015 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38a7b2-697d-4a7e-88e6-6546c9a9cd24 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.558291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38a7b2-697d-4a7e-88e6-6546c9a9cd24 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.558556 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38a7b2-697d-4a7e-88e6-6546c9a9cd24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.565455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-d6679274-6c62-4ebc-aef2-5596f5b65411 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:47:34.565455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:34.565455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:34.565455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:34.565455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:34.565455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:34.565455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:34.565455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:34.565455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:47:34.565455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:34.565455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:34.565455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:34.565455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:34.565455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:34.565455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:34.565455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:34.565455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:34.566767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:34.566767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:34.566767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:34.566767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:34.566767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:34.566767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:34.566767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:34.566767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:34.566767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:34.566767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:34.566767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:34.566767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:34.566767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:34.566767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:34.566767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:34.566767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:34.567836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:34.567836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:34.567836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:34.567836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:34.567836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:34.567836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:34.567836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:34.567836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:34.567836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:34.567836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:34.567836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:34.567836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:34.567836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:47:34.567836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:34.568704 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38a7b2-697d-4a7e-88e6-6546c9a9cd24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:34.568704 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38a7b2-697d-4a7e-88e6-6546c9a9cd24 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:34.570537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 452/942] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 13:47:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:34.579530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6679274-6c62-4ebc-aef2-5596f5b65411 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:34.582855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-1d38a7b2-697d-4a7e-88e6-6546c9a9cd24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:34.582855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:34.582855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:34.582855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:34.582855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:34.582855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:34.582855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:34.582855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:34.582855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:34.582855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:34.582855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:34.582855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:34.582855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:34.582855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:34.582855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:34.583822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:34.583822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:34.583822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:34.583822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:34.583822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:34.583822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:34.583822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:34.583822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:34.583822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:34.583822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:34.583822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:34.583822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:34.583822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:34.583822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:34.583822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:34.583822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:34.583822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:34.584779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:34.584779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:34.584779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:34.584779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:34.584779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:34.584779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:34.584779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:34.584779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:34.589227 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 491/943] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:34.590679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38a7b2-697d-4a7e-88e6-6546c9a9cd24 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:34.698985 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38a7b2-697d-4a7e-88e6-6546c9a9cd24 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:34.714113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6679274-6c62-4ebc-aef2-5596f5b65411 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:34.733761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debb103-8ff7-4118-af1e-8efd453b0706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:34.734439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debb103-8ff7-4118-af1e-8efd453b0706 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.734698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debb103-8ff7-4118-af1e-8efd453b0706 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.734972 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debb103-8ff7-4118-af1e-8efd453b0706 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.735924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debb103-8ff7-4118-af1e-8efd453b0706 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:34.736257 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debb103-8ff7-4118-af1e-8efd453b0706 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:34.737978 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debb103-8ff7-4118-af1e-8efd453b0706 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:34.753633 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 492/944] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:34.756008 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaf35b-f18b-4305-9f6c-3819ad45abe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:34.756722 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaf35b-f18b-4305-9f6c-3819ad45abe7 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.757012 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaf35b-f18b-4305-9f6c-3819ad45abe7 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.757289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaf35b-f18b-4305-9f6c-3819ad45abe7 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.757998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaf35b-f18b-4305-9f6c-3819ad45abe7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:34.758306 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaf35b-f18b-4305-9f6c-3819ad45abe7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:34.759297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debb103-8ff7-4118-af1e-8efd453b0706 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:34.759670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaf35b-f18b-4305-9f6c-3819ad45abe7 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:34.765274 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 453/945] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 13:47:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:34.771067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaf35b-f18b-4305-9f6c-3819ad45abe7 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:34.876405 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debb103-8ff7-4118-af1e-8efd453b0706 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:34.897756 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaf35b-f18b-4305-9f6c-3819ad45abe7 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:34.913334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59fa89-03a6-4be0-a747-8bd1dc8ef771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:34.914284 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59fa89-03a6-4be0-a747-8bd1dc8ef771 None admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.914632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59fa89-03a6-4be0-a747-8bd1dc8ef771 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.914978 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59fa89-03a6-4be0-a747-8bd1dc8ef771 None admin] PATH_INFO: `/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/df5dcdfb4eda417ebc0af2432497617d/roles/76799389aacd44d5a8d92e1df6f89e12` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.917407 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59fa89-03a6-4be0-a747-8bd1dc8ef771 None admin] RBAC: Authorizing `identity:create_grant(project_id=9613de9a3bc9461d9d348e5b66b8d684, user_id=df5dcdfb4eda417ebc0af2432497617d, role_id=76799389aacd44d5a8d92e1df6f89e12)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:34.918902 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59fa89-03a6-4be0-a747-8bd1dc8ef771 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:34.940216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 493/946] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:47:34 2022] PUT /identity/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/df5dcdfb4eda417ebc0af2432497617d/roles/76799389aacd44d5a8d92e1df6f89e12 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:47:34.945073 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867c2be-afb4-408e-ac0c-31e44b02ce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:34.945761 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867c2be-afb4-408e-ac0c-31e44b02ce80 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:34.946039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867c2be-afb4-408e-ac0c-31e44b02ce80 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:34.946317 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867c2be-afb4-408e-ac0c-31e44b02ce80 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:34.947036 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867c2be-afb4-408e-ac0c-31e44b02ce80 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:34.947339 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867c2be-afb4-408e-ac0c-31e44b02ce80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:34.948840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867c2be-afb4-408e-ac0c-31e44b02ce80 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:34.955050 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 454/947] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 13:47:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:34.961525 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59fa89-03a6-4be0-a747-8bd1dc8ef771 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:35.074396 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59fa89-03a6-4be0-a747-8bd1dc8ef771 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:35.112251 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabfb56-8832-4a58-88a9-30edf9dfc7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:35.112925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabfb56-8832-4a58-88a9-30edf9dfc7bc None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:35.113211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabfb56-8832-4a58-88a9-30edf9dfc7bc None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:35.113608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabfb56-8832-4a58-88a9-30edf9dfc7bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:35.114414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabfb56-8832-4a58-88a9-30edf9dfc7bc None admin] RBAC: Adding query filter params (interface=public, service_id=b46c01a1d245421bb8537101c837872b, region_id=RegionOne) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:35.114727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabfb56-8832-4a58-88a9-30edf9dfc7bc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:35.116102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabfb56-8832-4a58-88a9-30edf9dfc7bc None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:35.122835 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 494/948] 10.222.0.49 () {56 vars in 1251 bytes} [Tue May 10 13:47:34 2022] GET /identity/v3/endpoints?service_id=b46c01a1d245421bb8537101c837872b&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:35.127249 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867c2be-afb4-408e-ac0c-31e44b02ce80 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:35.236709 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867c2be-afb4-408e-ac0c-31e44b02ce80 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:35.271956 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71749d-7d30-4845-8a6c-c04f63450906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:35.272660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71749d-7d30-4845-8a6c-c04f63450906 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:35.272943 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71749d-7d30-4845-8a6c-c04f63450906 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:35.273219 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71749d-7d30-4845-8a6c-c04f63450906 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:35.273902 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71749d-7d30-4845-8a6c-c04f63450906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:35.275256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71749d-7d30-4845-8a6c-c04f63450906 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:35.281968 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 455/949] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 13:47:35 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:47:35.722615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bacd15-a9e2-48a7-b8ad-c21d2ac5a35a None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:35.723118 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bacd15-a9e2-48a7-b8ad-c21d2ac5a35a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:35.723294 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bacd15-a9e2-48a7-b8ad-c21d2ac5a35a None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:35.724844 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 495/950] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:35.730442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dc7e2-475e-4bd5-87df-2643a1261eb2 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:35.731010 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dc7e2-475e-4bd5-87df-2643a1261eb2 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:35.731010 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dc7e2-475e-4bd5-87df-2643a1261eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:35.748103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-a52dc7e2-475e-4bd5-87df-2643a1261eb2 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:35.749286 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a52dc7e2-475e-4bd5-87df-2643a1261eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:35.821012 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 456/951] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:47:35.843781 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bacd15-a9e2-48a7-b8ad-c21d2ac5a35a None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:35.943266 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bacd15-a9e2-48a7-b8ad-c21d2ac5a35a None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:35.977202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4cbc4-e439-42a0-ada9-fa0b162f4774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:35.977829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4cbc4-e439-42a0-ada9-fa0b162f4774 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:35.978107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4cbc4-e439-42a0-ada9-fa0b162f4774 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:35.978376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4cbc4-e439-42a0-ada9-fa0b162f4774 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:35.979067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4cbc4-e439-42a0-ada9-fa0b162f4774 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:35.980488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4cbc4-e439-42a0-ada9-fa0b162f4774 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:35.981889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: WARNING keystone.server.flask.common [None req-92c4cbc4-e439-42a0-ada9-fa0b162f4774 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 13:47:36.000091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.sql.core [None req-92c4cbc4-e439-42a0-ada9-fa0b162f4774 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 13:47:36.000091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 13:47:36.000091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [parameters: {'id': '5ac733af0be6469d8e01ed54ca5e25ec', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 13:47:36.000091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79924) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 13:47:36.007856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-92c4cbc4-e439-42a0-ada9-fa0b162f4774 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ac733af0be6469d8e01ed54ca5e25ec.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ac733af0be6469d8e01ed54ca5e25ec. May 10 13:47:36.007856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:36.007856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 13:47:36.007856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 13:47:36.007856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 13:47:36.007856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 13:47:36.007856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 13:47:36.007856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application result = self._query(query) May 10 13:47:36.007856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 13:47:36.007856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application conn.query(q) May 10 13:47:36.007856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 13:47:36.007856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 13:47:36.007856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application result.read() May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 10 13:47:36.009729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return project_ref.to_dict() May 10 13:47:36.012042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 13:47:36.012042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application next(self.gen) May 10 13:47:36.012042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 13:47:36.012042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application yield resource May 10 13:47:36.012042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 13:47:36.012042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application next(self.gen) May 10 13:47:36.012042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 13:47:36.012042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self.session.rollback() May 10 13:47:36.012042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 13:47:36.012042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self.force_reraise() May 10 13:47:36.012042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 13:47:36.012042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise self.value May 10 13:47:36.012042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 13:47:36.012042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 13:47:36.012042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 13:47:36.012042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application session.commit() May 10 13:47:36.012042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 13:47:36.014244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 13:47:36.014244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 13:47:36.014244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._prepare_impl() May 10 13:47:36.014244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 13:47:36.014244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self.session.flush() May 10 13:47:36.014244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 13:47:36.014244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._flush(objects) May 10 13:47:36.014244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 13:47:36.014244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 13:47:36.014244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 13:47:36.014244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application compat.raise_( May 10 13:47:36.014244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 13:47:36.014244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception May 10 13:47:36.014244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 13:47:36.014244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application flush_context.execute() May 10 13:47:36.014244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 13:47:36.014244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rec.execute(self) May 10 13:47:36.016375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 13:47:36.016375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 13:47:36.016375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 13:47:36.016375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 13:47:36.016375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 13:47:36.016375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 13:47:36.016375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 13:47:36.016375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 13:47:36.016375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 13:47:36.016375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 13:47:36.016375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 13:47:36.016375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 13:47:36.016375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 13:47:36.016375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 13:47:36.016375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 13:47:36.018229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 13:47:36.018229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 13:47:36.018229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception May 10 13:47:36.018229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 13:47:36.018229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 13:47:36.018229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 13:47:36.018229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 13:47:36.018229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 13:47:36.018229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application result = self._query(query) May 10 13:47:36.018229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 13:47:36.018229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application conn.query(q) May 10 13:47:36.018229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 13:47:36.018229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 13:47:36.018229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 13:47:36.018229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application result.read() May 10 13:47:36.018229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 13:47:36.018229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 13:47:36.020382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 13:47:36.020382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 13:47:36.020382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 13:47:36.020382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 13:47:36.020382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 13:47:36.020382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 13:47:36.020382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 13:47:36.020382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 13:47:36.020382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [parameters: {'id': '5ac733af0be6469d8e01ed54ca5e25ec', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 13:47:36.020382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 13:47:36.020382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:36.020382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:36.020382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:36.020382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:36.020382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 10 13:47:36.022255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 10 13:47:36.022255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 13:47:36.022255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 13:47:36.022255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 10 13:47:36.022255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:36.022255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:36.022255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:36.022255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:36.022255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:36.022255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:36.022255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:36.022255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:36.022255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:36.022255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:36.022255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:36.022255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:36.022255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:36.024607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:36.024607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 10 13:47:36.024607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 10 13:47:36.024607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:36.024607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:36.024607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 10 13:47:36.024607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.Conflict( May 10 13:47:36.024607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ac733af0be6469d8e01ed54ca5e25ec. May 10 13:47:36.024607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:36.024607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 496/952] 10.222.0.49 () {60 vars in 1140 bytes} [Tue May 10 13:47:35 2022] POST /identity/v3/projects => generated 262 bytes in 166 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:36.025856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dc7e2-475e-4bd5-87df-2643a1261eb2 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:36.120996 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dc7e2-475e-4bd5-87df-2643a1261eb2 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:36.157646 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51afdb1-0145-41ba-b5b6-deb80bae9d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:36.158456 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51afdb1-0145-41ba-b5b6-deb80bae9d02 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:36.158737 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51afdb1-0145-41ba-b5b6-deb80bae9d02 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:36.159010 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51afdb1-0145-41ba-b5b6-deb80bae9d02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:36.169070 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51afdb1-0145-41ba-b5b6-deb80bae9d02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:36.171544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51afdb1-0145-41ba-b5b6-deb80bae9d02 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:36.186433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-e51afdb1-0145-41ba-b5b6-deb80bae9d02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:36.186433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:36.186433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:36.186433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:36.186433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:36.186433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:36.186433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:36.186433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:36.186433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:36.186433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:36.186433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:36.186433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:36.186433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:36.186433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:36.186433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:36.187471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:36.187471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:36.187471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:36.187471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:36.187471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:36.187471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:36.187471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:36.187471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:36.187471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:36.187471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:36.187471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:36.187471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:36.187471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:36.187471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:36.187471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:36.187471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:36.187471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:36.188440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:36.188440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:36.188440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:36.188440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:36.188440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:36.188440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:36.188440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:36.188440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:36.188440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 457/953] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:36.193914 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4cbc4-e439-42a0-ada9-fa0b162f4774 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:36.294493 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4cbc4-e439-42a0-ada9-fa0b162f4774 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:36.328222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c5207-e64c-4b93-9d79-b0bcd0792b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:36.328882 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c5207-e64c-4b93-9d79-b0bcd0792b08 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:36.329154 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c5207-e64c-4b93-9d79-b0bcd0792b08 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:36.329422 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c5207-e64c-4b93-9d79-b0bcd0792b08 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:36.330163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c5207-e64c-4b93-9d79-b0bcd0792b08 None admin] RBAC: Adding query filter params (name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:36.330460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c5207-e64c-4b93-9d79-b0bcd0792b08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:36.332623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c5207-e64c-4b93-9d79-b0bcd0792b08 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:36.360324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 497/954] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 13:47:36 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:36.776692 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665e583-6408-4860-aa88-6b312b6d5638 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:36.777224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665e583-6408-4860-aa88-6b312b6d5638 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:36.777224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665e583-6408-4860-aa88-6b312b6d5638 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:36.778856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 458/955] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:36.784736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8f164-9853-4fe4-9b75-7e34591fd63b None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:36.785024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8f164-9853-4fe4-9b75-7e34591fd63b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:36.785340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8f164-9853-4fe4-9b75-7e34591fd63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:36.802717 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-0ad8f164-9853-4fe4-9b75-7e34591fd63b None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:36.804234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-0ad8f164-9853-4fe4-9b75-7e34591fd63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:36.874279 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 498/956] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:36.899227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665e583-6408-4860-aa88-6b312b6d5638 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:37.018235 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665e583-6408-4860-aa88-6b312b6d5638 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:37.055896 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499290f-741c-405b-a34b-b0119d791ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:37.056945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499290f-741c-405b-a34b-b0119d791ad4 None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:37.057434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499290f-741c-405b-a34b-b0119d791ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:37.057914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499290f-741c-405b-a34b-b0119d791ad4 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:37.058850 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499290f-741c-405b-a34b-b0119d791ad4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:37.060458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499290f-741c-405b-a34b-b0119d791ad4 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:37.079442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 459/957] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 13:47:36 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:37.377763 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5f4f5-d6ed-4120-8879-e1d42858fd1a None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:37.378096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5f4f5-d6ed-4120-8879-e1d42858fd1a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:37.378324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5f4f5-d6ed-4120-8879-e1d42858fd1a None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:37.380044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 499/958] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:37.385438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b2087-d28f-40e5-893d-2fff4304c1c9 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:37.385730 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b2087-d28f-40e5-893d-2fff4304c1c9 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:37.386011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b2087-d28f-40e5-893d-2fff4304c1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:37.403400 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-893b2087-d28f-40e5-893d-2fff4304c1c9 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:37.404952 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-893b2087-d28f-40e5-893d-2fff4304c1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:37.481856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 460/959] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:37.505378 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5f4f5-d6ed-4120-8879-e1d42858fd1a None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:37.614485 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5f4f5-d6ed-4120-8879-e1d42858fd1a None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:37.649391 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62609029-bd34-41cf-9b3f-4adf8a549c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:37.650130 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62609029-bd34-41cf-9b3f-4adf8a549c5a None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:37.650406 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62609029-bd34-41cf-9b3f-4adf8a549c5a None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:37.650675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62609029-bd34-41cf-9b3f-4adf8a549c5a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:37.664051 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62609029-bd34-41cf-9b3f-4adf8a549c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:37.672269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-62609029-bd34-41cf-9b3f-4adf8a549c5a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:47:37.672269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:37.672269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:37.672269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:37.672269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:37.672269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:37.672269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:37.672269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:37.672269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:37.672269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:37.672269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:37.672269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:37.672269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:37.672269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:37.672269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:37.672269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:37.673230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:37.673230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:37.673230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:37.673230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:37.673230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:37.673230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:37.673230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:37.673230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:37.673230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:37.673230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:37.673230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:37.673230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:37.673230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:37.673230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:37.673230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:37.673230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:37.674125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:37.674125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:37.674125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:37.674125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:37.674125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:37.674125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:37.674125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:37.674125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:37.674125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:37.674125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:37.674125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:47:37.674125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:37.674125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 500/960] 10.222.0.49 () {56 vars in 1120 bytes} [Tue May 10 13:47:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:37.679784 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b2087-d28f-40e5-893d-2fff4304c1c9 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:37.681565 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8933e-7b9f-4faa-9040-a78f3e4571fa None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:37.682285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8933e-7b9f-4faa-9040-a78f3e4571fa None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:37.683678 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8933e-7b9f-4faa-9040-a78f3e4571fa None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:37.685648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 501/961] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:37.692812 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8edad-70b1-4fb7-9933-7a249acdb49f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:37.693618 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8edad-70b1-4fb7-9933-7a249acdb49f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:37.694081 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8edad-70b1-4fb7-9933-7a249acdb49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:37.715615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-1bf8edad-70b1-4fb7-9933-7a249acdb49f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:37.718059 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-1bf8edad-70b1-4fb7-9933-7a249acdb49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:37.800406 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 502/962] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:47:37.801900 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b2087-d28f-40e5-893d-2fff4304c1c9 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:37.819988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8edad-70b1-4fb7-9933-7a249acdb49f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:37.840881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0acf81-8ee7-47f8-a094-c753e1478719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:37.842048 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0acf81-8ee7-47f8-a094-c753e1478719 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:37.842406 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0acf81-8ee7-47f8-a094-c753e1478719 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:37.842759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0acf81-8ee7-47f8-a094-c753e1478719 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:37.843843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0acf81-8ee7-47f8-a094-c753e1478719 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:37.844246 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0acf81-8ee7-47f8-a094-c753e1478719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:37.845883 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0acf81-8ee7-47f8-a094-c753e1478719 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:37.857411 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 461/963] 10.222.0.49 () {56 vars in 1115 bytes} [Tue May 10 13:47:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:37.863088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0acf81-8ee7-47f8-a094-c753e1478719 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:37.930296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8edad-70b1-4fb7-9933-7a249acdb49f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:37.973665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418ac5b-05f6-4b6c-8864-9c32f546b78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:37.974574 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418ac5b-05f6-4b6c-8864-9c32f546b78f None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:37.974932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418ac5b-05f6-4b6c-8864-9c32f546b78f None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:37.975280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418ac5b-05f6-4b6c-8864-9c32f546b78f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:37.975646 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0acf81-8ee7-47f8-a094-c753e1478719 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:37.976082 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418ac5b-05f6-4b6c-8864-9c32f546b78f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:37.977725 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418ac5b-05f6-4b6c-8864-9c32f546b78f None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:37.994028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-1418ac5b-05f6-4b6c-8864-9c32f546b78f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:47:37.994028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:37.994028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:37.994028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:37.994028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:37.994028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:37.994028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:37.994028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:37.994028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:47:37.994028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:37.994028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:37.994028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:37.994028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:37.994028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:37.994028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:37.994028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:37.994028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:37.995089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:37.995089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:37.995089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:37.995089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:37.995089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:37.995089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:37.995089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:37.995089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:37.995089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:37.995089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:37.995089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:37.995089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:37.995089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:37.995089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:37.995089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:37.995089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:37.995944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:37.995944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:37.995944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:37.995944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:37.995944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:37.995944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:37.995944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:37.995944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:37.995944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:37.995944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:37.995944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:37.995944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:37.995944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:47:37.995944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:37.995944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 503/964] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 13:47:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:38.003339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418ac5b-05f6-4b6c-8864-9c32f546b78f None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:38.015488 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c01f0-71c7-4dcf-a79a-03b9ea7521f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:38.016633 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c01f0-71c7-4dcf-a79a-03b9ea7521f9 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:38.017140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c01f0-71c7-4dcf-a79a-03b9ea7521f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:38.017665 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c01f0-71c7-4dcf-a79a-03b9ea7521f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:38.028897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c01f0-71c7-4dcf-a79a-03b9ea7521f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:38.030878 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c01f0-71c7-4dcf-a79a-03b9ea7521f9 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:38.048159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-286c01f0-71c7-4dcf-a79a-03b9ea7521f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:38.048159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:38.048159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:38.048159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:38.048159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:38.048159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:38.048159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:38.048159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:38.048159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:38.048159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:38.048159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:38.048159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:38.048159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:38.048159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:38.048159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:38.049115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:38.049115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:38.049115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:38.049115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:38.049115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:38.049115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:38.049115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:38.049115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:38.049115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:38.049115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:38.049115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:38.049115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:38.049115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:38.049115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:38.049115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:38.049115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:38.049115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:38.050037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:38.050037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:38.050037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:38.050037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:38.052782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 462/965] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:38.058148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c01f0-71c7-4dcf-a79a-03b9ea7521f9 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:38.124290 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418ac5b-05f6-4b6c-8864-9c32f546b78f None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:38.160353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60ec50-eb16-425a-bb35-7283cbb7e89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:38.161110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60ec50-eb16-425a-bb35-7283cbb7e89f None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:38.161463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60ec50-eb16-425a-bb35-7283cbb7e89f None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:38.161809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60ec50-eb16-425a-bb35-7283cbb7e89f None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:38.162579 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60ec50-eb16-425a-bb35-7283cbb7e89f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:38.162954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60ec50-eb16-425a-bb35-7283cbb7e89f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:38.164458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60ec50-eb16-425a-bb35-7283cbb7e89f None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:38.172079 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c01f0-71c7-4dcf-a79a-03b9ea7521f9 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:38.174600 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 504/966] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 13:47:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:38.175652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60ec50-eb16-425a-bb35-7283cbb7e89f None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:38.207921 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34e663-f924-4470-b7fb-54e7fc501538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:38.208948 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34e663-f924-4470-b7fb-54e7fc501538 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:38.209438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34e663-f924-4470-b7fb-54e7fc501538 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:38.209935 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34e663-f924-4470-b7fb-54e7fc501538 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:38.210853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34e663-f924-4470-b7fb-54e7fc501538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:38.211393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34e663-f924-4470-b7fb-54e7fc501538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:38.213011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34e663-f924-4470-b7fb-54e7fc501538 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:38.230530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 463/967] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:38.231721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34e663-f924-4470-b7fb-54e7fc501538 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:38.280300 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60ec50-eb16-425a-bb35-7283cbb7e89f None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:38.315422 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee72ab-bb94-4b22-afe4-f0b16ec629fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:38.316402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee72ab-bb94-4b22-afe4-f0b16ec629fb None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:38.316831 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee72ab-bb94-4b22-afe4-f0b16ec629fb None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:38.317251 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee72ab-bb94-4b22-afe4-f0b16ec629fb None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:38.318099 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee72ab-bb94-4b22-afe4-f0b16ec629fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:38.318576 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee72ab-bb94-4b22-afe4-f0b16ec629fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:38.320066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee72ab-bb94-4b22-afe4-f0b16ec629fb None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:38.330348 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 505/968] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 13:47:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:38.331416 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee72ab-bb94-4b22-afe4-f0b16ec629fb None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:38.334967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34e663-f924-4470-b7fb-54e7fc501538 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:38.371924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d94e8c-903d-431e-87fd-ee4082037b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:38.372912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d94e8c-903d-431e-87fd-ee4082037b5a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:38.373312 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d94e8c-903d-431e-87fd-ee4082037b5a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:38.373685 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d94e8c-903d-431e-87fd-ee4082037b5a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:38.381393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d94e8c-903d-431e-87fd-ee4082037b5a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:38.383041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d94e8c-903d-431e-87fd-ee4082037b5a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:38.398434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-95d94e8c-903d-431e-87fd-ee4082037b5a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:47:38.398434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:38.398434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:38.398434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:38.398434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:38.398434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:38.398434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:38.398434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:38.398434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:38.398434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:38.398434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:38.398434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:38.398434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:38.398434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:38.398434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:38.398434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:38.399569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:38.400567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:38.400567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:38.400567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:38.400567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:38.400567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:38.400567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:38.400567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:38.400567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:38.400567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 13:47:38.400567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:38.401166 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 464/969] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 13:47:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:38.406736 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d94e8c-903d-431e-87fd-ee4082037b5a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:38.443497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee72ab-bb94-4b22-afe4-f0b16ec629fb None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:38.480866 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a62dc-3715-4802-96bc-23661c1be58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:38.481814 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a62dc-3715-4802-96bc-23661c1be58c None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:38.482274 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a62dc-3715-4802-96bc-23661c1be58c None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:38.482750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a62dc-3715-4802-96bc-23661c1be58c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:38.483669 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a62dc-3715-4802-96bc-23661c1be58c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:38.485240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a62dc-3715-4802-96bc-23661c1be58c None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:38.512258 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d94e8c-903d-431e-87fd-ee4082037b5a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:38.512753 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 506/970] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 13:47:38 2022] POST /identity/v3/endpoints => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:38.561170 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379beee-58b1-484c-9896-3cff491dba8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:38.561853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379beee-58b1-484c-9896-3cff491dba8d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:38.562155 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379beee-58b1-484c-9896-3cff491dba8d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:38.562398 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379beee-58b1-484c-9896-3cff491dba8d None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:38.563243 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379beee-58b1-484c-9896-3cff491dba8d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:38.563552 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379beee-58b1-484c-9896-3cff491dba8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:38.565031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379beee-58b1-484c-9896-3cff491dba8d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:38.587487 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 465/971] 10.222.0.49 () {56 vars in 1149 bytes} [Tue May 10 13:47:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:38.593813 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a62dc-3715-4802-96bc-23661c1be58c None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:38.702731 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a62dc-3715-4802-96bc-23661c1be58c None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:38.734910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b483cf-b402-4636-bf1e-c1ab94b13ed2 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:38.735137 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b483cf-b402-4636-bf1e-c1ab94b13ed2 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:38.735411 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b483cf-b402-4636-bf1e-c1ab94b13ed2 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:38.737042 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 466/972] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:38.742046 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd98c7-5cd2-4eb8-8bd6-b416cdcf60f2 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:38.742358 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd98c7-5cd2-4eb8-8bd6-b416cdcf60f2 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:38.742668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd98c7-5cd2-4eb8-8bd6-b416cdcf60f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:38.742970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c4084-b116-45d2-b216-6ca35c244d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:38.743624 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c4084-b116-45d2-b216-6ca35c244d26 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:38.743908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c4084-b116-45d2-b216-6ca35c244d26 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:38.744213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c4084-b116-45d2-b216-6ca35c244d26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:38.762921 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-abdd98c7-5cd2-4eb8-8bd6-b416cdcf60f2 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:38.763960 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-abdd98c7-5cd2-4eb8-8bd6-b416cdcf60f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:38.824775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c4084-b116-45d2-b216-6ca35c244d26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:38.826729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c4084-b116-45d2-b216-6ca35c244d26 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:38.856427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 467/973] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:47:38.874832 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd98c7-5cd2-4eb8-8bd6-b416cdcf60f2 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:38.956206 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 507/974] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:47:38 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:47:38.962613 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c4084-b116-45d2-b216-6ca35c244d26 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:38.995060 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd98c7-5cd2-4eb8-8bd6-b416cdcf60f2 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:39.029653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b564c4-6f93-464c-9815-a12da2fdf7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:39.030959 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b564c4-6f93-464c-9815-a12da2fdf7c0 None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.031443 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b564c4-6f93-464c-9815-a12da2fdf7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.031917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b564c4-6f93-464c-9815-a12da2fdf7c0 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.032853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b564c4-6f93-464c-9815-a12da2fdf7c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:39.034495 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b564c4-6f93-464c-9815-a12da2fdf7c0 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:39.036651 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: WARNING keystone.server.flask.common [None req-a0b564c4-6f93-464c-9815-a12da2fdf7c0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 13:47:39.049225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.sql.core [None req-a0b564c4-6f93-464c-9815-a12da2fdf7c0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 13:47:39.049225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 13:47:39.049225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [parameters: {'user_id': 'b538bffcf61340a2aedb429300a713ba', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 13:47:39.049225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79925) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 13:47:39.065044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c4084-b116-45d2-b216-6ca35c244d26 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:39.072199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-a0b564c4-6f93-464c-9815-a12da2fdf7c0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 13:47:39.072199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:39.072199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 13:47:39.072199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 13:47:39.072199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 13:47:39.072199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 13:47:39.072199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 13:47:39.072199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application result = self._query(query) May 10 13:47:39.072199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 13:47:39.072199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application conn.query(q) May 10 13:47:39.072199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 13:47:39.072199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 13:47:39.072199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 13:47:39.072199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application result.read() May 10 13:47:39.072199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 13:47:39.073160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application next(self.gen) May 10 13:47:39.074187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 13:47:39.074187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application yield resource May 10 13:47:39.074187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 13:47:39.074187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application next(self.gen) May 10 13:47:39.074187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 13:47:39.074187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self.session.rollback() May 10 13:47:39.074187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 13:47:39.074187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self.force_reraise() May 10 13:47:39.074187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 13:47:39.074187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise self.value May 10 13:47:39.074187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 13:47:39.074187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 13:47:39.074187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 13:47:39.074187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application session.commit() May 10 13:47:39.074187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 13:47:39.074187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 13:47:39.074187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 13:47:39.075123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._prepare_impl() May 10 13:47:39.075123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 13:47:39.075123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self.session.flush() May 10 13:47:39.075123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 13:47:39.075123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._flush(objects) May 10 13:47:39.075123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 13:47:39.075123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 13:47:39.075123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 13:47:39.075123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application compat.raise_( May 10 13:47:39.075123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 13:47:39.075123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception May 10 13:47:39.075123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 13:47:39.075123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application flush_context.execute() May 10 13:47:39.075123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 13:47:39.075123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rec.execute(self) May 10 13:47:39.075123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 13:47:39.075123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 13:47:39.076043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 13:47:39.076043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 13:47:39.076043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 10 13:47:39.076043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application result = connection._execute_20( May 10 13:47:39.076043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 13:47:39.076043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 13:47:39.076043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 13:47:39.076043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 13:47:39.076043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 13:47:39.076043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 13:47:39.076043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 13:47:39.076043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 13:47:39.076043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 13:47:39.076043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 13:47:39.076043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 13:47:39.076043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception May 10 13:47:39.077606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 13:47:39.077606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 13:47:39.077606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 13:47:39.077606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 13:47:39.077606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 13:47:39.077606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application result = self._query(query) May 10 13:47:39.077606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 13:47:39.077606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application conn.query(q) May 10 13:47:39.077606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 13:47:39.077606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 13:47:39.077606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 13:47:39.077606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application result.read() May 10 13:47:39.077606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 13:47:39.077606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 13:47:39.077606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 13:47:39.077606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 13:47:39.078677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 13:47:39.078677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 13:47:39.078677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 13:47:39.078677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 13:47:39.078677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 13:47:39.078677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 13:47:39.078677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b538bffcf61340a2aedb429300a713ba', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 13:47:39.078677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 13:47:39.078677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:39.078677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:39.078677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:39.078677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:39.078677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:39.078677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:39.078677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:39.079720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:39.079720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:39.079720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:39.079720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:39.079720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:39.079720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:39.079720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:39.079720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 10 13:47:39.079720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 10 13:47:39.079720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:39.079720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:39.079720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:39.079720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:39.079720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:39.079720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:39.079720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 10 13:47:39.079720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 10 13:47:39.080951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 10 13:47:39.080951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 10 13:47:39.080951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 13:47:39.080951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 13:47:39.080951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 13:47:39.080951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:39.088065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 468/975] 10.222.0.49 () {60 vars in 1131 bytes} [Tue May 10 13:47:38 2022] POST /identity/v3/users => generated 160 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:39.089349 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b564c4-6f93-464c-9815-a12da2fdf7c0 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:39.114618 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5e335-0840-40cd-aad1-907fe153be14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:39.115806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5e335-0840-40cd-aad1-907fe153be14 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.116340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5e335-0840-40cd-aad1-907fe153be14 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.117003 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5e335-0840-40cd-aad1-907fe153be14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.127645 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5e335-0840-40cd-aad1-907fe153be14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:39.129374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5e335-0840-40cd-aad1-907fe153be14 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:39.147175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-97b5e335-0840-40cd-aad1-907fe153be14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:39.147175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:39.147175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:39.147175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:39.147175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:39.147175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:39.147175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:39.147175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:39.147175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:39.147175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:39.147175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:39.147175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:39.147175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:39.147175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:39.147175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:39.148134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:39.148134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:39.148134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:39.148134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:39.148134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:39.148134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:39.148134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:39.148134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:39.148134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:39.148134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:39.148134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:39.148134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:39.148134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:39.148134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:39.148134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:39.148134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:39.148134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:39.149113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:39.149113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:39.149113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:39.149113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:39.151298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 508/976] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:39.156769 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5e335-0840-40cd-aad1-907fe153be14 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:39.216767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b564c4-6f93-464c-9815-a12da2fdf7c0 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:39.260936 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37a9e9-d5c4-4c2f-82ca-66e6033b3af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:39.262675 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37a9e9-d5c4-4c2f-82ca-66e6033b3af8 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.263176 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37a9e9-d5c4-4c2f-82ca-66e6033b3af8 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.263651 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37a9e9-d5c4-4c2f-82ca-66e6033b3af8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.275963 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37a9e9-d5c4-4c2f-82ca-66e6033b3af8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:39.278695 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37a9e9-d5c4-4c2f-82ca-66e6033b3af8 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:39.283026 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5e335-0840-40cd-aad1-907fe153be14 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:39.298430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-7d37a9e9-d5c4-4c2f-82ca-66e6033b3af8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 13:47:39.298430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:39.298430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:39.298430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:39.298430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:39.298430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:39.298430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:39.298430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:39.298430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:39.298430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:39.298430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:39.298430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:39.298430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:39.298430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:39.298430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:39.298430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:39.299440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:39.300425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:39.300425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:39.300425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:39.300425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:39.300425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:39.300425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:39.300425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:39.300425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:39.300425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 13:47:39.300425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:39.306784 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 469/977] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:47:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:39.308875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37a9e9-d5c4-4c2f-82ca-66e6033b3af8 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:39.327105 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4d1fc-8263-4389-a546-0860c1dde680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:39.327739 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d1fc-8263-4389-a546-0860c1dde680 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.328016 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d1fc-8263-4389-a546-0860c1dde680 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.328326 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d1fc-8263-4389-a546-0860c1dde680 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.329114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4d1fc-8263-4389-a546-0860c1dde680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:39.329401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4d1fc-8263-4389-a546-0860c1dde680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:39.330829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4d1fc-8263-4389-a546-0860c1dde680 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:39.348461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 509/978] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:39.349388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4d1fc-8263-4389-a546-0860c1dde680 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:39.431488 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37a9e9-d5c4-4c2f-82ca-66e6033b3af8 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:39.450206 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4d1fc-8263-4389-a546-0860c1dde680 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:39.464153 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a7a35-48e7-4994-af7c-766b66f24446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:39.464865 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a7a35-48e7-4994-af7c-766b66f24446 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.465208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a7a35-48e7-4994-af7c-766b66f24446 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.465414 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a7a35-48e7-4994-af7c-766b66f24446 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.466208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a7a35-48e7-4994-af7c-766b66f24446 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:39.466507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a7a35-48e7-4994-af7c-766b66f24446 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:39.467920 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a7a35-48e7-4994-af7c-766b66f24446 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:39.483511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698c762-2f9b-4757-8fe5-5fe3de4860fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:39.484285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698c762-2f9b-4757-8fe5-5fe3de4860fb None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.484566 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698c762-2f9b-4757-8fe5-5fe3de4860fb None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.484837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698c762-2f9b-4757-8fe5-5fe3de4860fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.491350 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698c762-2f9b-4757-8fe5-5fe3de4860fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:39.492798 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698c762-2f9b-4757-8fe5-5fe3de4860fb None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:39.516282 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 470/979] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 13:47:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:39.516461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-9698c762-2f9b-4757-8fe5-5fe3de4860fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:39.516461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:39.516461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:39.516461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:39.516461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:39.516461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:39.516461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:39.516461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:39.516461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:39.516461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:39.516461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:39.516461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:39.516461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:39.516461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:39.516461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:39.517301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:39.517301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:39.517301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:39.517301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:39.517301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:39.517301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:39.517301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:39.517301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:39.517301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:39.517301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:39.517301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:39.517301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:39.517301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:39.517301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:39.517301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:39.517301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:39.517301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:39.518256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:39.518256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:39.518256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:39.518256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:39.518256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:39.518256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:39.518256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:39.518256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:39.518696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95702f-0d30-4b82-9f20-24b5128dcdf4 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.518696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95702f-0d30-4b82-9f20-24b5128dcdf4 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.518696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95702f-0d30-4b82-9f20-24b5128dcdf4 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.518876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 510/980] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:39.518952 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 471/981] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:39.519034 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698c762-2f9b-4757-8fe5-5fe3de4860fb None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:39.519104 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c8614-f01f-42ea-adf4-0cea7b3ea6c0 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.520372 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c8614-f01f-42ea-adf4-0cea7b3ea6c0 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.520372 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c8614-f01f-42ea-adf4-0cea7b3ea6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.540729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-1f4c8614-f01f-42ea-adf4-0cea7b3ea6c0 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:39.542365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-1f4c8614-f01f-42ea-adf4-0cea7b3ea6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:39.629989 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 472/982] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:39.631958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698c762-2f9b-4757-8fe5-5fe3de4860fb None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:39.657818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c8614-f01f-42ea-adf4-0cea7b3ea6c0 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:39.680216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb571477-3d67-4320-8dcb-ba4e32ba1ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:39.681170 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb571477-3d67-4320-8dcb-ba4e32ba1ffa None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.681598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb571477-3d67-4320-8dcb-ba4e32ba1ffa None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.682019 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb571477-3d67-4320-8dcb-ba4e32ba1ffa None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.682964 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb571477-3d67-4320-8dcb-ba4e32ba1ffa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:39.683449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb571477-3d67-4320-8dcb-ba4e32ba1ffa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:39.685189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb571477-3d67-4320-8dcb-ba4e32ba1ffa None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:39.698202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 511/983] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:39.708019 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb571477-3d67-4320-8dcb-ba4e32ba1ffa None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:39.782396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c8614-f01f-42ea-adf4-0cea7b3ea6c0 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:39.833993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb571477-3d67-4320-8dcb-ba4e32ba1ffa None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:39.834879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637717ac-cb41-43db-894d-1c617d1c24b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:39.835869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637717ac-cb41-43db-894d-1c617d1c24b0 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.836151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637717ac-cb41-43db-894d-1c617d1c24b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.836459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637717ac-cb41-43db-894d-1c617d1c24b0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.837125 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637717ac-cb41-43db-894d-1c617d1c24b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:39.838670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637717ac-cb41-43db-894d-1c617d1c24b0 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:39.852329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-637717ac-cb41-43db-894d-1c617d1c24b0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:47:39.852329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:39.852329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:39.852329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:39.852329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:39.852329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:39.852329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:39.852329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:39.852329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:47:39.852329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:39.852329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:39.852329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:39.852329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:39.852329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:39.852329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:39.852329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:39.852329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:39.853452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:39.853452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:39.853452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:39.853452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:39.853452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:39.853452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:39.853452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:39.853452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:39.853452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:39.853452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:39.853452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:39.853452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:39.853452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:39.853452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:39.853452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:39.853452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:39.855053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:39.855053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:39.855053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:39.855053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:39.855053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:39.855053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:39.855053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:39.855053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:39.855053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:39.855053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:39.855053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:39.855053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:39.855053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:47:39.855053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:39.855053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 473/984] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:39.860391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637717ac-cb41-43db-894d-1c617d1c24b0 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:39.875434 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56262fe-8184-4b3f-9c31-c5cf5b8503d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:39.876615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56262fe-8184-4b3f-9c31-c5cf5b8503d5 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.876924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56262fe-8184-4b3f-9c31-c5cf5b8503d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.877203 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56262fe-8184-4b3f-9c31-c5cf5b8503d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.878309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56262fe-8184-4b3f-9c31-c5cf5b8503d5 None admin] RBAC: Adding query filter params (role.id=76799389aacd44d5a8d92e1df6f89e12, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=df5dcdfb4eda417ebc0af2432497617d) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:39.878801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56262fe-8184-4b3f-9c31-c5cf5b8503d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:39.880611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56262fe-8184-4b3f-9c31-c5cf5b8503d5 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:39.888405 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 512/985] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:47:39 2022] GET /identity/v3/role_assignments?user.id=df5dcdfb4eda417ebc0af2432497617d&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=76799389aacd44d5a8d92e1df6f89e12 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:39.962843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637717ac-cb41-43db-894d-1c617d1c24b0 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:39.997673 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181f314-501b-4873-b716-12284ffb04d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:39.998345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181f314-501b-4873-b716-12284ffb04d4 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:39.998622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181f314-501b-4873-b716-12284ffb04d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:39.998981 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181f314-501b-4873-b716-12284ffb04d4 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:39.999588 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181f314-501b-4873-b716-12284ffb04d4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:39.999886 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181f314-501b-4873-b716-12284ffb04d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:40.001285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181f314-501b-4873-b716-12284ffb04d4 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:40.012754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 474/986] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 13:47:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:40.012980 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56262fe-8184-4b3f-9c31-c5cf5b8503d5 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:40.116304 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56262fe-8184-4b3f-9c31-c5cf5b8503d5 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:40.148000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a94d1-dca6-43dc-b505-93a9a632a3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:40.148679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a94d1-dca6-43dc-b505-93a9a632a3e4 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:40.148955 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a94d1-dca6-43dc-b505-93a9a632a3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:40.149219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a94d1-dca6-43dc-b505-93a9a632a3e4 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:40.149903 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a94d1-dca6-43dc-b505-93a9a632a3e4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:40.150199 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a94d1-dca6-43dc-b505-93a9a632a3e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:40.151514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a94d1-dca6-43dc-b505-93a9a632a3e4 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:40.156622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 513/987] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 13:47:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:40.162634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181f314-501b-4873-b716-12284ffb04d4 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:40.256605 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181f314-501b-4873-b716-12284ffb04d4 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:40.289705 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf55217-31e3-424a-abd6-a3e159b50dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:40.290357 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf55217-31e3-424a-abd6-a3e159b50dfa None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:40.290632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf55217-31e3-424a-abd6-a3e159b50dfa None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:40.290898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf55217-31e3-424a-abd6-a3e159b50dfa None admin] PATH_INFO: `/v3/endpoints` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:40.291676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf55217-31e3-424a-abd6-a3e159b50dfa None admin] RBAC: Adding query filter params (interface=public, service_id=6f93ccb5e0e24740a9f17f9e1b5d0c14, region_id=RegionOne) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:40.291978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf55217-31e3-424a-abd6-a3e159b50dfa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:40.293382 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf55217-31e3-424a-abd6-a3e159b50dfa None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:40.303478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 475/988] 10.222.0.49 () {56 vars in 1251 bytes} [Tue May 10 13:47:40 2022] GET /identity/v3/endpoints?service_id=6f93ccb5e0e24740a9f17f9e1b5d0c14&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:40.305210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a94d1-dca6-43dc-b505-93a9a632a3e4 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:40.407271 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a94d1-dca6-43dc-b505-93a9a632a3e4 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:40.440149 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6f2be-ff5f-44c6-b096-f483aeb8f1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:40.440836 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6f2be-ff5f-44c6-b096-f483aeb8f1d6 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:40.441110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6f2be-ff5f-44c6-b096-f483aeb8f1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:40.441378 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6f2be-ff5f-44c6-b096-f483aeb8f1d6 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:40.442043 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6f2be-ff5f-44c6-b096-f483aeb8f1d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:40.443364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6f2be-ff5f-44c6-b096-f483aeb8f1d6 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:40.456484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 514/989] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 13:47:40 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:47:40.875082 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8715fc0-ee4b-4e34-9f7c-051436ad2acf None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:40.875597 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8715fc0-ee4b-4e34-9f7c-051436ad2acf None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:40.875676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8715fc0-ee4b-4e34-9f7c-051436ad2acf None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:40.877138 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 476/990] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:40.886468 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b54adc-1de9-4253-a9e1-f9f3776eed13 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:40.886770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b54adc-1de9-4253-a9e1-f9f3776eed13 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:40.887053 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b54adc-1de9-4253-a9e1-f9f3776eed13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:40.904020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-87b54adc-1de9-4253-a9e1-f9f3776eed13 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:40.905479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-87b54adc-1de9-4253-a9e1-f9f3776eed13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:40.969328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 515/991] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:40.991803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8715fc0-ee4b-4e34-9f7c-051436ad2acf None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:41.091774 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8715fc0-ee4b-4e34-9f7c-051436ad2acf None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:41.124027 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24718b29-1b72-42a8-ac92-c23b55c7eb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:41.124847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24718b29-1b72-42a8-ac92-c23b55c7eb51 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:41.125179 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24718b29-1b72-42a8-ac92-c23b55c7eb51 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:41.125386 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24718b29-1b72-42a8-ac92-c23b55c7eb51 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:41.126032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24718b29-1b72-42a8-ac92-c23b55c7eb51 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:41.127448 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24718b29-1b72-42a8-ac92-c23b55c7eb51 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:41.139752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-24718b29-1b72-42a8-ac92-c23b55c7eb51 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:47:41.139752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:41.139752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:41.139752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:41.139752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:41.139752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:41.139752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:41.139752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:41.139752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:47:41.139752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:41.139752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:41.139752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:41.139752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:41.139752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:41.139752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:41.139752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:41.139752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:41.141014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:41.141014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:41.141014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:41.141014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:41.141014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:41.141014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:41.141014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:41.141014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:41.141014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:41.141014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:41.141014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:41.141014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:41.141014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:41.141014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:41.141014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:41.141014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:41.141912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:41.141912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:41.141912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:41.141912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:41.141912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:41.141912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:41.141912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:41.141912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:41.141912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:41.141912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:41.141912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:41.141912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:41.141912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:47:41.141912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:41.141912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 477/992] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 13:47:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:41.148222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b54adc-1de9-4253-a9e1-f9f3776eed13 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:41.241272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b54adc-1de9-4253-a9e1-f9f3776eed13 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:41.273682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fa929-0532-4b0d-a35f-148f6e0c900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:41.274344 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fa929-0532-4b0d-a35f-148f6e0c900b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:41.274624 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fa929-0532-4b0d-a35f-148f6e0c900b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:41.274895 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fa929-0532-4b0d-a35f-148f6e0c900b None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:41.275593 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fa929-0532-4b0d-a35f-148f6e0c900b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:41.275893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fa929-0532-4b0d-a35f-148f6e0c900b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:41.277284 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fa929-0532-4b0d-a35f-148f6e0c900b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:41.287514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 516/993] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 13:47:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:41.288479 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24718b29-1b72-42a8-ac92-c23b55c7eb51 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:41.388040 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24718b29-1b72-42a8-ac92-c23b55c7eb51 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:41.424514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a35faf-7bde-4bd7-8691-43c1a83b93e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:41.425164 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a35faf-7bde-4bd7-8691-43c1a83b93e0 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:41.425444 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a35faf-7bde-4bd7-8691-43c1a83b93e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:41.426270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a35faf-7bde-4bd7-8691-43c1a83b93e0 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:41.426966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a35faf-7bde-4bd7-8691-43c1a83b93e0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:41.427274 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a35faf-7bde-4bd7-8691-43c1a83b93e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:41.428648 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a35faf-7bde-4bd7-8691-43c1a83b93e0 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:41.433427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 478/994] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 13:47:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:41.439035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fa929-0532-4b0d-a35f-148f6e0c900b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:41.533581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fa929-0532-4b0d-a35f-148f6e0c900b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:41.567676 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6a381-8af7-41de-b65a-f71c2ad244b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:41.568372 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a381-8af7-41de-b65a-f71c2ad244b4 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:41.568656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a381-8af7-41de-b65a-f71c2ad244b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:41.568930 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a381-8af7-41de-b65a-f71c2ad244b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:41.569730 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6a381-8af7-41de-b65a-f71c2ad244b4 None admin] RBAC: Adding query filter params (interface=admin, service_id=b46c01a1d245421bb8537101c837872b, region_id=RegionOne) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:41.570041 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6a381-8af7-41de-b65a-f71c2ad244b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:41.571396 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6a381-8af7-41de-b65a-f71c2ad244b4 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:41.581291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 517/995] 10.222.0.49 () {56 vars in 1249 bytes} [Tue May 10 13:47:41 2022] GET /identity/v3/endpoints?service_id=b46c01a1d245421bb8537101c837872b&interface=admin®ion_id=RegionOne => generated 193 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:41.583313 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a35faf-7bde-4bd7-8691-43c1a83b93e0 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:41.681506 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a35faf-7bde-4bd7-8691-43c1a83b93e0 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:41.713839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e0de3-0c61-4a96-a4c1-6f744302dd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:41.714499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e0de3-0c61-4a96-a4c1-6f744302dd76 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:41.714779 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e0de3-0c61-4a96-a4c1-6f744302dd76 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:41.715053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e0de3-0c61-4a96-a4c1-6f744302dd76 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:41.715723 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e0de3-0c61-4a96-a4c1-6f744302dd76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:41.717110 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e0de3-0c61-4a96-a4c1-6f744302dd76 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:41.724097 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 479/996] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 13:47:41 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:47:42.149222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dd3e9-2879-43e9-a5b2-76f499a2e879 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:42.149735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dd3e9-2879-43e9-a5b2-76f499a2e879 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:42.149815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dd3e9-2879-43e9-a5b2-76f499a2e879 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:42.151288 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 518/997] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:42.156533 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779511c1-3b0e-4a6a-92e1-e240628840d4 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:42.156923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779511c1-3b0e-4a6a-92e1-e240628840d4 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:42.157103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779511c1-3b0e-4a6a-92e1-e240628840d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:42.173842 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-779511c1-3b0e-4a6a-92e1-e240628840d4 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:42.175002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-779511c1-3b0e-4a6a-92e1-e240628840d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:42.240484 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 480/998] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:42.261831 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dd3e9-2879-43e9-a5b2-76f499a2e879 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:42.359781 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dd3e9-2879-43e9-a5b2-76f499a2e879 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:42.397282 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f8505-f8b0-4db0-9329-fa67198826cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:42.398088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f8505-f8b0-4db0-9329-fa67198826cc None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:42.398363 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f8505-f8b0-4db0-9329-fa67198826cc None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:42.398633 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f8505-f8b0-4db0-9329-fa67198826cc None admin] PATH_INFO: `/v3/services/image` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:42.399330 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f8505-f8b0-4db0-9329-fa67198826cc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:42.400657 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f8505-f8b0-4db0-9329-fa67198826cc None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:42.413073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-431f8505-f8b0-4db0-9329-fa67198826cc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:47:42.413073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:42.413073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:42.413073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:42.413073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:42.413073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:42.413073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:42.413073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:42.413073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:47:42.413073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:42.413073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:42.413073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:42.413073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:42.413073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:42.413073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:42.413073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:42.413073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:42.414088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:42.414088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:42.414088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:42.414088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:42.414088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:42.414088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:42.414088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:42.414088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:42.414088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:42.414088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:42.414088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:42.414088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:42.414088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:42.414088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:42.414088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:42.414088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:42.415067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:42.415067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:42.415067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:42.415067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:42.415067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:42.415067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:42.415067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:42.415067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:42.415067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:42.415067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:42.415067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:42.415067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:42.415067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:47:42.415067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:42.416684 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 519/999] 10.222.0.49 () {56 vars in 1105 bytes} [Tue May 10 13:47:42 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:42.420282 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779511c1-3b0e-4a6a-92e1-e240628840d4 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:42.520589 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779511c1-3b0e-4a6a-92e1-e240628840d4 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:42.554601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b621d96-b95b-4227-997f-55587b83ef4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:42.555263 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b621d96-b95b-4227-997f-55587b83ef4a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:42.555546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b621d96-b95b-4227-997f-55587b83ef4a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:42.555821 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b621d96-b95b-4227-997f-55587b83ef4a None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:42.556624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b621d96-b95b-4227-997f-55587b83ef4a None admin] RBAC: Adding query filter params (name=image) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:42.556930 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b621d96-b95b-4227-997f-55587b83ef4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:42.558291 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b621d96-b95b-4227-997f-55587b83ef4a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:42.567895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 481/1000] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:42.569067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f8505-f8b0-4db0-9329-fa67198826cc None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:42.668727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f8505-f8b0-4db0-9329-fa67198826cc None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:42.685626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b2099-6eaa-473d-a113-1d4361859ff4 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:42.685915 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b2099-6eaa-473d-a113-1d4361859ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:42.686190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b2099-6eaa-473d-a113-1d4361859ff4 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:42.687688 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 482/1001] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:42.692917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11675e36-37cf-44ec-b754-e5322ae13135 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:42.693202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11675e36-37cf-44ec-b754-e5322ae13135 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:42.693480 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11675e36-37cf-44ec-b754-e5322ae13135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:42.702559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830f586-a7e4-4093-b288-10084b1f2408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:42.703461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830f586-a7e4-4093-b288-10084b1f2408 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:42.703930 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830f586-a7e4-4093-b288-10084b1f2408 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:42.704234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830f586-a7e4-4093-b288-10084b1f2408 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:42.704940 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830f586-a7e4-4093-b288-10084b1f2408 None admin] RBAC: Adding query filter params (type=image) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:42.705245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830f586-a7e4-4093-b288-10084b1f2408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:42.706714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830f586-a7e4-4093-b288-10084b1f2408 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:42.709590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-11675e36-37cf-44ec-b754-e5322ae13135 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:42.710756 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-11675e36-37cf-44ec-b754-e5322ae13135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:42.720241 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 520/1002] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:42.784554 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 483/1003] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:47:42.805421 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830f586-a7e4-4093-b288-10084b1f2408 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:42.911080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830f586-a7e4-4093-b288-10084b1f2408 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:42.943817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6fb53-4502-489c-80e7-634e1dcd4cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:42.944618 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6fb53-4502-489c-80e7-634e1dcd4cdb None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:42.944910 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6fb53-4502-489c-80e7-634e1dcd4cdb None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:42.945170 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6fb53-4502-489c-80e7-634e1dcd4cdb None admin] PATH_INFO: `/v3/services/compute` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:42.945814 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6fb53-4502-489c-80e7-634e1dcd4cdb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:42.947159 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6fb53-4502-489c-80e7-634e1dcd4cdb None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:42.958911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-58c6fb53-4502-489c-80e7-634e1dcd4cdb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:47:42.958911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:42.958911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:42.958911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:42.958911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:42.958911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:42.958911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:42.958911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:42.958911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:47:42.958911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:42.958911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:42.958911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:42.958911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:42.958911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:42.958911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:42.958911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:42.958911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:42.960141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:42.960141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:42.960141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:42.960141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:42.960141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:42.960141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:42.960141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:42.960141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:42.960141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:42.960141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:42.960141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:42.960141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:42.960141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:42.960141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:42.960141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:42.960141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:42.961045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:42.961045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:42.961045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:42.961045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:42.961045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:42.961045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:42.961045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:42.961045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:42.961045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:42.961045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:42.961045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:42.961045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:42.961045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 13:47:42.961045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:42.961045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 521/1004] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:42.966597 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11675e36-37cf-44ec-b754-e5322ae13135 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:43.064818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11675e36-37cf-44ec-b754-e5322ae13135 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:43.098471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df870641-26ae-436c-8d3b-647c8894dae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:43.099137 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df870641-26ae-436c-8d3b-647c8894dae4 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:43.099417 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df870641-26ae-436c-8d3b-647c8894dae4 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:43.099689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df870641-26ae-436c-8d3b-647c8894dae4 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:43.100424 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df870641-26ae-436c-8d3b-647c8894dae4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:43.100729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df870641-26ae-436c-8d3b-647c8894dae4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:43.102080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df870641-26ae-436c-8d3b-647c8894dae4 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:43.108117 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 484/1005] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 13:47:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:43.112640 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6fb53-4502-489c-80e7-634e1dcd4cdb None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:43.208158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6fb53-4502-489c-80e7-634e1dcd4cdb None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:43.240142 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16426e22-ebce-41f8-a9a4-22c1f55e9320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:43.240823 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16426e22-ebce-41f8-a9a4-22c1f55e9320 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:43.241092 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16426e22-ebce-41f8-a9a4-22c1f55e9320 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:43.241363 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16426e22-ebce-41f8-a9a4-22c1f55e9320 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:43.242054 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16426e22-ebce-41f8-a9a4-22c1f55e9320 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:43.242372 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16426e22-ebce-41f8-a9a4-22c1f55e9320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:43.243688 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16426e22-ebce-41f8-a9a4-22c1f55e9320 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:43.248514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 522/1006] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 13:47:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:43.255052 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df870641-26ae-436c-8d3b-647c8894dae4 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:43.348977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df870641-26ae-436c-8d3b-647c8894dae4 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:43.386446 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b458a-a3f9-4ece-b10b-b26b7c8c5e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:43.387114 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b458a-a3f9-4ece-b10b-b26b7c8c5e5a None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:43.387397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b458a-a3f9-4ece-b10b-b26b7c8c5e5a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:43.387673 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b458a-a3f9-4ece-b10b-b26b7c8c5e5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:43.388445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b458a-a3f9-4ece-b10b-b26b7c8c5e5a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:43.390820 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b458a-a3f9-4ece-b10b-b26b7c8c5e5a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:43.416199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 485/1007] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 13:47:43 2022] POST /identity/v3/endpoints => generated 334 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:47:43.948689 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc678f4-7fb5-46a1-816d-33609b1f8309 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:43.949116 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc678f4-7fb5-46a1-816d-33609b1f8309 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:43.949223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc678f4-7fb5-46a1-816d-33609b1f8309 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:43.950627 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 523/1008] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:43.955812 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53220d21-a91f-4f56-b0c7-92d0b143f7e8 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:43.956102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53220d21-a91f-4f56-b0c7-92d0b143f7e8 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:43.956407 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53220d21-a91f-4f56-b0c7-92d0b143f7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:43.973703 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-53220d21-a91f-4f56-b0c7-92d0b143f7e8 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:43.974862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-53220d21-a91f-4f56-b0c7-92d0b143f7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:44.046603 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 486/1009] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:43 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:44.068443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc678f4-7fb5-46a1-816d-33609b1f8309 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:44.164631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc678f4-7fb5-46a1-816d-33609b1f8309 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:44.195492 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e74ed-3157-4704-a1e1-f6081eb2cf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:44.196314 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e74ed-3157-4704-a1e1-f6081eb2cf98 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:44.196592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e74ed-3157-4704-a1e1-f6081eb2cf98 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:44.196860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e74ed-3157-4704-a1e1-f6081eb2cf98 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:44.197498 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e74ed-3157-4704-a1e1-f6081eb2cf98 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:44.198880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e74ed-3157-4704-a1e1-f6081eb2cf98 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:44.211029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-d39e74ed-3157-4704-a1e1-f6081eb2cf98 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:47:44.211029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:44.211029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:44.211029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:44.211029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:44.211029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:44.211029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:44.211029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:44.211029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:47:44.211029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:44.211029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:44.211029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:44.211029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:44.211029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:44.211029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:44.211029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:44.211029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:44.212901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:44.212901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:44.212901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:44.212901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:44.212901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:44.212901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:44.212901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:44.212901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:44.212901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:44.212901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:44.212901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:44.212901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:44.212901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:44.212901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:44.212901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:44.212901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:44.213997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:44.213997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:44.213997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:44.213997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:44.213997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:44.213997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:44.213997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:44.213997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:44.213997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:44.213997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:44.213997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:44.213997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:44.213997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 13:47:44.213997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:44.216518 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 524/1010] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 13:47:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:44.218149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53220d21-a91f-4f56-b0c7-92d0b143f7e8 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:44.312292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53220d21-a91f-4f56-b0c7-92d0b143f7e8 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:44.345205 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bb03b-4b70-421e-b934-8f30ffe6a8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:44.345867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bb03b-4b70-421e-b934-8f30ffe6a8fb None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:44.346148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bb03b-4b70-421e-b934-8f30ffe6a8fb None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:44.346419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bb03b-4b70-421e-b934-8f30ffe6a8fb None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:44.347112 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bb03b-4b70-421e-b934-8f30ffe6a8fb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:44.347443 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bb03b-4b70-421e-b934-8f30ffe6a8fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:44.348824 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bb03b-4b70-421e-b934-8f30ffe6a8fb None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:44.358358 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 487/1011] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 13:47:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:44.359876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e74ed-3157-4704-a1e1-f6081eb2cf98 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:44.456131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e74ed-3157-4704-a1e1-f6081eb2cf98 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:44.487702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e74d11-ebe4-44d4-8902-adb72e199685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:44.488418 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e74d11-ebe4-44d4-8902-adb72e199685 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:44.488697 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e74d11-ebe4-44d4-8902-adb72e199685 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:44.488970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e74d11-ebe4-44d4-8902-adb72e199685 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:44.489663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e74d11-ebe4-44d4-8902-adb72e199685 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:44.489962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e74d11-ebe4-44d4-8902-adb72e199685 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:44.491298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e74d11-ebe4-44d4-8902-adb72e199685 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:44.500522 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 525/1012] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 13:47:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:44.502150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bb03b-4b70-421e-b934-8f30ffe6a8fb None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:44.599913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bb03b-4b70-421e-b934-8f30ffe6a8fb None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:44.635539 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1b392-d8f4-4b15-a47c-33d11a3587fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:44.636263 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1b392-d8f4-4b15-a47c-33d11a3587fe None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:44.636552 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1b392-d8f4-4b15-a47c-33d11a3587fe None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:44.636830 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1b392-d8f4-4b15-a47c-33d11a3587fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:44.637596 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1b392-d8f4-4b15-a47c-33d11a3587fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:44.639053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1b392-d8f4-4b15-a47c-33d11a3587fe None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:44.668411 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 488/1013] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 13:47:44 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:47:44.933722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b93360-d2f4-4951-954d-a05e6f84836a None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:44.934093 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b93360-d2f4-4951-954d-a05e6f84836a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:44.934293 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b93360-d2f4-4951-954d-a05e6f84836a None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:44.935767 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 526/1014] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:44.940766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ffddc-8686-4959-adcb-6537bb6b8a7a None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:44.941063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ffddc-8686-4959-adcb-6537bb6b8a7a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:44.941854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ffddc-8686-4959-adcb-6537bb6b8a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:44.957892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-993ffddc-8686-4959-adcb-6537bb6b8a7a None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:44.959042 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-993ffddc-8686-4959-adcb-6537bb6b8a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:45.031648 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 489/1015] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:44 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:45.054314 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b93360-d2f4-4951-954d-a05e6f84836a None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:45.150470 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b93360-d2f4-4951-954d-a05e6f84836a None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:45.183206 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eabf1d-7dd7-488f-9244-01f8682bf329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:45.183922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eabf1d-7dd7-488f-9244-01f8682bf329 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:45.184142 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eabf1d-7dd7-488f-9244-01f8682bf329 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:45.184437 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eabf1d-7dd7-488f-9244-01f8682bf329 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:45.185151 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eabf1d-7dd7-488f-9244-01f8682bf329 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:45.186479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eabf1d-7dd7-488f-9244-01f8682bf329 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:45.200298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 527/1016] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 13:47:45 2022] POST /identity/v3/services => generated 242 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:45.775757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d8e4f-66d7-4e81-852b-6f568457f075 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:45.776311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d8e4f-66d7-4e81-852b-6f568457f075 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:45.776311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d8e4f-66d7-4e81-852b-6f568457f075 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:45.777826 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 490/1017] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:45.783073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7b350-3bfd-4482-8153-a9cc13b8023b None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:45.783478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7b350-3bfd-4482-8153-a9cc13b8023b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:45.783666 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7b350-3bfd-4482-8153-a9cc13b8023b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:45.800812 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-c8e7b350-3bfd-4482-8153-a9cc13b8023b None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:45.801952 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c8e7b350-3bfd-4482-8153-a9cc13b8023b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:45.873213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 528/1018] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:45.896730 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d8e4f-66d7-4e81-852b-6f568457f075 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:45.994238 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d8e4f-66d7-4e81-852b-6f568457f075 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:46.027149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da83d72-a464-4711-b67b-63a4c79f6328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:46.027870 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da83d72-a464-4711-b67b-63a4c79f6328 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.028145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da83d72-a464-4711-b67b-63a4c79f6328 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.028437 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da83d72-a464-4711-b67b-63a4c79f6328 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.038469 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da83d72-a464-4711-b67b-63a4c79f6328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:46.046542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-9da83d72-a464-4711-b67b-63a4c79f6328 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:47:46.046542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:46.046542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:46.046542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:46.046542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:46.046542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:46.046542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:46.046542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:46.046542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:46.046542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:46.046542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:46.046542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:46.046542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:46.046542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:46.046542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:46.046542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:46.047516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:46.047516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:46.047516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:46.047516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:46.047516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:46.047516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:46.047516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:46.047516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:46.047516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:46.047516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:46.047516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:46.047516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:46.047516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:46.047516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:46.047516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:46.047516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:46.048438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:46.048438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:46.048438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:46.048438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:46.048438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:46.048438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:46.048438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:46.048438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:46.048438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:46.048438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:46.048438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:47:46.048438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:46.052495 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 491/1019] 10.222.0.49 () {56 vars in 1120 bytes} [Tue May 10 13:47:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:46.053656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7b350-3bfd-4482-8153-a9cc13b8023b None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:46.146756 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7b350-3bfd-4482-8153-a9cc13b8023b None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:46.179805 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d1838-4710-44b5-bb8f-54348f1362b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:46.180759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1838-4710-44b5-bb8f-54348f1362b0 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.181293 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1838-4710-44b5-bb8f-54348f1362b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.181771 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1838-4710-44b5-bb8f-54348f1362b0 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.182708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d1838-4710-44b5-bb8f-54348f1362b0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:46.183214 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d1838-4710-44b5-bb8f-54348f1362b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:46.184784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d1838-4710-44b5-bb8f-54348f1362b0 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:46.193163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 529/1020] 10.222.0.49 () {56 vars in 1115 bytes} [Tue May 10 13:47:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:46.198660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da83d72-a464-4711-b67b-63a4c79f6328 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:46.293177 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da83d72-a464-4711-b67b-63a4c79f6328 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:46.326763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0596c-ac0e-4256-a59b-d4b91dffd066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:46.327672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0596c-ac0e-4256-a59b-d4b91dffd066 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.327959 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0596c-ac0e-4256-a59b-d4b91dffd066 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.328259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0596c-ac0e-4256-a59b-d4b91dffd066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.339796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0596c-ac0e-4256-a59b-d4b91dffd066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:46.341401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0596c-ac0e-4256-a59b-d4b91dffd066 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:46.359384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-44a0596c-ac0e-4256-a59b-d4b91dffd066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:46.359384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:46.359384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:46.359384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:46.359384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:46.359384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:46.359384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:46.359384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:46.359384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:46.359384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:46.359384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:46.359384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:46.359384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:46.359384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:46.359384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:46.360402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:46.360402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:46.360402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:46.360402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:46.360402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:46.360402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:46.360402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:46.360402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:46.360402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:46.360402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:46.360402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:46.360402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:46.360402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:46.360402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:46.360402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:46.360402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:46.360402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:46.365055 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:46.365055 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:46.365055 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:46.365055 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:46.365055 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 492/1021] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:46.368453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d1838-4710-44b5-bb8f-54348f1362b0 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:46.465091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d1838-4710-44b5-bb8f-54348f1362b0 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:46.497450 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b94e81-6b9a-471f-a86a-f5437ae22b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:46.498106 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b94e81-6b9a-471f-a86a-f5437ae22b47 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.498377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b94e81-6b9a-471f-a86a-f5437ae22b47 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.498642 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b94e81-6b9a-471f-a86a-f5437ae22b47 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.499349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b94e81-6b9a-471f-a86a-f5437ae22b47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:46.499643 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b94e81-6b9a-471f-a86a-f5437ae22b47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:46.501003 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b94e81-6b9a-471f-a86a-f5437ae22b47 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:46.516862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 530/1022] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:46.518141 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0596c-ac0e-4256-a59b-d4b91dffd066 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:46.617763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0596c-ac0e-4256-a59b-d4b91dffd066 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:46.649630 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7accd4-049f-44b1-947d-b7136e75fde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:46.650425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7accd4-049f-44b1-947d-b7136e75fde8 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.650707 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7accd4-049f-44b1-947d-b7136e75fde8 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.650982 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7accd4-049f-44b1-947d-b7136e75fde8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.658687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7accd4-049f-44b1-947d-b7136e75fde8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:46.660687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7accd4-049f-44b1-947d-b7136e75fde8 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:46.674511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-9d7accd4-049f-44b1-947d-b7136e75fde8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:47:46.674511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:46.674511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:46.674511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:46.674511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:46.674511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:46.674511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:46.674511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:46.674511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:46.674511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:46.674511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:46.674511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:46.674511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:46.674511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:46.674511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:46.674511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:46.676144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:46.677186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:46.677186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:46.677186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:46.677186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:46.677186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:46.677186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:46.677186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:46.677186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:46.677186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:47:46.677186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:46.680511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 493/1023] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 13:47:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:46.681976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b94e81-6b9a-471f-a86a-f5437ae22b47 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:46.780114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b94e81-6b9a-471f-a86a-f5437ae22b47 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:46.813072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07507022-d433-41fa-a91a-b8b0a2b79406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:46.813819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507022-d433-41fa-a91a-b8b0a2b79406 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.814063 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507022-d433-41fa-a91a-b8b0a2b79406 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.814272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507022-d433-41fa-a91a-b8b0a2b79406 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.815090 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07507022-d433-41fa-a91a-b8b0a2b79406 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:46.815397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07507022-d433-41fa-a91a-b8b0a2b79406 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:46.816842 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07507022-d433-41fa-a91a-b8b0a2b79406 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:46.838433 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 531/1024] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 13:47:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:46.839838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7accd4-049f-44b1-947d-b7136e75fde8 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:46.936236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7accd4-049f-44b1-947d-b7136e75fde8 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:46.938580 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d29f3d-a949-40a8-8068-250c142d86b0 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.939094 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d29f3d-a949-40a8-8068-250c142d86b0 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.939380 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d29f3d-a949-40a8-8068-250c142d86b0 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.940828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 532/1025] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:46.946229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14f564-11b3-47f8-9928-b40649b60089 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.946513 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14f564-11b3-47f8-9928-b40649b60089 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.946792 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14f564-11b3-47f8-9928-b40649b60089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:46.963686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-3e14f564-11b3-47f8-9928-b40649b60089 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:46.964891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-3e14f564-11b3-47f8-9928-b40649b60089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:46.971661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68300b-0f34-4969-89d6-def9667c59a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:46.972884 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68300b-0f34-4969-89d6-def9667c59a6 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:46.973176 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68300b-0f34-4969-89d6-def9667c59a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:46.973450 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68300b-0f34-4969-89d6-def9667c59a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:47.030686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 533/1026] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:47.038310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68300b-0f34-4969-89d6-def9667c59a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:47.039734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68300b-0f34-4969-89d6-def9667c59a6 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:47.054404 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14f564-11b3-47f8-9928-b40649b60089 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:47.136081 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 494/1027] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:47:46 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:47:47.141670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68300b-0f34-4969-89d6-def9667c59a6 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:47.148018 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14f564-11b3-47f8-9928-b40649b60089 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:47.184120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b51a1-20ca-421b-96ca-719526ad0449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:47.184934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b51a1-20ca-421b-96ca-719526ad0449 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:47.185206 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b51a1-20ca-421b-96ca-719526ad0449 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:47.185476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b51a1-20ca-421b-96ca-719526ad0449 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:47.186677 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b51a1-20ca-421b-96ca-719526ad0449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:47.188026 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b51a1-20ca-421b-96ca-719526ad0449 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:47.189820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 534/1028] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:47.195674 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b51a1-20ca-421b-96ca-719526ad0449 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:47.243432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68300b-0f34-4969-89d6-def9667c59a6 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:47.278604 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af387fb0-a575-4b26-a1ed-fc6ddaa17e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:47.279404 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af387fb0-a575-4b26-a1ed-fc6ddaa17e61 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:47.279680 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af387fb0-a575-4b26-a1ed-fc6ddaa17e61 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:47.280242 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af387fb0-a575-4b26-a1ed-fc6ddaa17e61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:47.291706 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af387fb0-a575-4b26-a1ed-fc6ddaa17e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:47.293186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af387fb0-a575-4b26-a1ed-fc6ddaa17e61 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:47.309053 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b51a1-20ca-421b-96ca-719526ad0449 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:47.310912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-af387fb0-a575-4b26-a1ed-fc6ddaa17e61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:47.310912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:47.310912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:47.310912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:47.310912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:47.310912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:47.310912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:47.310912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:47.310912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:47.310912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:47.310912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:47.310912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:47.310912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:47.310912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:47.310912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:47.311934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:47.311934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:47.311934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:47.311934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:47.311934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:47.311934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:47.311934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:47.311934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:47.311934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:47.311934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:47.311934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:47.311934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:47.311934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:47.311934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:47.311934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:47.311934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:47.311934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:47.313393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:47.313393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:47.313393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:47.313393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:47.313393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 495/1029] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:47.317594 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af387fb0-a575-4b26-a1ed-fc6ddaa17e61 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:47.345976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012e8ef-734d-4648-9771-f94597e49e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:47.346641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e8ef-734d-4648-9771-f94597e49e34 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:47.346972 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e8ef-734d-4648-9771-f94597e49e34 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:47.347802 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e8ef-734d-4648-9771-f94597e49e34 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:47.348530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012e8ef-734d-4648-9771-f94597e49e34 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:47.349933 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012e8ef-734d-4648-9771-f94597e49e34 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:47.380302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 535/1030] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 13:47:47 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:47:47.425311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af387fb0-a575-4b26-a1ed-fc6ddaa17e61 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:47.453439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d2e61-cece-49e2-b5f7-f5224d6f28e0 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:47.453616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d2e61-cece-49e2-b5f7-f5224d6f28e0 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:47.453902 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d2e61-cece-49e2-b5f7-f5224d6f28e0 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:47.455485 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 536/1031] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:47.461253 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a0398-cd7e-401b-94e6-8b5bd45e5ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:47.461703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6513d-0a41-4ee0-a942-3926eba830e2 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:47.461909 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a0398-cd7e-401b-94e6-8b5bd45e5ef1 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:47.462026 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6513d-0a41-4ee0-a942-3926eba830e2 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:47.462214 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a0398-cd7e-401b-94e6-8b5bd45e5ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:47.462312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6513d-0a41-4ee0-a942-3926eba830e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:47.462456 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a0398-cd7e-401b-94e6-8b5bd45e5ef1 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:47.463162 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a0398-cd7e-401b-94e6-8b5bd45e5ef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:47.463459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a0398-cd7e-401b-94e6-8b5bd45e5ef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:47.464869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a0398-cd7e-401b-94e6-8b5bd45e5ef1 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:47.482279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 496/1032] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:47.482482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-27c6513d-0a41-4ee0-a942-3926eba830e2 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:47.482482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-27c6513d-0a41-4ee0-a942-3926eba830e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:47.483903 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a0398-cd7e-401b-94e6-8b5bd45e5ef1 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:47.550258 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 537/1033] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:47:47.572727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6513d-0a41-4ee0-a942-3926eba830e2 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:47.584235 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a0398-cd7e-401b-94e6-8b5bd45e5ef1 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:47.618855 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd0ffa-45ca-4d0b-ba8b-ea6fd6205e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:47.619891 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd0ffa-45ca-4d0b-ba8b-ea6fd6205e62 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:47.620415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd0ffa-45ca-4d0b-ba8b-ea6fd6205e62 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:47.620838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd0ffa-45ca-4d0b-ba8b-ea6fd6205e62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:47.627803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd0ffa-45ca-4d0b-ba8b-ea6fd6205e62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:47.629484 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd0ffa-45ca-4d0b-ba8b-ea6fd6205e62 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:47.643721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-47cd0ffa-45ca-4d0b-ba8b-ea6fd6205e62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:47.643721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:47.643721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:47.643721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:47.643721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:47.643721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:47.643721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:47.643721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:47.643721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:47.643721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:47.643721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:47.643721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:47.643721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:47.643721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:47.643721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:47.645445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:47.645445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:47.645445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:47.645445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:47.645445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:47.645445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:47.645445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:47.645445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:47.645445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:47.645445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:47.645445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:47.645445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:47.645445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:47.645445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:47.645445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:47.645445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:47.645445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:47.646610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:47.646610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:47.646610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:47.646610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:47.646610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:47.646610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:47.646610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:47.646610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:47.648482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 497/1034] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:47.654058 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd0ffa-45ca-4d0b-ba8b-ea6fd6205e62 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:47.675594 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6513d-0a41-4ee0-a942-3926eba830e2 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:47.709798 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45f61e-06b0-428a-bc80-1bf30a5012e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:47.710503 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45f61e-06b0-428a-bc80-1bf30a5012e8 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:47.710782 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45f61e-06b0-428a-bc80-1bf30a5012e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:47.711054 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45f61e-06b0-428a-bc80-1bf30a5012e8 None admin] PATH_INFO: `/v3/services/image` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:47.711727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45f61e-06b0-428a-bc80-1bf30a5012e8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:47.713327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45f61e-06b0-428a-bc80-1bf30a5012e8 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:47.725317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-8d45f61e-06b0-428a-bc80-1bf30a5012e8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:47:47.725317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:47.725317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:47.725317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:47.725317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:47.725317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:47.725317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:47.725317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:47.725317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:47:47.725317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:47.725317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:47.725317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:47.725317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:47.725317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:47.725317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:47.725317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:47.725317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:47.726656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:47.726656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:47.726656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:47.726656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:47.726656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:47.726656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:47.726656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:47.726656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:47.726656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:47.726656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:47.726656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:47.726656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:47.726656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:47.726656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:47.726656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:47.726656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:47.727715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:47.727715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:47.727715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:47.727715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:47.727715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:47.727715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:47.727715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:47.727715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:47.727715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:47.727715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:47.727715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:47.727715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:47.727715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:47:47.727715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:47.731474 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 538/1035] 10.222.0.49 () {56 vars in 1105 bytes} [Tue May 10 13:47:47 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:47.732552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45f61e-06b0-428a-bc80-1bf30a5012e8 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:47.764799 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd0ffa-45ca-4d0b-ba8b-ea6fd6205e62 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:47.799934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074bf5a-bf32-4684-9e66-8f592301b026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:47.800628 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074bf5a-bf32-4684-9e66-8f592301b026 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:47.800908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074bf5a-bf32-4684-9e66-8f592301b026 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:47.801183 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074bf5a-bf32-4684-9e66-8f592301b026 None admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:47.801966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074bf5a-bf32-4684-9e66-8f592301b026 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:47.802272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074bf5a-bf32-4684-9e66-8f592301b026 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:47.803692 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074bf5a-bf32-4684-9e66-8f592301b026 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:47.822517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 498/1036] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:47.823979 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074bf5a-bf32-4684-9e66-8f592301b026 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:47.831326 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45f61e-06b0-428a-bc80-1bf30a5012e8 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:47.865436 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee19e44-9ada-443e-bf33-dfe8ceb53c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:47.866104 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee19e44-9ada-443e-bf33-dfe8ceb53c88 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:47.866383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee19e44-9ada-443e-bf33-dfe8ceb53c88 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:47.866652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee19e44-9ada-443e-bf33-dfe8ceb53c88 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:47.867350 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee19e44-9ada-443e-bf33-dfe8ceb53c88 None admin] RBAC: Adding query filter params (name=image) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:47.867652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee19e44-9ada-443e-bf33-dfe8ceb53c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:47.869028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee19e44-9ada-443e-bf33-dfe8ceb53c88 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:47.878995 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 539/1037] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:47.880662 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee19e44-9ada-443e-bf33-dfe8ceb53c88 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:47.922672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074bf5a-bf32-4684-9e66-8f592301b026 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:47.955388 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c545f4-18fc-4292-b359-62bf2fa4418a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:47.956043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c545f4-18fc-4292-b359-62bf2fa4418a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:47.956351 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c545f4-18fc-4292-b359-62bf2fa4418a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:47.957210 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c545f4-18fc-4292-b359-62bf2fa4418a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:47.958032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c545f4-18fc-4292-b359-62bf2fa4418a None admin] RBAC: Adding query filter params (role.id=76799389aacd44d5a8d92e1df6f89e12, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=975f10f781b94bdaa8edee39a2b1bba4) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:47.958338 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c545f4-18fc-4292-b359-62bf2fa4418a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:47.959747 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c545f4-18fc-4292-b359-62bf2fa4418a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:47.965316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 499/1038] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:47:47 2022] GET /identity/v3/role_assignments?user.id=975f10f781b94bdaa8edee39a2b1bba4&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=76799389aacd44d5a8d92e1df6f89e12 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:47.978129 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee19e44-9ada-443e-bf33-dfe8ceb53c88 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:48.013943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471589e-d4ee-4732-af86-dc92807a01a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:48.014615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471589e-d4ee-4732-af86-dc92807a01a4 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:48.014891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471589e-d4ee-4732-af86-dc92807a01a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:48.015160 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471589e-d4ee-4732-af86-dc92807a01a4 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:48.015863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471589e-d4ee-4732-af86-dc92807a01a4 None admin] RBAC: Adding query filter params (type=image) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:48.016163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471589e-d4ee-4732-af86-dc92807a01a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:48.017557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471589e-d4ee-4732-af86-dc92807a01a4 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:48.028439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 540/1039] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:48.030454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c545f4-18fc-4292-b359-62bf2fa4418a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:48.131697 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c545f4-18fc-4292-b359-62bf2fa4418a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:48.165740 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3c008-0b37-4ad8-9d16-175c58609c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:48.166394 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3c008-0b37-4ad8-9d16-175c58609c66 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:48.166668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3c008-0b37-4ad8-9d16-175c58609c66 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:48.166939 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3c008-0b37-4ad8-9d16-175c58609c66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:48.167714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3c008-0b37-4ad8-9d16-175c58609c66 None admin] RBAC: Adding query filter params (interface=public, service_id=f0476dc499994e20ad023b41143f9d52, region_id=RegionOne) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:48.168016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3c008-0b37-4ad8-9d16-175c58609c66 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:48.169410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3c008-0b37-4ad8-9d16-175c58609c66 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:48.174467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 500/1040] 10.222.0.49 () {56 vars in 1251 bytes} [Tue May 10 13:47:48 2022] GET /identity/v3/endpoints?service_id=f0476dc499994e20ad023b41143f9d52&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:48.180801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471589e-d4ee-4732-af86-dc92807a01a4 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:48.276524 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471589e-d4ee-4732-af86-dc92807a01a4 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:48.308341 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031f5db-fed5-41c3-9402-4b7e5d76ec4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:48.308998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031f5db-fed5-41c3-9402-4b7e5d76ec4d None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:48.309272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031f5db-fed5-41c3-9402-4b7e5d76ec4d None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:48.309539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031f5db-fed5-41c3-9402-4b7e5d76ec4d None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:48.310198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031f5db-fed5-41c3-9402-4b7e5d76ec4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:48.311532 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031f5db-fed5-41c3-9402-4b7e5d76ec4d None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:48.324216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 541/1041] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 13:47:48 2022] GET /identity/v3/services => generated 1957 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:47:49.663537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997e3b6-1b9b-4d62-966d-176ddd679832 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:49.664076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997e3b6-1b9b-4d62-966d-176ddd679832 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:49.664446 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997e3b6-1b9b-4d62-966d-176ddd679832 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:49.666970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 501/1042] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:49.672315 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650af20-604e-422e-97c6-e99cf635e671 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:49.672719 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650af20-604e-422e-97c6-e99cf635e671 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:49.672914 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650af20-604e-422e-97c6-e99cf635e671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:49.688998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f650af20-604e-422e-97c6-e99cf635e671 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:49.690141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f650af20-604e-422e-97c6-e99cf635e671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:49.755428 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 542/1043] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:49.779132 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997e3b6-1b9b-4d62-966d-176ddd679832 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:49.876144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997e3b6-1b9b-4d62-966d-176ddd679832 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:49.910986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f18834-3d11-400c-a89f-0ca6f3a3f2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:49.911766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f18834-3d11-400c-a89f-0ca6f3a3f2ff None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:49.912043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f18834-3d11-400c-a89f-0ca6f3a3f2ff None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:49.912341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f18834-3d11-400c-a89f-0ca6f3a3f2ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:49.913485 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f18834-3d11-400c-a89f-0ca6f3a3f2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:49.914945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f18834-3d11-400c-a89f-0ca6f3a3f2ff None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:49.916823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 502/1044] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:49.922202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650af20-604e-422e-97c6-e99cf635e671 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:50.013899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650af20-604e-422e-97c6-e99cf635e671 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:50.045904 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a8590-00b8-4d87-933e-0b8e2e5221a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:50.046569 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a8590-00b8-4d87-933e-0b8e2e5221a7 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.046845 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a8590-00b8-4d87-933e-0b8e2e5221a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.047116 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a8590-00b8-4d87-933e-0b8e2e5221a7 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.047814 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a8590-00b8-4d87-933e-0b8e2e5221a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:50.049238 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a8590-00b8-4d87-933e-0b8e2e5221a7 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:50.070117 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 543/1045] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:47:49 2022] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:47:50.674368 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581a617-9cfe-43ef-8baa-3c488abd9745 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.674866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581a617-9cfe-43ef-8baa-3c488abd9745 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.674866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581a617-9cfe-43ef-8baa-3c488abd9745 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.676819 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 503/1046] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:50.681950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe84f0-2f8f-405a-9405-1d67159accb1 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.682356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe84f0-2f8f-405a-9405-1d67159accb1 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.682547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe84f0-2f8f-405a-9405-1d67159accb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.699403 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-82fe84f0-2f8f-405a-9405-1d67159accb1 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:50.700604 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-82fe84f0-2f8f-405a-9405-1d67159accb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:50.764527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 544/1047] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:50.788149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581a617-9cfe-43ef-8baa-3c488abd9745 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:50.891469 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581a617-9cfe-43ef-8baa-3c488abd9745 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:50.926506 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68e10e-41e0-4c59-9daa-836aadd8e205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:50.927224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68e10e-41e0-4c59-9daa-836aadd8e205 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.927503 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68e10e-41e0-4c59-9daa-836aadd8e205 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.927776 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68e10e-41e0-4c59-9daa-836aadd8e205 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.938270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68e10e-41e0-4c59-9daa-836aadd8e205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:50.946402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-6d68e10e-41e0-4c59-9daa-836aadd8e205 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:47:50.946402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:50.946402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:50.946402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:50.946402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:50.946402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:50.946402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:50.946402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:50.946402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:50.946402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:50.946402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:50.946402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:50.946402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:50.946402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:50.946402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:50.946402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:50.947410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:50.947410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:50.947410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:50.947410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:50.947410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:50.947410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:50.947410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:50.947410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:50.947410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:50.947410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:50.947410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:50.947410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:50.947410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:50.947410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:50.947410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:50.947410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:50.948803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:50.948803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:50.948803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:50.948803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:50.948803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:50.948803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:50.948803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:50.948803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:50.948803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:50.948803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:50.948803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:47:50.948803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:50.949804 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 504/1048] 10.222.0.49 () {56 vars in 1120 bytes} [Tue May 10 13:47:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:50.953611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe84f0-2f8f-405a-9405-1d67159accb1 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:50.997444 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee30492-c45d-4599-b6d6-af8f8bacb9eb None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:50.997744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee30492-c45d-4599-b6d6-af8f8bacb9eb None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:50.997994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee30492-c45d-4599-b6d6-af8f8bacb9eb None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:50.999484 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 505/1049] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:51.004241 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfed956-fd19-4312-a6c8-584de5e8b767 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.004529 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfed956-fd19-4312-a6c8-584de5e8b767 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.004802 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfed956-fd19-4312-a6c8-584de5e8b767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.024651 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-7dfed956-fd19-4312-a6c8-584de5e8b767 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:51.026483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-7dfed956-fd19-4312-a6c8-584de5e8b767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:51.055319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe84f0-2f8f-405a-9405-1d67159accb1 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.089318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5f74a-02e2-4c73-b741-556b10705818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.089983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5f74a-02e2-4c73-b741-556b10705818 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.090262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5f74a-02e2-4c73-b741-556b10705818 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.090534 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5f74a-02e2-4c73-b741-556b10705818 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.091261 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5f74a-02e2-4c73-b741-556b10705818 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:51.091564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5f74a-02e2-4c73-b741-556b10705818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.092889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 506/1050] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:47:51.093000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5f74a-02e2-4c73-b741-556b10705818 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.103017 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 545/1051] 10.222.0.49 () {56 vars in 1115 bytes} [Tue May 10 13:47:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:51.107059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfed956-fd19-4312-a6c8-584de5e8b767 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.117468 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5f74a-02e2-4c73-b741-556b10705818 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.202211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfed956-fd19-4312-a6c8-584de5e8b767 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.211879 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5f74a-02e2-4c73-b741-556b10705818 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.234644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a34819-0b2c-43f3-a295-16a06e739db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.235454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a34819-0b2c-43f3-a295-16a06e739db2 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.235732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a34819-0b2c-43f3-a295-16a06e739db2 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.235996 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a34819-0b2c-43f3-a295-16a06e739db2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.245537 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654258dc-42ac-45cd-82ed-81aa80e0de00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.246336 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654258dc-42ac-45cd-82ed-81aa80e0de00 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.246613 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654258dc-42ac-45cd-82ed-81aa80e0de00 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.246885 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654258dc-42ac-45cd-82ed-81aa80e0de00 None admin] PATH_INFO: `/v3/services/image` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.247089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a34819-0b2c-43f3-a295-16a06e739db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.247535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654258dc-42ac-45cd-82ed-81aa80e0de00 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.248564 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a34819-0b2c-43f3-a295-16a06e739db2 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.248904 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654258dc-42ac-45cd-82ed-81aa80e0de00 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.260953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-654258dc-42ac-45cd-82ed-81aa80e0de00 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:47:51.260953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:51.260953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:47:51.260953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:47:51.260953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:47:51.260953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:47:51.260953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:47:51.260953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:51.260953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:47:51.260953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:51.260953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:47:51.260953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:51.260953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:51.260953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:51.260953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:51.260953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:51.260953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:51.261979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:51.261979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:51.261979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:51.261979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:51.261979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:51.261979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:51.261979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:47:51.261979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:47:51.261979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:47:51.261979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:47:51.261979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:51.261979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:51.261979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:51.261979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:51.261979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:51.261979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:51.262934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:51.262934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:51.262934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:51.262934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:51.262934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:51.262934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:51.262934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:51.262934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:51.262934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:51.262934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:51.262934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:47:51.262934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:47:51.262934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 13:47:51.262934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:51.267686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 546/1052] 10.222.0.49 () {56 vars in 1105 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:51.267811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-a8a34819-0b2c-43f3-a295-16a06e739db2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:51.267811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:51.267811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:51.267811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:51.267811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:51.267811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:51.267811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:51.267811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:51.267811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:51.267811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:51.267811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:51.267811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:51.267811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:51.267811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:51.267811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:51.269099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:51.269099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:51.269099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:51.269099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:51.269099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:51.269099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:51.269099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:51.269099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:51.269099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:51.269099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:51.269099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:51.269099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:51.269099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:51.269099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:51.269099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:51.269099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:51.269099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:51.272354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:51.272354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:51.272354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:51.272354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:51.272628 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654258dc-42ac-45cd-82ed-81aa80e0de00 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.272706 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 507/1053] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:51.275702 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a34819-0b2c-43f3-a295-16a06e739db2 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.370622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654258dc-42ac-45cd-82ed-81aa80e0de00 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.375240 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a34819-0b2c-43f3-a295-16a06e739db2 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.410397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706622d-5db6-4319-98c1-8efa0f3ebff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.411059 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706622d-5db6-4319-98c1-8efa0f3ebff4 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.411336 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706622d-5db6-4319-98c1-8efa0f3ebff4 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.411615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706622d-5db6-4319-98c1-8efa0f3ebff4 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.412368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706622d-5db6-4319-98c1-8efa0f3ebff4 None admin] RBAC: Adding query filter params (name=image) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:51.412637 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706622d-5db6-4319-98c1-8efa0f3ebff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.414167 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706622d-5db6-4319-98c1-8efa0f3ebff4 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.416501 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761e69c-76bb-4d39-ad1a-316db85bb9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.417435 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761e69c-76bb-4d39-ad1a-316db85bb9b8 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.417720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761e69c-76bb-4d39-ad1a-316db85bb9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.417996 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761e69c-76bb-4d39-ad1a-316db85bb9b8 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.418712 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761e69c-76bb-4d39-ad1a-316db85bb9b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:51.419239 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 547/1054] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:51.420327 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761e69c-76bb-4d39-ad1a-316db85bb9b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.421705 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761e69c-76bb-4d39-ad1a-316db85bb9b8 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.424425 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706622d-5db6-4319-98c1-8efa0f3ebff4 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.437924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 508/1055] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:51.439073 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761e69c-76bb-4d39-ad1a-316db85bb9b8 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.523931 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706622d-5db6-4319-98c1-8efa0f3ebff4 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.539806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761e69c-76bb-4d39-ad1a-316db85bb9b8 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.556509 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af11e94-7f62-4e56-a1ee-758ab5042c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.557166 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af11e94-7f62-4e56-a1ee-758ab5042c75 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.557444 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af11e94-7f62-4e56-a1ee-758ab5042c75 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.557715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af11e94-7f62-4e56-a1ee-758ab5042c75 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.558418 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af11e94-7f62-4e56-a1ee-758ab5042c75 None admin] RBAC: Adding query filter params (type=image) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:51.558718 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af11e94-7f62-4e56-a1ee-758ab5042c75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.560053 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af11e94-7f62-4e56-a1ee-758ab5042c75 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.564802 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 548/1056] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:51.570735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af11e94-7f62-4e56-a1ee-758ab5042c75 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.572503 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7f082-9451-47e3-9978-59a55def7a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.573341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7f082-9451-47e3-9978-59a55def7a24 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.573627 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7f082-9451-47e3-9978-59a55def7a24 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.573901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7f082-9451-47e3-9978-59a55def7a24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.581341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7f082-9451-47e3-9978-59a55def7a24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.583304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7f082-9451-47e3-9978-59a55def7a24 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.597121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-b8b7f082-9451-47e3-9978-59a55def7a24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:47:51.597121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:51.597121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:51.597121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:51.597121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:51.597121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:51.597121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:51.597121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:51.597121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:51.597121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:51.597121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:51.597121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:51.597121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:51.597121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:51.597121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:51.597121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:51.598088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:51.599089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:51.599089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:51.599089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:51.599089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:51.599089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:51.599089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:51.599089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:51.599089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:51.599089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:47:51.599089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:51.599089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 509/1057] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:51.603949 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7f082-9451-47e3-9978-59a55def7a24 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.668792 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af11e94-7f62-4e56-a1ee-758ab5042c75 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.701096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7f082-9451-47e3-9978-59a55def7a24 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.701609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac6da0-fedc-40d7-9513-4dea07266bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.702058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac6da0-fedc-40d7-9513-4dea07266bc0 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.702279 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac6da0-fedc-40d7-9513-4dea07266bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.702553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac6da0-fedc-40d7-9513-4dea07266bc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.703285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac6da0-fedc-40d7-9513-4dea07266bc0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.704656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac6da0-fedc-40d7-9513-4dea07266bc0 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.725870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 549/1058] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 13:47:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:47:51.751466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc515c3-3489-43fd-a3ec-d77aeac6d944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.752150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc515c3-3489-43fd-a3ec-d77aeac6d944 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.752459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc515c3-3489-43fd-a3ec-d77aeac6d944 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.752731 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc515c3-3489-43fd-a3ec-d77aeac6d944 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.754111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc515c3-3489-43fd-a3ec-d77aeac6d944 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:51.754417 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc515c3-3489-43fd-a3ec-d77aeac6d944 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.755892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc515c3-3489-43fd-a3ec-d77aeac6d944 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.780557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 510/1059] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:51.782367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac6da0-fedc-40d7-9513-4dea07266bc0 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:51.889114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac6da0-fedc-40d7-9513-4dea07266bc0 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:51.924952 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a96106-a8aa-4f6a-91de-6a60b91dd8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:51.926302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a96106-a8aa-4f6a-91de-6a60b91dd8bb None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:51.926579 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a96106-a8aa-4f6a-91de-6a60b91dd8bb None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:51.926845 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a96106-a8aa-4f6a-91de-6a60b91dd8bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:51.937767 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a96106-a8aa-4f6a-91de-6a60b91dd8bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:51.939211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a96106-a8aa-4f6a-91de-6a60b91dd8bb None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:51.957030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-e4a96106-a8aa-4f6a-91de-6a60b91dd8bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:51.957030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:51.957030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:51.957030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:51.957030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:51.957030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:51.957030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:51.957030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:51.957030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:51.957030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:51.957030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:51.957030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:51.957030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:51.957030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:51.957030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:51.957976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:51.957976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:51.957976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:51.957976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:51.957976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:51.957976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:51.957976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:51.957976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:51.957976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:51.957976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:51.957976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:51.957976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:51.957976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:51.957976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:51.957976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:51.957976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:51.957976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:51.959002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:51.959002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:51.959002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:51.959002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:51.959002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 550/1060] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:51.963906 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc515c3-3489-43fd-a3ec-d77aeac6d944 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:52.059773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc515c3-3489-43fd-a3ec-d77aeac6d944 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:52.092107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312b5bf-6928-421f-89f5-74987f6cce33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:52.092796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312b5bf-6928-421f-89f5-74987f6cce33 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.093080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312b5bf-6928-421f-89f5-74987f6cce33 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.093357 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312b5bf-6928-421f-89f5-74987f6cce33 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.094069 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312b5bf-6928-421f-89f5-74987f6cce33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:52.094439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312b5bf-6928-421f-89f5-74987f6cce33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:52.095809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312b5bf-6928-421f-89f5-74987f6cce33 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:52.111430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 511/1061] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:52.113134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a96106-a8aa-4f6a-91de-6a60b91dd8bb None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:52.213219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a96106-a8aa-4f6a-91de-6a60b91dd8bb None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:52.246506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561f99d-2309-4569-884f-eb99f13a377a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:52.247300 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561f99d-2309-4569-884f-eb99f13a377a None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.247580 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561f99d-2309-4569-884f-eb99f13a377a None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.247853 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561f99d-2309-4569-884f-eb99f13a377a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.254715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561f99d-2309-4569-884f-eb99f13a377a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:52.256137 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561f99d-2309-4569-884f-eb99f13a377a None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:52.270228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-a561f99d-2309-4569-884f-eb99f13a377a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:52.270228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:52.270228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:52.270228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:52.270228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:52.270228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:52.270228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:52.270228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:52.270228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:52.270228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:52.270228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:52.270228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:52.270228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:52.270228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:52.270228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:52.271242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:52.271242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:52.271242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:52.271242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:52.271242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:52.271242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:52.271242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:52.271242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:52.271242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:52.271242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:52.271242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:52.271242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:52.271242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:52.271242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:52.271242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:52.271242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:52.271242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:52.272207 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:52.272207 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:52.272207 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:52.272207 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:52.272207 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:52.272207 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:52.272207 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:52.272207 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:52.272207 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 551/1062] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:52.278729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312b5bf-6928-421f-89f5-74987f6cce33 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:52.377548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3e336-d8a6-4829-b644-79a1d7efe9ec None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.377918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3e336-d8a6-4829-b644-79a1d7efe9ec None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.378104 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3e336-d8a6-4829-b644-79a1d7efe9ec None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.380773 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 552/1063] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:52.384893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d2c9d-877d-41ab-8a42-9dba592fdfec None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.385171 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d2c9d-877d-41ab-8a42-9dba592fdfec None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.385448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d2c9d-877d-41ab-8a42-9dba592fdfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.386589 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312b5bf-6928-421f-89f5-74987f6cce33 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:52.404675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-a74d2c9d-877d-41ab-8a42-9dba592fdfec None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:52.406471 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a74d2c9d-877d-41ab-8a42-9dba592fdfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:52.420736 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb66db-600a-4197-a2f7-9344f453bc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:52.421441 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb66db-600a-4197-a2f7-9344f453bc83 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.421722 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb66db-600a-4197-a2f7-9344f453bc83 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.421987 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb66db-600a-4197-a2f7-9344f453bc83 None admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.422754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb66db-600a-4197-a2f7-9344f453bc83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:52.423053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb66db-600a-4197-a2f7-9344f453bc83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:52.424479 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb66db-600a-4197-a2f7-9344f453bc83 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:52.437303 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 512/1064] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:52.442717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb66db-600a-4197-a2f7-9344f453bc83 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:52.473610 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 553/1065] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:52.497075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d2c9d-877d-41ab-8a42-9dba592fdfec None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:52.539874 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb66db-600a-4197-a2f7-9344f453bc83 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:52.574202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c1847-f728-4b15-ab86-977280364d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:52.575231 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c1847-f728-4b15-ab86-977280364d49 None admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.575608 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c1847-f728-4b15-ab86-977280364d49 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.575978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c1847-f728-4b15-ab86-977280364d49 None admin] PATH_INFO: `/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/975f10f781b94bdaa8edee39a2b1bba4/roles/76799389aacd44d5a8d92e1df6f89e12` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.578354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c1847-f728-4b15-ab86-977280364d49 None admin] RBAC: Authorizing `identity:create_grant(project_id=9613de9a3bc9461d9d348e5b66b8d684, user_id=975f10f781b94bdaa8edee39a2b1bba4, role_id=76799389aacd44d5a8d92e1df6f89e12)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:52.579887 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c1847-f728-4b15-ab86-977280364d49 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:52.593789 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 513/1066] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:47:52 2022] PUT /identity/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/975f10f781b94bdaa8edee39a2b1bba4/roles/76799389aacd44d5a8d92e1df6f89e12 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 13:47:52.594184 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d2c9d-877d-41ab-8a42-9dba592fdfec None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:52.630853 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42df2c-5899-430e-a649-4c42b59b8249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:52.631582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42df2c-5899-430e-a649-4c42b59b8249 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.631860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42df2c-5899-430e-a649-4c42b59b8249 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.632134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42df2c-5899-430e-a649-4c42b59b8249 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.643604 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42df2c-5899-430e-a649-4c42b59b8249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:52.652365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-4d42df2c-5899-430e-a649-4c42b59b8249 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:52.652365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:52.652365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:52.652365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:52.652365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:52.652365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:52.652365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:52.652365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:52.652365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:52.652365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:52.652365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:52.652365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:52.652365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:52.652365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:52.652365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:52.652365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:52.653402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:52.653402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:52.653402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:52.653402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:52.653402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:52.653402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:52.653402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:52.653402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:52.653402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:52.653402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:52.653402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:52.653402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:52.653402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:52.653402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:52.653402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:52.653402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:52.660863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:52.660863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:52.660863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:52.660863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:52.660863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:52.660863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:52.660863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:52.660863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:52.660863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:52.660863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:52.660863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:52.660863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:52.660863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 554/1067] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:47:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:52.661931 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c1847-f728-4b15-ab86-977280364d49 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:52.767385 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c1847-f728-4b15-ab86-977280364d49 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:52.803118 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd2f13-4071-4c73-83eb-2cce3f2a39eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:52.803783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd2f13-4071-4c73-83eb-2cce3f2a39eb None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.804060 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd2f13-4071-4c73-83eb-2cce3f2a39eb None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.804359 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd2f13-4071-4c73-83eb-2cce3f2a39eb None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.805096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd2f13-4071-4c73-83eb-2cce3f2a39eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:52.805397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd2f13-4071-4c73-83eb-2cce3f2a39eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:52.806747 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd2f13-4071-4c73-83eb-2cce3f2a39eb None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:52.814994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 514/1068] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:47:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:52.821047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42df2c-5899-430e-a649-4c42b59b8249 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:52.919983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42df2c-5899-430e-a649-4c42b59b8249 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:52.952553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ef145-f09e-41f2-80d2-fc16fba37af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:52.953468 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ef145-f09e-41f2-80d2-fc16fba37af4 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:52.953707 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ef145-f09e-41f2-80d2-fc16fba37af4 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:52.953979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ef145-f09e-41f2-80d2-fc16fba37af4 None admin] PATH_INFO: `/v3/users/0a03f163c62842aea81d46254154dabe` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:52.967270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ef145-f09e-41f2-80d2-fc16fba37af4 None admin] RBAC: Authorizing `identity:get_user(user_id=0a03f163c62842aea81d46254154dabe)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:52.968725 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ef145-f09e-41f2-80d2-fc16fba37af4 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:52.970587 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 555/1069] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:47:52 2022] GET /identity/v3/users/0a03f163c62842aea81d46254154dabe => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:52.976622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd2f13-4071-4c73-83eb-2cce3f2a39eb None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:53.073474 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd2f13-4071-4c73-83eb-2cce3f2a39eb None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:53.105034 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fca841-680e-422a-b1df-d17c86c01922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:53.105677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fca841-680e-422a-b1df-d17c86c01922 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:53.105952 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fca841-680e-422a-b1df-d17c86c01922 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:53.106222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fca841-680e-422a-b1df-d17c86c01922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:53.169645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fca841-680e-422a-b1df-d17c86c01922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:53.171128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fca841-680e-422a-b1df-d17c86c01922 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:53.266449 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 515/1070] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:47:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:47:53.267651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ef145-f09e-41f2-80d2-fc16fba37af4 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:53.361680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ef145-f09e-41f2-80d2-fc16fba37af4 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:53.395820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d53689-55a5-4021-8132-c3b0c53502df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:53.396711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d53689-55a5-4021-8132-c3b0c53502df None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:53.396983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d53689-55a5-4021-8132-c3b0c53502df None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:53.397250 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d53689-55a5-4021-8132-c3b0c53502df None admin] PATH_INFO: `/v3/projects/bdf220a422b44c5193a5cf02bca2364d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:53.398591 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d53689-55a5-4021-8132-c3b0c53502df None admin] RBAC: Authorizing `identity:get_project(project_id=bdf220a422b44c5193a5cf02bca2364d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:53.400032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d53689-55a5-4021-8132-c3b0c53502df None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:53.407000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 556/1071] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:47:53 2022] GET /identity/v3/projects/bdf220a422b44c5193a5cf02bca2364d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:53.408068 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fca841-680e-422a-b1df-d17c86c01922 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:53.501782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fca841-680e-422a-b1df-d17c86c01922 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:53.535105 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73241a22-02f3-4536-8d9c-42a3611ac27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:53.535755 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73241a22-02f3-4536-8d9c-42a3611ac27f None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:53.536027 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73241a22-02f3-4536-8d9c-42a3611ac27f None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:53.536320 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73241a22-02f3-4536-8d9c-42a3611ac27f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:53.537127 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73241a22-02f3-4536-8d9c-42a3611ac27f None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=bdf220a422b44c5193a5cf02bca2364d, user.id=0a03f163c62842aea81d46254154dabe) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:53.537429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73241a22-02f3-4536-8d9c-42a3611ac27f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:53.538838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73241a22-02f3-4536-8d9c-42a3611ac27f None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:53.552198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 516/1072] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:47:53 2022] GET /identity/v3/role_assignments?user.id=0a03f163c62842aea81d46254154dabe&scope.project.id=bdf220a422b44c5193a5cf02bca2364d&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:53.981759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ae156-a161-44cf-bd99-35a70d3d0edd None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:53.982309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ae156-a161-44cf-bd99-35a70d3d0edd None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:53.982309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ae156-a161-44cf-bd99-35a70d3d0edd None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:53.983670 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 557/1073] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:53.988870 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4293a-1520-494b-97e3-3379e93c2808 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:53.989264 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4293a-1520-494b-97e3-3379e93c2808 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:53.989425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4293a-1520-494b-97e3-3379e93c2808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:54.005939 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-3bd4293a-1520-494b-97e3-3379e93c2808 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:54.007094 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-3bd4293a-1520-494b-97e3-3379e93c2808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:54.072103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 517/1074] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:54.093354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ae156-a161-44cf-bd99-35a70d3d0edd None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:54.189163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ae156-a161-44cf-bd99-35a70d3d0edd None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:54.221326 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d935834-a9d8-4c06-a2e3-115bc225eb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:54.222100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d935834-a9d8-4c06-a2e3-115bc225eb2e None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:54.222376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d935834-a9d8-4c06-a2e3-115bc225eb2e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:54.222644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d935834-a9d8-4c06-a2e3-115bc225eb2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:54.286093 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d935834-a9d8-4c06-a2e3-115bc225eb2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:54.287423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d935834-a9d8-4c06-a2e3-115bc225eb2e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:54.384335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 558/1075] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:47:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:47:54.387195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4293a-1520-494b-97e3-3379e93c2808 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:54.493859 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4293a-1520-494b-97e3-3379e93c2808 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:54.525487 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd6f92-fdac-4385-a963-ac32e5c7008b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:54.526270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd6f92-fdac-4385-a963-ac32e5c7008b None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:54.526547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd6f92-fdac-4385-a963-ac32e5c7008b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:54.526817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd6f92-fdac-4385-a963-ac32e5c7008b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:54.537265 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd6f92-fdac-4385-a963-ac32e5c7008b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:54.538637 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd6f92-fdac-4385-a963-ac32e5c7008b None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:54.556041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-f0bd6f92-fdac-4385-a963-ac32e5c7008b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:54.556041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:54.556041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:54.556041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:54.556041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:54.556041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:54.556041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:54.556041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:54.556041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:54.556041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:54.556041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:54.556041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:54.556041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:54.556041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:54.556041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:54.557051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:54.557051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:54.557051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:54.557051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:54.557051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:54.557051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:54.557051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:54.557051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:54.557051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:54.557051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:54.557051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:54.557051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:54.557051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:54.557051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:54.557051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:54.557051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:54.557051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:54.557977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:54.557977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:54.557977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:54.557977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:54.560482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 518/1076] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:54.563019 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d935834-a9d8-4c06-a2e3-115bc225eb2e None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:54.659116 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d935834-a9d8-4c06-a2e3-115bc225eb2e None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:54.695374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9a39d-9bda-4d8c-b638-b0785b743715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:54.696053 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9a39d-9bda-4d8c-b638-b0785b743715 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:54.696364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9a39d-9bda-4d8c-b638-b0785b743715 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:54.696640 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9a39d-9bda-4d8c-b638-b0785b743715 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:54.697373 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9a39d-9bda-4d8c-b638-b0785b743715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:54.697675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9a39d-9bda-4d8c-b638-b0785b743715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:54.699044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9a39d-9bda-4d8c-b638-b0785b743715 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:54.711219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 559/1077] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:54.865406 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05ebe2-0fd3-4a38-afce-9e54bd75daf9 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:54.865722 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05ebe2-0fd3-4a38-afce-9e54bd75daf9 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:54.865977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05ebe2-0fd3-4a38-afce-9e54bd75daf9 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:54.867536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 519/1078] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:54.873209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cf6c0-6e7a-4276-b761-12d5bdbfc202 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:54.873491 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cf6c0-6e7a-4276-b761-12d5bdbfc202 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:54.873769 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cf6c0-6e7a-4276-b761-12d5bdbfc202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:54.890567 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-cb0cf6c0-6e7a-4276-b761-12d5bdbfc202 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:54.891728 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cb0cf6c0-6e7a-4276-b761-12d5bdbfc202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:54.959831 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 560/1079] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:47:54.982993 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05ebe2-0fd3-4a38-afce-9e54bd75daf9 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:55.080859 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05ebe2-0fd3-4a38-afce-9e54bd75daf9 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:55.113339 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777d7cb-22d2-40ac-95b8-99015282e331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:55.114126 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777d7cb-22d2-40ac-95b8-99015282e331 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:55.114410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777d7cb-22d2-40ac-95b8-99015282e331 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:55.114682 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777d7cb-22d2-40ac-95b8-99015282e331 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:55.124397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777d7cb-22d2-40ac-95b8-99015282e331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:55.132422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-c777d7cb-22d2-40ac-95b8-99015282e331 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:47:55.132422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:55.132422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:55.132422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:55.132422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:55.132422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:55.132422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:55.132422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:55.132422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:55.132422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:55.132422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:55.132422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:55.132422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:55.132422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:55.132422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:55.132422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:55.133537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:55.133537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:55.133537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:55.133537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:55.133537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:55.133537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:55.133537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:55.133537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:55.133537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:55.133537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:55.133537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:55.133537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:55.133537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:55.133537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:55.133537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:55.133537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:55.134818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:55.134818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:55.134818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:55.134818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:55.134818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:55.134818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:55.134818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:55.134818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:55.134818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:55.134818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:55.134818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 13:47:55.134818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:55.134818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 520/1080] 10.222.0.49 () {56 vars in 1120 bytes} [Tue May 10 13:47:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:55.139523 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cf6c0-6e7a-4276-b761-12d5bdbfc202 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:55.233058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cf6c0-6e7a-4276-b761-12d5bdbfc202 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:55.265160 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b2e90-0ed5-46c3-b708-099ed7de02b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:55.265817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b2e90-0ed5-46c3-b708-099ed7de02b4 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:55.266095 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b2e90-0ed5-46c3-b708-099ed7de02b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:55.266367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b2e90-0ed5-46c3-b708-099ed7de02b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:55.267108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b2e90-0ed5-46c3-b708-099ed7de02b4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:55.267409 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b2e90-0ed5-46c3-b708-099ed7de02b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:55.269364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b2e90-0ed5-46c3-b708-099ed7de02b4 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:55.277367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 561/1081] 10.222.0.49 () {56 vars in 1115 bytes} [Tue May 10 13:47:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:55.282983 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777d7cb-22d2-40ac-95b8-99015282e331 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:55.376215 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777d7cb-22d2-40ac-95b8-99015282e331 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:55.412235 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474972d1-0255-4874-9e48-13161be2e882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:55.413047 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474972d1-0255-4874-9e48-13161be2e882 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:55.413324 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474972d1-0255-4874-9e48-13161be2e882 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:55.413596 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474972d1-0255-4874-9e48-13161be2e882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:55.423883 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474972d1-0255-4874-9e48-13161be2e882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:55.425365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474972d1-0255-4874-9e48-13161be2e882 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:55.442005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-474972d1-0255-4874-9e48-13161be2e882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:55.442005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:55.442005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:55.442005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:55.442005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:55.442005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:55.442005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:55.442005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:55.442005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:55.442005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:55.442005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:55.442005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:55.442005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:55.442005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:55.442005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:55.443085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:55.443085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:55.443085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:55.443085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:55.443085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:55.443085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:55.443085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:55.443085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:55.443085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:55.443085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:55.443085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:55.443085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:55.443085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:55.443085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:55.443085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:55.443085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:55.443085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:55.444520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:55.444520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:55.444520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:55.444520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:55.444520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 521/1082] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:55.448723 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b2e90-0ed5-46c3-b708-099ed7de02b4 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:55.546547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b2e90-0ed5-46c3-b708-099ed7de02b4 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:55.579102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1356de0-af38-4cc5-94f3-a521e19c0676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:55.579787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1356de0-af38-4cc5-94f3-a521e19c0676 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:55.580062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1356de0-af38-4cc5-94f3-a521e19c0676 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:55.580361 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1356de0-af38-4cc5-94f3-a521e19c0676 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:55.581101 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1356de0-af38-4cc5-94f3-a521e19c0676 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:55.581440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1356de0-af38-4cc5-94f3-a521e19c0676 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:55.582833 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1356de0-af38-4cc5-94f3-a521e19c0676 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:55.595948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 562/1083] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:55.601598 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474972d1-0255-4874-9e48-13161be2e882 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:55.697134 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474972d1-0255-4874-9e48-13161be2e882 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:55.728237 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f80e0-4cbe-4bd4-a12f-351c67bdfd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:55.729019 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f80e0-4cbe-4bd4-a12f-351c67bdfd0c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:55.729297 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f80e0-4cbe-4bd4-a12f-351c67bdfd0c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:55.729568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f80e0-4cbe-4bd4-a12f-351c67bdfd0c None admin] PATH_INFO: `/v3/users/nova` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:55.736931 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f80e0-4cbe-4bd4-a12f-351c67bdfd0c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:55.738886 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f80e0-4cbe-4bd4-a12f-351c67bdfd0c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:55.752266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-828f80e0-4cbe-4bd4-a12f-351c67bdfd0c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 13:47:55.752266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:55.752266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:55.752266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:55.752266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:55.752266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:55.752266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:55.752266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:55.752266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:55.752266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:55.752266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:55.752266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:55.752266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:47:55.752266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:47:55.752266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:47:55.752266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:55.753997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:55.755409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:55.755409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:55.755409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:47:55.755409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:47:55.755409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:47:55.755409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:47:55.755409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:47:55.755409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:47:55.755409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 13:47:55.755409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:55.755409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 522/1084] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 13:47:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:55.759736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1356de0-af38-4cc5-94f3-a521e19c0676 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:55.764311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bc18f-7b63-4974-aa9b-9afb8ee2564f None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:55.764593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bc18f-7b63-4974-aa9b-9afb8ee2564f None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:55.764863 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bc18f-7b63-4974-aa9b-9afb8ee2564f None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:55.766216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 523/1085] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:47:55.773284 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f7eb7-445e-49f9-8330-0285a0db8ae8 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:55.773284 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f7eb7-445e-49f9-8330-0285a0db8ae8 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:55.774072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f7eb7-445e-49f9-8330-0285a0db8ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:55.793745 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-0a7f7eb7-445e-49f9-8330-0285a0db8ae8 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:55.794928 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0a7f7eb7-445e-49f9-8330-0285a0db8ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:55.858107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 524/1086] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:47:55.863392 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1356de0-af38-4cc5-94f3-a521e19c0676 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:55.880914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f7eb7-445e-49f9-8330-0285a0db8ae8 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:55.895671 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467732be-830d-4bcc-96c0-fb758995af15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:55.896363 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467732be-830d-4bcc-96c0-fb758995af15 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:55.896640 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467732be-830d-4bcc-96c0-fb758995af15 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:55.896909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467732be-830d-4bcc-96c0-fb758995af15 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:55.897733 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467732be-830d-4bcc-96c0-fb758995af15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:55.898034 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467732be-830d-4bcc-96c0-fb758995af15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:55.899721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467732be-830d-4bcc-96c0-fb758995af15 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:55.918411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 563/1087] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 13:47:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:55.923980 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467732be-830d-4bcc-96c0-fb758995af15 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:55.974433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f7eb7-445e-49f9-8330-0285a0db8ae8 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:56.006043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a2bf3-819d-4908-a9c3-79aa763e211d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:56.006822 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a2bf3-819d-4908-a9c3-79aa763e211d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:56.007101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a2bf3-819d-4908-a9c3-79aa763e211d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:56.007375 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a2bf3-819d-4908-a9c3-79aa763e211d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:56.014979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467732be-830d-4bcc-96c0-fb758995af15 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:56.016910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a2bf3-819d-4908-a9c3-79aa763e211d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:56.024978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-845a2bf3-819d-4908-a9c3-79aa763e211d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:56.024978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:56.024978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:56.024978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:56.024978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:56.024978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:56.024978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:56.024978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:56.024978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:56.024978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:56.024978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:56.024978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:56.024978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:56.024978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:56.024978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:56.024978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:56.025927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:56.025927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:56.025927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:56.025927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:56.025927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:56.025927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:56.025927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:56.025927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:56.025927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:56.025927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:56.025927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:56.025927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:56.025927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:56.025927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:56.025927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:56.025927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:56.026815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:56.026815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:56.026815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:56.026815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:56.026815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:56.026815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:56.026815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:56.026815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:56.026815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:56.026815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:56.026815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:56.026815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:56.026815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 525/1088] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:47:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:56.032234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a2bf3-819d-4908-a9c3-79aa763e211d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:56.047589 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daaa557-ac6b-4864-9c28-b6fcf3182fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:56.048264 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daaa557-ac6b-4864-9c28-b6fcf3182fb7 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:56.048544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daaa557-ac6b-4864-9c28-b6fcf3182fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:56.048816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daaa557-ac6b-4864-9c28-b6fcf3182fb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:56.111381 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daaa557-ac6b-4864-9c28-b6fcf3182fb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:56.112872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daaa557-ac6b-4864-9c28-b6fcf3182fb7 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:56.123897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a2bf3-819d-4908-a9c3-79aa763e211d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:56.156046 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad388ba-e131-41a5-bda4-33cfe75303e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:56.156710 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad388ba-e131-41a5-bda4-33cfe75303e4 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:56.156986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad388ba-e131-41a5-bda4-33cfe75303e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:56.157274 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad388ba-e131-41a5-bda4-33cfe75303e4 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:56.157978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad388ba-e131-41a5-bda4-33cfe75303e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:56.158273 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad388ba-e131-41a5-bda4-33cfe75303e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:56.159634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad388ba-e131-41a5-bda4-33cfe75303e4 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:56.167276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 526/1089] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:47:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:56.173073 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad388ba-e131-41a5-bda4-33cfe75303e4 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:56.205241 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 564/1090] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:47:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 13:47:56.211327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daaa557-ac6b-4864-9c28-b6fcf3182fb7 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:56.266052 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad388ba-e131-41a5-bda4-33cfe75303e4 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:56.297786 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd97ac-746d-4bdc-90dd-11ec7c1fae5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:56.298639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd97ac-746d-4bdc-90dd-11ec7c1fae5f None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:56.298918 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd97ac-746d-4bdc-90dd-11ec7c1fae5f None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:56.299192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd97ac-746d-4bdc-90dd-11ec7c1fae5f None admin] PATH_INFO: `/v3/users/0a03f163c62842aea81d46254154dabe` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:56.300923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd97ac-746d-4bdc-90dd-11ec7c1fae5f None admin] RBAC: Authorizing `identity:get_user(user_id=0a03f163c62842aea81d46254154dabe)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:56.301936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daaa557-ac6b-4864-9c28-b6fcf3182fb7 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:56.302347 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd97ac-746d-4bdc-90dd-11ec7c1fae5f None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:56.304336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 527/1091] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:47:56 2022] GET /identity/v3/users/0a03f163c62842aea81d46254154dabe => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:56.309458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd97ac-746d-4bdc-90dd-11ec7c1fae5f None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:56.334298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db7e74-c4d1-4940-b2cd-1d4752f2ce11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:56.335079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db7e74-c4d1-4940-b2cd-1d4752f2ce11 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:56.335356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db7e74-c4d1-4940-b2cd-1d4752f2ce11 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:56.335627 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db7e74-c4d1-4940-b2cd-1d4752f2ce11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:56.345196 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db7e74-c4d1-4940-b2cd-1d4752f2ce11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:56.346605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db7e74-c4d1-4940-b2cd-1d4752f2ce11 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:56.363609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-a0db7e74-c4d1-4940-b2cd-1d4752f2ce11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:56.363609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:56.363609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:56.363609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:56.363609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:56.363609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:56.363609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:56.363609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:56.363609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:56.363609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:56.363609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:56.363609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:56.363609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:47:56.363609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:47:56.363609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:47:56.364560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:47:56.364560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:56.364560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:56.364560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:56.364560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:56.364560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:56.364560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:56.364560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:56.364560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:56.364560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:56.364560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:56.364560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:56.364560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:56.364560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:56.364560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:56.364560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:56.364560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:56.365652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:47:56.365652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:47:56.365652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:47:56.365652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:56.365652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 565/1092] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:47:56.370214 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db7e74-c4d1-4940-b2cd-1d4752f2ce11 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:56.407488 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd97ac-746d-4bdc-90dd-11ec7c1fae5f None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:56.439266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa11a3-3464-4d1b-a112-2df1d4464dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:56.440116 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa11a3-3464-4d1b-a112-2df1d4464dec None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:56.440424 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa11a3-3464-4d1b-a112-2df1d4464dec None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:56.441281 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa11a3-3464-4d1b-a112-2df1d4464dec None admin] PATH_INFO: `/v3/projects/bdf220a422b44c5193a5cf02bca2364d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:56.442453 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa11a3-3464-4d1b-a112-2df1d4464dec None admin] RBAC: Authorizing `identity:get_project(project_id=bdf220a422b44c5193a5cf02bca2364d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:56.443880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa11a3-3464-4d1b-a112-2df1d4464dec None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:56.445599 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 528/1093] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:47:56 2022] GET /identity/v3/projects/bdf220a422b44c5193a5cf02bca2364d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:56.451268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa11a3-3464-4d1b-a112-2df1d4464dec None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:56.463495 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db7e74-c4d1-4940-b2cd-1d4752f2ce11 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:56.495315 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d8b1c-358e-48d6-bed9-0a152bfc284d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:56.495958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d8b1c-358e-48d6-bed9-0a152bfc284d None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:56.496273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d8b1c-358e-48d6-bed9-0a152bfc284d None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:56.496549 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d8b1c-358e-48d6-bed9-0a152bfc284d None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:56.497254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d8b1c-358e-48d6-bed9-0a152bfc284d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:56.497553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d8b1c-358e-48d6-bed9-0a152bfc284d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:56.498877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d8b1c-358e-48d6-bed9-0a152bfc284d None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:56.516927 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 566/1094] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:47:56.518608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d8b1c-358e-48d6-bed9-0a152bfc284d None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:56.544908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa11a3-3464-4d1b-a112-2df1d4464dec None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:56.577264 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b362e97-e8ba-4c4e-89b7-5dd58e119795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:56.578140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b362e97-e8ba-4c4e-89b7-5dd58e119795 None admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:56.578420 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b362e97-e8ba-4c4e-89b7-5dd58e119795 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:56.578697 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b362e97-e8ba-4c4e-89b7-5dd58e119795 None admin] PATH_INFO: `/v3/projects/bdf220a422b44c5193a5cf02bca2364d/users/0a03f163c62842aea81d46254154dabe/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:56.580683 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b362e97-e8ba-4c4e-89b7-5dd58e119795 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdf220a422b44c5193a5cf02bca2364d, user_id=0a03f163c62842aea81d46254154dabe, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:56.582130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b362e97-e8ba-4c4e-89b7-5dd58e119795 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:56.595041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 529/1095] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:47:56 2022] PUT /identity/v3/projects/bdf220a422b44c5193a5cf02bca2364d/users/0a03f163c62842aea81d46254154dabe/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 13:47:56.617787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d8b1c-358e-48d6-bed9-0a152bfc284d None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:56.652675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d71dec-4f92-42d3-9a41-6db17fca1b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:56.653503 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d71dec-4f92-42d3-9a41-6db17fca1b18 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:56.653783 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d71dec-4f92-42d3-9a41-6db17fca1b18 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:56.654055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d71dec-4f92-42d3-9a41-6db17fca1b18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:56.661993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d71dec-4f92-42d3-9a41-6db17fca1b18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:56.663442 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d71dec-4f92-42d3-9a41-6db17fca1b18 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:56.678865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-f5d71dec-4f92-42d3-9a41-6db17fca1b18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:56.678865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:56.678865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:56.678865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:56.678865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:56.678865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:56.678865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:56.678865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:56.678865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:56.678865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:56.678865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:56.678865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:56.678865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:47:56.678865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:47:56.678865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:47:56.679865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:47:56.679865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:56.679865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:56.679865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:56.679865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:56.679865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:56.679865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:56.679865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:56.679865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:47:56.679865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:56.679865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:56.679865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:56.679865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:56.679865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:56.679865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:56.679865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:56.679865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:56.680824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:47:56.680824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:47:56.680824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:47:56.680824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:47:56.680824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:47:56.680824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:47:56.680824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:47:56.680824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:47:56.680824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 567/1096] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:47:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:56.686192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b362e97-e8ba-4c4e-89b7-5dd58e119795 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:56.790550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b362e97-e8ba-4c4e-89b7-5dd58e119795 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:56.822685 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04039394-d0ea-4db7-8a8e-e264634f6e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:56.823340 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04039394-d0ea-4db7-8a8e-e264634f6e45 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:56.823620 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04039394-d0ea-4db7-8a8e-e264634f6e45 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:56.823892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04039394-d0ea-4db7-8a8e-e264634f6e45 None admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:56.824704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04039394-d0ea-4db7-8a8e-e264634f6e45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:56.825009 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04039394-d0ea-4db7-8a8e-e264634f6e45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:56.826423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04039394-d0ea-4db7-8a8e-e264634f6e45 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:56.837879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 530/1097] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:47:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:56.843965 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d71dec-4f92-42d3-9a41-6db17fca1b18 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:56.937821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d71dec-4f92-42d3-9a41-6db17fca1b18 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:56.969058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952d9c2-528f-44a0-93df-873fbcbbc7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:56.969699 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952d9c2-528f-44a0-93df-873fbcbbc7d6 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:56.969975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952d9c2-528f-44a0-93df-873fbcbbc7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:56.970244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952d9c2-528f-44a0-93df-873fbcbbc7d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:56.971055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952d9c2-528f-44a0-93df-873fbcbbc7d6 None admin] RBAC: Adding query filter params (role.id=76799389aacd44d5a8d92e1df6f89e12, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=975f10f781b94bdaa8edee39a2b1bba4) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:56.971358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952d9c2-528f-44a0-93df-873fbcbbc7d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:56.973298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952d9c2-528f-44a0-93df-873fbcbbc7d6 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:56.978927 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 568/1098] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:47:56 2022] GET /identity/v3/role_assignments?user.id=975f10f781b94bdaa8edee39a2b1bba4&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=76799389aacd44d5a8d92e1df6f89e12 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:58.796620 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dd9fd-da29-4255-8336-38f4742d5738 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:58.797118 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dd9fd-da29-4255-8336-38f4742d5738 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:58.797118 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dd9fd-da29-4255-8336-38f4742d5738 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:58.798445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 531/1099] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:47:58.803612 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bab9a5-1516-4557-a511-511821845e3a None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:58.804028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bab9a5-1516-4557-a511-511821845e3a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:58.804162 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bab9a5-1516-4557-a511-511821845e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:58.820294 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f5bab9a5-1516-4557-a511-511821845e3a None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:47:58.821444 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f5bab9a5-1516-4557-a511-511821845e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:47:58.883254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 569/1100] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:47:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:47:58.907174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dd9fd-da29-4255-8336-38f4742d5738 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:59.000637 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dd9fd-da29-4255-8336-38f4742d5738 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:59.032145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339a014-5478-451d-85ba-685d393bbb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:59.032927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339a014-5478-451d-85ba-685d393bbb4b None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:59.033205 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339a014-5478-451d-85ba-685d393bbb4b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:59.033474 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339a014-5478-451d-85ba-685d393bbb4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:59.043342 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339a014-5478-451d-85ba-685d393bbb4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:47:59.051459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-5339a014-5478-451d-85ba-685d393bbb4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:59.051459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:47:59.051459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:47:59.051459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:47:59.051459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:47:59.051459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:47:59.051459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:47:59.051459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:47:59.051459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:47:59.051459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:47:59.051459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:47:59.051459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:47:59.051459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:47:59.051459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:47:59.051459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:47:59.051459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:47:59.052586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:47:59.052586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:47:59.052586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:47:59.052586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:47:59.052586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:47:59.052586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:47:59.052586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:47:59.052586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:47:59.052586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:47:59.052586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:47:59.052586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:47:59.052586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:47:59.052586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:47:59.052586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:47:59.052586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:47:59.052586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:47:59.053466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:47:59.053466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:47:59.053466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:47:59.053466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:47:59.053466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:47:59.053466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:47:59.053466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:47:59.053466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:47:59.053466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:47:59.053466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:47:59.053466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:47:59.053466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:47:59.053466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 532/1101] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:47:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:47:59.058328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bab9a5-1516-4557-a511-511821845e3a None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:59.148711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bab9a5-1516-4557-a511-511821845e3a None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:59.180943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521e87-9d40-4d73-8565-132466246738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:59.181585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521e87-9d40-4d73-8565-132466246738 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:59.181862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521e87-9d40-4d73-8565-132466246738 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:59.182135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521e87-9d40-4d73-8565-132466246738 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:59.182862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65521e87-9d40-4d73-8565-132466246738 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:59.183163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65521e87-9d40-4d73-8565-132466246738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:59.184518 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65521e87-9d40-4d73-8565-132466246738 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:59.192086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 570/1102] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:47:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:59.197884 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339a014-5478-451d-85ba-685d393bbb4b None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:59.290955 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339a014-5478-451d-85ba-685d393bbb4b None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:59.322017 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e426d7-c0ea-43e9-b26c-aac965ac5254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:59.322798 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e426d7-c0ea-43e9-b26c-aac965ac5254 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:59.323075 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e426d7-c0ea-43e9-b26c-aac965ac5254 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:59.323345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e426d7-c0ea-43e9-b26c-aac965ac5254 None admin] PATH_INFO: `/v3/users/0a03f163c62842aea81d46254154dabe` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:59.324525 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e426d7-c0ea-43e9-b26c-aac965ac5254 None admin] RBAC: Authorizing `identity:get_user(user_id=0a03f163c62842aea81d46254154dabe)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:59.325934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e426d7-c0ea-43e9-b26c-aac965ac5254 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:59.327504 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 533/1103] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:47:59 2022] GET /identity/v3/users/0a03f163c62842aea81d46254154dabe => generated 285 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:59.333594 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521e87-9d40-4d73-8565-132466246738 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:59.427035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521e87-9d40-4d73-8565-132466246738 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:59.460002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15db86-ecdb-4523-9be9-fb578eb5f4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:59.460661 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15db86-ecdb-4523-9be9-fb578eb5f4f9 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:59.460934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15db86-ecdb-4523-9be9-fb578eb5f4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:59.461202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15db86-ecdb-4523-9be9-fb578eb5f4f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:59.523098 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15db86-ecdb-4523-9be9-fb578eb5f4f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:59.524521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15db86-ecdb-4523-9be9-fb578eb5f4f9 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:59.614805 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 571/1104] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:47:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:47:59.620672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e426d7-c0ea-43e9-b26c-aac965ac5254 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:59.715355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e426d7-c0ea-43e9-b26c-aac965ac5254 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:59.746130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1269815-5135-48c9-a092-0b975f0eab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:59.746968 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1269815-5135-48c9-a092-0b975f0eab4e None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:59.747248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1269815-5135-48c9-a092-0b975f0eab4e None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:59.747523 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1269815-5135-48c9-a092-0b975f0eab4e None admin] PATH_INFO: `/v3/projects/bdf220a422b44c5193a5cf02bca2364d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:59.748703 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1269815-5135-48c9-a092-0b975f0eab4e None admin] RBAC: Authorizing `identity:get_project(project_id=bdf220a422b44c5193a5cf02bca2364d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:59.750122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1269815-5135-48c9-a092-0b975f0eab4e None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:59.751782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 534/1105] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:47:59 2022] GET /identity/v3/projects/bdf220a422b44c5193a5cf02bca2364d => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:47:59.758312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15db86-ecdb-4523-9be9-fb578eb5f4f9 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:47:59.850535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15db86-ecdb-4523-9be9-fb578eb5f4f9 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:47:59.882141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad15fb1-407e-450e-9f68-08b09e594f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:47:59.882722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15fb1-407e-450e-9f68-08b09e594f88 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:47:59.883000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15fb1-407e-450e-9f68-08b09e594f88 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:47:59.883271 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15fb1-407e-450e-9f68-08b09e594f88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:47:59.884077 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad15fb1-407e-450e-9f68-08b09e594f88 None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=bdf220a422b44c5193a5cf02bca2364d, user.id=0a03f163c62842aea81d46254154dabe) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:47:59.884411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad15fb1-407e-450e-9f68-08b09e594f88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:47:59.885805 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad15fb1-407e-450e-9f68-08b09e594f88 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:47:59.891290 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 572/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:47:59 2022] GET /identity/v3/role_assignments?user.id=0a03f163c62842aea81d46254154dabe&scope.project.id=bdf220a422b44c5193a5cf02bca2364d&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:02.088660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b37191-a8e9-4bc2-b99f-18a698b12544 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:02.089223 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b37191-a8e9-4bc2-b99f-18a698b12544 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:02.089223 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b37191-a8e9-4bc2-b99f-18a698b12544 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:02.090690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 535/1107] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:02.095936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78dc09-35d4-4567-a30c-9306f3232e43 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:02.096362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78dc09-35d4-4567-a30c-9306f3232e43 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:02.096528 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78dc09-35d4-4567-a30c-9306f3232e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:02.112586 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-4f78dc09-35d4-4567-a30c-9306f3232e43 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:02.113752 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-4f78dc09-35d4-4567-a30c-9306f3232e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:02.175933 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 573/1108] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:48:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:02.200628 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b37191-a8e9-4bc2-b99f-18a698b12544 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:02.297366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b37191-a8e9-4bc2-b99f-18a698b12544 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:02.328977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc893a-def9-468a-92b0-5b24f4fdd028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:02.329741 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc893a-def9-468a-92b0-5b24f4fdd028 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:02.330020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc893a-def9-468a-92b0-5b24f4fdd028 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:02.330292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc893a-def9-468a-92b0-5b24f4fdd028 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:02.331478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc893a-def9-468a-92b0-5b24f4fdd028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:02.332938 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc893a-def9-468a-92b0-5b24f4fdd028 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:02.334507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 536/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:48:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:02.340076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78dc09-35d4-4567-a30c-9306f3232e43 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:02.432331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78dc09-35d4-4567-a30c-9306f3232e43 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:02.464420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934142f-8e9b-40eb-852b-3124ca4c516e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:02.465089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934142f-8e9b-40eb-852b-3124ca4c516e None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:02.465368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934142f-8e9b-40eb-852b-3124ca4c516e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:02.465644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934142f-8e9b-40eb-852b-3124ca4c516e None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:02.466339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934142f-8e9b-40eb-852b-3124ca4c516e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:02.467782 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934142f-8e9b-40eb-852b-3124ca4c516e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:02.486320 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 574/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:48:02 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:48:04.698173 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94476a1b-fa0d-4cbf-a3fa-fa5b0079b70f None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:04.698699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94476a1b-fa0d-4cbf-a3fa-fa5b0079b70f None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:04.698699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94476a1b-fa0d-4cbf-a3fa-fa5b0079b70f None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:04.699990 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 537/1111] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:04.705285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecab570-aa03-4575-853e-f0960c7413a5 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:04.705697 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecab570-aa03-4575-853e-f0960c7413a5 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:04.706346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecab570-aa03-4575-853e-f0960c7413a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:04.722918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-0ecab570-aa03-4575-853e-f0960c7413a5 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:04.724056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-0ecab570-aa03-4575-853e-f0960c7413a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:04.785421 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 575/1112] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:48:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:04.808481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94476a1b-fa0d-4cbf-a3fa-fa5b0079b70f None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:04.906926 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94476a1b-fa0d-4cbf-a3fa-fa5b0079b70f None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:04.938271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45094d8-226d-458e-bc9c-f13a38502ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:04.939108 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45094d8-226d-458e-bc9c-f13a38502ef0 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:04.939387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45094d8-226d-458e-bc9c-f13a38502ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:04.939655 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45094d8-226d-458e-bc9c-f13a38502ef0 None admin] PATH_INFO: `/v3/roles/c8015925658a407b9977b5b0a7f50f05` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:04.941581 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45094d8-226d-458e-bc9c-f13a38502ef0 None admin] RBAC: Authorizing `identity:get_role(role_id=c8015925658a407b9977b5b0a7f50f05)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:04.942928 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45094d8-226d-458e-bc9c-f13a38502ef0 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:04.944294 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 538/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:48:04 2022] GET /identity/v3/roles/c8015925658a407b9977b5b0a7f50f05 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:04.950193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecab570-aa03-4575-853e-f0960c7413a5 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:05.041664 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecab570-aa03-4575-853e-f0960c7413a5 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:05.073163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691267c-22e6-4179-8f36-f85a83890d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:05.074005 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691267c-22e6-4179-8f36-f85a83890d90 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:05.074282 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691267c-22e6-4179-8f36-f85a83890d90 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:05.074554 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691267c-22e6-4179-8f36-f85a83890d90 None admin] PATH_INFO: `/v3/users/9f1021973d0d48c0b0432817d241a3b7` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:05.087323 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691267c-22e6-4179-8f36-f85a83890d90 None admin] RBAC: Authorizing `identity:get_user(user_id=9f1021973d0d48c0b0432817d241a3b7)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:05.088774 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691267c-22e6-4179-8f36-f85a83890d90 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:05.090385 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 576/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:48:04 2022] GET /identity/v3/users/9f1021973d0d48c0b0432817d241a3b7 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:05.096412 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45094d8-226d-458e-bc9c-f13a38502ef0 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:05.189695 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45094d8-226d-458e-bc9c-f13a38502ef0 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:05.221390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7923a-8b91-44d8-9417-74f5e7718180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:05.222017 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7923a-8b91-44d8-9417-74f5e7718180 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:05.222305 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7923a-8b91-44d8-9417-74f5e7718180 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:05.222581 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7923a-8b91-44d8-9417-74f5e7718180 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:05.285316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7923a-8b91-44d8-9417-74f5e7718180 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:05.286734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7923a-8b91-44d8-9417-74f5e7718180 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:05.377542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 539/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:48:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:48:05.383451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691267c-22e6-4179-8f36-f85a83890d90 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:05.477583 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691267c-22e6-4179-8f36-f85a83890d90 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:05.508611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17f62d-42eb-4f3f-86c7-60adcd548db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:05.509455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17f62d-42eb-4f3f-86c7-60adcd548db7 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:05.509733 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17f62d-42eb-4f3f-86c7-60adcd548db7 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:05.510006 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17f62d-42eb-4f3f-86c7-60adcd548db7 None admin] PATH_INFO: `/v3/projects/bdf220a422b44c5193a5cf02bca2364d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:05.511162 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17f62d-42eb-4f3f-86c7-60adcd548db7 None admin] RBAC: Authorizing `identity:get_project(project_id=bdf220a422b44c5193a5cf02bca2364d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:05.512610 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17f62d-42eb-4f3f-86c7-60adcd548db7 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:05.514267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 577/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:48:05 2022] GET /identity/v3/projects/bdf220a422b44c5193a5cf02bca2364d => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:05.520733 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7923a-8b91-44d8-9417-74f5e7718180 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:05.612281 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7923a-8b91-44d8-9417-74f5e7718180 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:05.643130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e62c8-15b1-4d69-8f3a-4c28b788e160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:05.644309 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e62c8-15b1-4d69-8f3a-4c28b788e160 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:05.644590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e62c8-15b1-4d69-8f3a-4c28b788e160 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:05.644860 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e62c8-15b1-4d69-8f3a-4c28b788e160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:05.645673 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e62c8-15b1-4d69-8f3a-4c28b788e160 None admin] RBAC: Adding query filter params (role.id=c8015925658a407b9977b5b0a7f50f05, scope.project.id=bdf220a422b44c5193a5cf02bca2364d, user.id=9f1021973d0d48c0b0432817d241a3b7) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:05.645981 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e62c8-15b1-4d69-8f3a-4c28b788e160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:05.647387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e62c8-15b1-4d69-8f3a-4c28b788e160 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:05.652564 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 540/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:48:05 2022] GET /identity/v3/role_assignments?user.id=9f1021973d0d48c0b0432817d241a3b7&scope.project.id=bdf220a422b44c5193a5cf02bca2364d&role.id=c8015925658a407b9977b5b0a7f50f05 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:07.827978 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de6a2b-5419-47b4-8a29-4514378f1b9d None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:07.828514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de6a2b-5419-47b4-8a29-4514378f1b9d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:07.828514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de6a2b-5419-47b4-8a29-4514378f1b9d None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:07.829842 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 578/1118] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:07.835632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25350dac-8e5b-4230-9a8d-cec229a4410f None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:07.836073 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25350dac-8e5b-4230-9a8d-cec229a4410f None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:07.836185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25350dac-8e5b-4230-9a8d-cec229a4410f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:07.852869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-25350dac-8e5b-4230-9a8d-cec229a4410f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:07.854027 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-25350dac-8e5b-4230-9a8d-cec229a4410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:07.916833 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 541/1119] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:48:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:07.943733 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de6a2b-5419-47b4-8a29-4514378f1b9d None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:08.039141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de6a2b-5419-47b4-8a29-4514378f1b9d None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:08.070938 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc517aaf-1172-4826-8c07-4f731dbfa5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:08.071781 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc517aaf-1172-4826-8c07-4f731dbfa5f9 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:08.072059 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc517aaf-1172-4826-8c07-4f731dbfa5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:08.072367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc517aaf-1172-4826-8c07-4f731dbfa5f9 None admin] PATH_INFO: `/v3/roles/c8015925658a407b9977b5b0a7f50f05` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:08.073829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc517aaf-1172-4826-8c07-4f731dbfa5f9 None admin] RBAC: Authorizing `identity:get_role(role_id=c8015925658a407b9977b5b0a7f50f05)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:08.075170 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc517aaf-1172-4826-8c07-4f731dbfa5f9 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:08.076559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 579/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:48:07 2022] GET /identity/v3/roles/c8015925658a407b9977b5b0a7f50f05 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:08.083497 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25350dac-8e5b-4230-9a8d-cec229a4410f None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:08.183740 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25350dac-8e5b-4230-9a8d-cec229a4410f None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:08.215880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade60cc-a44d-4d34-a247-b056fc50d160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:08.216761 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade60cc-a44d-4d34-a247-b056fc50d160 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:08.217038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade60cc-a44d-4d34-a247-b056fc50d160 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:08.217307 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade60cc-a44d-4d34-a247-b056fc50d160 None admin] PATH_INFO: `/v3/users/9f1021973d0d48c0b0432817d241a3b7` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:08.218471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade60cc-a44d-4d34-a247-b056fc50d160 None admin] RBAC: Authorizing `identity:get_user(user_id=9f1021973d0d48c0b0432817d241a3b7)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:08.219903 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade60cc-a44d-4d34-a247-b056fc50d160 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:08.221538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 542/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:48:08 2022] GET /identity/v3/users/9f1021973d0d48c0b0432817d241a3b7 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:08.227284 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc517aaf-1172-4826-8c07-4f731dbfa5f9 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:08.321889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc517aaf-1172-4826-8c07-4f731dbfa5f9 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:08.354365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01bd62-e8ea-4655-930d-a8f1727ab3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:08.355161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01bd62-e8ea-4655-930d-a8f1727ab3a6 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:08.355440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01bd62-e8ea-4655-930d-a8f1727ab3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:08.355709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01bd62-e8ea-4655-930d-a8f1727ab3a6 None admin] PATH_INFO: `/v3/projects/bdf220a422b44c5193a5cf02bca2364d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:08.356892 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01bd62-e8ea-4655-930d-a8f1727ab3a6 None admin] RBAC: Authorizing `identity:get_project(project_id=bdf220a422b44c5193a5cf02bca2364d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:08.358298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01bd62-e8ea-4655-930d-a8f1727ab3a6 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:08.359966 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 580/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:48:08 2022] GET /identity/v3/projects/bdf220a422b44c5193a5cf02bca2364d => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:08.365796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade60cc-a44d-4d34-a247-b056fc50d160 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:08.462095 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade60cc-a44d-4d34-a247-b056fc50d160 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:08.496905 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b96db5-0ea9-4b8c-b844-031f8764ab96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:08.497779 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b96db5-0ea9-4b8c-b844-031f8764ab96 None admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:08.498060 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b96db5-0ea9-4b8c-b844-031f8764ab96 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:08.498339 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b96db5-0ea9-4b8c-b844-031f8764ab96 None admin] PATH_INFO: `/v3/projects/bdf220a422b44c5193a5cf02bca2364d/users/9f1021973d0d48c0b0432817d241a3b7/roles/c8015925658a407b9977b5b0a7f50f05` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:08.500547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b96db5-0ea9-4b8c-b844-031f8764ab96 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdf220a422b44c5193a5cf02bca2364d, user_id=9f1021973d0d48c0b0432817d241a3b7, role_id=c8015925658a407b9977b5b0a7f50f05)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:08.501968 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b96db5-0ea9-4b8c-b844-031f8764ab96 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:08.515210 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 543/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:48:08 2022] PUT /identity/v3/projects/bdf220a422b44c5193a5cf02bca2364d/users/9f1021973d0d48c0b0432817d241a3b7/roles/c8015925658a407b9977b5b0a7f50f05 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:48:10.680261 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a8895-a9ed-44ad-91cd-ddae5577d04a None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:10.680771 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a8895-a9ed-44ad-91cd-ddae5577d04a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:10.680771 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a8895-a9ed-44ad-91cd-ddae5577d04a None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:10.682100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 581/1124] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:10.687226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6aad19-827f-4bbb-8d52-ac1224c4c5ef None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:10.687651 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6aad19-827f-4bbb-8d52-ac1224c4c5ef None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:10.687780 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6aad19-827f-4bbb-8d52-ac1224c4c5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:10.704416 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-2d6aad19-827f-4bbb-8d52-ac1224c4c5ef None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:10.705573 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-2d6aad19-827f-4bbb-8d52-ac1224c4c5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:10.767380 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 544/1125] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:48:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:10.789995 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a8895-a9ed-44ad-91cd-ddae5577d04a None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:10.884577 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a8895-a9ed-44ad-91cd-ddae5577d04a None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:10.915595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5433c5c-b25f-4fd2-a21f-29bcede009bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:10.916463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5433c5c-b25f-4fd2-a21f-29bcede009bd None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:10.916737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5433c5c-b25f-4fd2-a21f-29bcede009bd None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:10.917007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5433c5c-b25f-4fd2-a21f-29bcede009bd None admin] PATH_INFO: `/v3/roles/c8015925658a407b9977b5b0a7f50f05` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:10.918449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5433c5c-b25f-4fd2-a21f-29bcede009bd None admin] RBAC: Authorizing `identity:get_role(role_id=c8015925658a407b9977b5b0a7f50f05)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:10.919784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5433c5c-b25f-4fd2-a21f-29bcede009bd None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:10.921155 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 582/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:48:10 2022] GET /identity/v3/roles/c8015925658a407b9977b5b0a7f50f05 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:10.927096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6aad19-827f-4bbb-8d52-ac1224c4c5ef None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:11.019524 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6aad19-827f-4bbb-8d52-ac1224c4c5ef None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:11.051889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cff376-c990-46bb-88a9-009b05e81d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:11.052762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cff376-c990-46bb-88a9-009b05e81d9d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:11.053043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cff376-c990-46bb-88a9-009b05e81d9d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:11.053315 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cff376-c990-46bb-88a9-009b05e81d9d None admin] PATH_INFO: `/v3/users/9f1021973d0d48c0b0432817d241a3b7` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:11.054479 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cff376-c990-46bb-88a9-009b05e81d9d None admin] RBAC: Authorizing `identity:get_user(user_id=9f1021973d0d48c0b0432817d241a3b7)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:11.055898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cff376-c990-46bb-88a9-009b05e81d9d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:11.057520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 545/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:48:10 2022] GET /identity/v3/users/9f1021973d0d48c0b0432817d241a3b7 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:11.063074 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5433c5c-b25f-4fd2-a21f-29bcede009bd None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:11.160635 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5433c5c-b25f-4fd2-a21f-29bcede009bd None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:11.192029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821220f-8654-4b45-8021-487501bbec88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:11.192667 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821220f-8654-4b45-8021-487501bbec88 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:11.192947 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821220f-8654-4b45-8021-487501bbec88 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:11.193226 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821220f-8654-4b45-8021-487501bbec88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:11.260867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821220f-8654-4b45-8021-487501bbec88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:11.262278 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821220f-8654-4b45-8021-487501bbec88 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:11.353174 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 583/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:48:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 13:48:11.358935 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cff376-c990-46bb-88a9-009b05e81d9d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:11.451696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cff376-c990-46bb-88a9-009b05e81d9d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:11.482336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e17ca-cddd-4124-afa0-4fa66e6b37e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:11.483166 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e17ca-cddd-4124-afa0-4fa66e6b37e6 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:11.483439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e17ca-cddd-4124-afa0-4fa66e6b37e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:11.483708 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e17ca-cddd-4124-afa0-4fa66e6b37e6 None admin] PATH_INFO: `/v3/projects/bdf220a422b44c5193a5cf02bca2364d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:11.484822 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e17ca-cddd-4124-afa0-4fa66e6b37e6 None admin] RBAC: Authorizing `identity:get_project(project_id=bdf220a422b44c5193a5cf02bca2364d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:11.486226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e17ca-cddd-4124-afa0-4fa66e6b37e6 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:11.488424 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 546/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:48:11 2022] GET /identity/v3/projects/bdf220a422b44c5193a5cf02bca2364d => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:11.494445 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821220f-8654-4b45-8021-487501bbec88 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:11.587164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821220f-8654-4b45-8021-487501bbec88 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:11.618984 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1f68b-bd59-4de5-91e4-3c1c2d4d0862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:11.619613 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1f68b-bd59-4de5-91e4-3c1c2d4d0862 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:11.619887 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1f68b-bd59-4de5-91e4-3c1c2d4d0862 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:11.620156 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1f68b-bd59-4de5-91e4-3c1c2d4d0862 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:11.620991 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1f68b-bd59-4de5-91e4-3c1c2d4d0862 None admin] RBAC: Adding query filter params (role.id=c8015925658a407b9977b5b0a7f50f05, scope.project.id=bdf220a422b44c5193a5cf02bca2364d, user.id=9f1021973d0d48c0b0432817d241a3b7) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:11.621293 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1f68b-bd59-4de5-91e4-3c1c2d4d0862 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:11.622674 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1f68b-bd59-4de5-91e4-3c1c2d4d0862 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:11.628754 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 584/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:48:11 2022] GET /identity/v3/role_assignments?user.id=9f1021973d0d48c0b0432817d241a3b7&scope.project.id=bdf220a422b44c5193a5cf02bca2364d&role.id=c8015925658a407b9977b5b0a7f50f05 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:13.838861 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d50915-5f5b-4abe-9d9c-a22862ff99e0 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:13.839376 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d50915-5f5b-4abe-9d9c-a22862ff99e0 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:13.839376 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d50915-5f5b-4abe-9d9c-a22862ff99e0 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:13.840726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 547/1131] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:13.845913 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20531f3d-9f69-45e4-b459-013c0bdcb88d None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:13.846296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20531f3d-9f69-45e4-b459-013c0bdcb88d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:13.846456 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20531f3d-9f69-45e4-b459-013c0bdcb88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:13.862922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-20531f3d-9f69-45e4-b459-013c0bdcb88d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:13.864056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-20531f3d-9f69-45e4-b459-013c0bdcb88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:13.925566 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 585/1132] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:48:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:13.949041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d50915-5f5b-4abe-9d9c-a22862ff99e0 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:14.048704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d50915-5f5b-4abe-9d9c-a22862ff99e0 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:14.080547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22eac08-2371-4082-9c90-ca9fed22df67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:14.081320 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eac08-2371-4082-9c90-ca9fed22df67 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:14.081606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eac08-2371-4082-9c90-ca9fed22df67 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:14.081880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eac08-2371-4082-9c90-ca9fed22df67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:14.083037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22eac08-2371-4082-9c90-ca9fed22df67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:14.084495 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22eac08-2371-4082-9c90-ca9fed22df67 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:14.086093 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 548/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:48:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:14.091866 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20531f3d-9f69-45e4-b459-013c0bdcb88d None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:14.184780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20531f3d-9f69-45e4-b459-013c0bdcb88d None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:14.215860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37498467-5fe5-4305-95b0-14c209635181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:14.216524 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37498467-5fe5-4305-95b0-14c209635181 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:14.216803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37498467-5fe5-4305-95b0-14c209635181 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:14.217073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37498467-5fe5-4305-95b0-14c209635181 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:14.217775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37498467-5fe5-4305-95b0-14c209635181 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:14.219166 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37498467-5fe5-4305-95b0-14c209635181 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:14.243242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 586/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 13:48:14 2022] POST /identity/v3/projects => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:48:16.447100 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe7323-3645-468b-a66a-90a484c9b441 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:16.447594 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe7323-3645-468b-a66a-90a484c9b441 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:16.447684 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe7323-3645-468b-a66a-90a484c9b441 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:16.449044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 549/1135] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:16.454328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e12c5-a2ad-4399-8ae0-2f8c32d4974d None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:16.454708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e12c5-a2ad-4399-8ae0-2f8c32d4974d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:16.454890 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e12c5-a2ad-4399-8ae0-2f8c32d4974d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:16.471619 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-5a3e12c5-a2ad-4399-8ae0-2f8c32d4974d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:16.472811 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-5a3e12c5-a2ad-4399-8ae0-2f8c32d4974d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:16.535497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 587/1136] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:48:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:16.560063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe7323-3645-468b-a66a-90a484c9b441 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:16.655041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe7323-3645-468b-a66a-90a484c9b441 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:16.686356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650838b-1792-4e41-8e92-4ab185718afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:16.687119 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650838b-1792-4e41-8e92-4ab185718afc None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:16.687397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650838b-1792-4e41-8e92-4ab185718afc None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:16.687668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650838b-1792-4e41-8e92-4ab185718afc None admin] PATH_INFO: `/v3/domains/default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:16.688831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650838b-1792-4e41-8e92-4ab185718afc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:16.690814 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650838b-1792-4e41-8e92-4ab185718afc None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:16.692418 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 550/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:48:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:16.697901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e12c5-a2ad-4399-8ae0-2f8c32d4974d None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:16.790314 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e12c5-a2ad-4399-8ae0-2f8c32d4974d None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:16.822511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b883cd5-038f-4992-814d-f43ed38054dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:16.823160 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b883cd5-038f-4992-814d-f43ed38054dc None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:16.823439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b883cd5-038f-4992-814d-f43ed38054dc None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:16.823710 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b883cd5-038f-4992-814d-f43ed38054dc None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:16.824431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b883cd5-038f-4992-814d-f43ed38054dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:16.825832 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b883cd5-038f-4992-814d-f43ed38054dc None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:16.844599 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 588/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:48:16 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:48:19.082544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38d06f-b4b5-45c3-a219-5134e2d3f0f5 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:19.083090 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38d06f-b4b5-45c3-a219-5134e2d3f0f5 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:19.083090 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38d06f-b4b5-45c3-a219-5134e2d3f0f5 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:19.084483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 551/1139] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:19.089654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed6c0f-072d-4f9f-aa32-57e121f5438c None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:19.090059 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed6c0f-072d-4f9f-aa32-57e121f5438c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:19.090211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed6c0f-072d-4f9f-aa32-57e121f5438c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:19.106925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-b8ed6c0f-072d-4f9f-aa32-57e121f5438c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:19.108084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b8ed6c0f-072d-4f9f-aa32-57e121f5438c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:19.170288 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 589/1140] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:48:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:19.193922 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38d06f-b4b5-45c3-a219-5134e2d3f0f5 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:19.288420 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38d06f-b4b5-45c3-a219-5134e2d3f0f5 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:19.319601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fc926-839a-43a4-91bb-7b2e09645b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:19.320390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fc926-839a-43a4-91bb-7b2e09645b5c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:19.320665 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fc926-839a-43a4-91bb-7b2e09645b5c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:19.320931 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fc926-839a-43a4-91bb-7b2e09645b5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:19.330323 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fc926-839a-43a4-91bb-7b2e09645b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:19.337781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-2c5fc926-839a-43a4-91bb-7b2e09645b5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:19.337781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:19.337781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:19.337781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:19.337781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:19.337781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:19.337781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:19.337781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:19.337781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:19.337781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:19.337781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:19.337781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:19.337781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:19.337781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:19.337781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:19.337781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:19.338950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:19.338950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:19.338950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:19.338950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:19.338950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:19.338950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:19.338950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:19.338950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:19.338950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:19.338950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:19.338950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:19.338950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:48:19.338950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:19.338950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:19.338950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:19.338950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:19.340145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:19.340145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:19.340145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:19.340145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:19.340145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:19.340145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:19.340145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:19.340145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:19.340145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:19.340145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:19.340145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:19.340145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:48:19.340145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 552/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:48:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:19.344665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed6c0f-072d-4f9f-aa32-57e121f5438c None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:19.437255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed6c0f-072d-4f9f-aa32-57e121f5438c None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:19.468629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bf869-6bd4-450d-8cb1-6afd627714b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:19.469291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bf869-6bd4-450d-8cb1-6afd627714b1 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:19.469575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bf869-6bd4-450d-8cb1-6afd627714b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:19.469847 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bf869-6bd4-450d-8cb1-6afd627714b1 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:19.470578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bf869-6bd4-450d-8cb1-6afd627714b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:19.471373 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bf869-6bd4-450d-8cb1-6afd627714b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:19.472740 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bf869-6bd4-450d-8cb1-6afd627714b1 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:19.480546 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 590/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:48:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:48:19.486211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fc926-839a-43a4-91bb-7b2e09645b5c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:19.578925 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fc926-839a-43a4-91bb-7b2e09645b5c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:19.610740 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f990d-c200-4967-93dd-35b235138ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:19.612031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f990d-c200-4967-93dd-35b235138ceb None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:19.612348 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f990d-c200-4967-93dd-35b235138ceb None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:19.612620 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f990d-c200-4967-93dd-35b235138ceb None admin] PATH_INFO: `/v3/users/18285a7a7e864a03ad4b804d7543a349` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:19.624977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f990d-c200-4967-93dd-35b235138ceb None admin] RBAC: Authorizing `identity:get_user(user_id=18285a7a7e864a03ad4b804d7543a349)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:19.626381 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f990d-c200-4967-93dd-35b235138ceb None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:19.628570 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 553/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:48:19 2022] GET /identity/v3/users/18285a7a7e864a03ad4b804d7543a349 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:19.634056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bf869-6bd4-450d-8cb1-6afd627714b1 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:19.726199 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bf869-6bd4-450d-8cb1-6afd627714b1 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:19.757448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce719a22-3392-4b2a-bcb9-45aae2749aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:19.758070 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce719a22-3392-4b2a-bcb9-45aae2749aed None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:19.758345 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce719a22-3392-4b2a-bcb9-45aae2749aed None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:19.758614 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce719a22-3392-4b2a-bcb9-45aae2749aed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:19.819461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce719a22-3392-4b2a-bcb9-45aae2749aed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:19.820880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce719a22-3392-4b2a-bcb9-45aae2749aed None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:19.914076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 591/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:48:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 13:48:19.919891 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f990d-c200-4967-93dd-35b235138ceb None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:20.011646 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f990d-c200-4967-93dd-35b235138ceb None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:20.043774 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eaa6e2-8309-496c-950c-3b82bd75c7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:20.044646 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaa6e2-8309-496c-950c-3b82bd75c7ad None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:20.044922 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaa6e2-8309-496c-950c-3b82bd75c7ad None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:20.045189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaa6e2-8309-496c-950c-3b82bd75c7ad None admin] PATH_INFO: `/v3/projects/2e6ed234dacc421a8defeed9a7c349a9` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:20.046327 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaa6e2-8309-496c-950c-3b82bd75c7ad None admin] RBAC: Authorizing `identity:get_project(project_id=2e6ed234dacc421a8defeed9a7c349a9)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:20.047724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaa6e2-8309-496c-950c-3b82bd75c7ad None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:20.049430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 554/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:48:19 2022] GET /identity/v3/projects/2e6ed234dacc421a8defeed9a7c349a9 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:20.055609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce719a22-3392-4b2a-bcb9-45aae2749aed None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:20.148141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce719a22-3392-4b2a-bcb9-45aae2749aed None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:20.179676 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f8261-265c-4911-9956-c4567500fcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:20.180286 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f8261-265c-4911-9956-c4567500fcb4 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:20.180569 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f8261-265c-4911-9956-c4567500fcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:20.180840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f8261-265c-4911-9956-c4567500fcb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:20.181656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f8261-265c-4911-9956-c4567500fcb4 None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=2e6ed234dacc421a8defeed9a7c349a9, user.id=18285a7a7e864a03ad4b804d7543a349) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:20.181964 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f8261-265c-4911-9956-c4567500fcb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:20.183370 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f8261-265c-4911-9956-c4567500fcb4 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:20.188558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 592/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:48:20 2022] GET /identity/v3/role_assignments?user.id=18285a7a7e864a03ad4b804d7543a349&scope.project.id=2e6ed234dacc421a8defeed9a7c349a9&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:22.341023 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f44f77-105f-4d94-ba1f-ec81007a7ac7 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:22.341562 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f44f77-105f-4d94-ba1f-ec81007a7ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:22.341562 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f44f77-105f-4d94-ba1f-ec81007a7ac7 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:22.342909 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 555/1147] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:22.348534 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e07f96-72fe-4ed9-a4e1-ac27338e9fb3 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:22.348931 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e07f96-72fe-4ed9-a4e1-ac27338e9fb3 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:22.349082 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e07f96-72fe-4ed9-a4e1-ac27338e9fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:22.365859 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-93e07f96-72fe-4ed9-a4e1-ac27338e9fb3 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:22.367010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-93e07f96-72fe-4ed9-a4e1-ac27338e9fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:22.430023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 593/1148] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:48:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:22.452394 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f44f77-105f-4d94-ba1f-ec81007a7ac7 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:22.547231 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f44f77-105f-4d94-ba1f-ec81007a7ac7 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:22.578520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39b0c3-2e2c-49db-a9df-cc7c23ede7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:22.579280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39b0c3-2e2c-49db-a9df-cc7c23ede7e9 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:22.579555 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39b0c3-2e2c-49db-a9df-cc7c23ede7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:22.579819 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39b0c3-2e2c-49db-a9df-cc7c23ede7e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:22.589854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39b0c3-2e2c-49db-a9df-cc7c23ede7e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:22.597885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-cb39b0c3-2e2c-49db-a9df-cc7c23ede7e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:22.597885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:22.597885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:22.597885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:22.597885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:22.597885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:22.597885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:22.597885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:22.597885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:22.597885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:22.597885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:22.597885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:22.597885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:22.597885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:22.597885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:22.597885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:22.599015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:22.599015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:22.599015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:22.599015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:22.599015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:22.599015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:22.599015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:22.599015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:22.599015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:22.599015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:22.599015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:22.599015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:48:22.599015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:22.599015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:22.599015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:22.599015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:22.600067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:22.600067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:22.600067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:22.600067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:22.600067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:22.600067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:22.600067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:22.600067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:22.600067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:22.600067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:22.600067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:22.600067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:48:22.600067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 556/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:48:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:22.604893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e07f96-72fe-4ed9-a4e1-ac27338e9fb3 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:22.696246 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e07f96-72fe-4ed9-a4e1-ac27338e9fb3 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:22.728051 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9886ed-f151-4e0e-8c3f-91ebaf533004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:22.728719 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9886ed-f151-4e0e-8c3f-91ebaf533004 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:22.728996 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9886ed-f151-4e0e-8c3f-91ebaf533004 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:22.729268 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9886ed-f151-4e0e-8c3f-91ebaf533004 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:22.729994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9886ed-f151-4e0e-8c3f-91ebaf533004 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:22.730291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9886ed-f151-4e0e-8c3f-91ebaf533004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:22.731631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9886ed-f151-4e0e-8c3f-91ebaf533004 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:22.739150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 594/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:48:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:22.744851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39b0c3-2e2c-49db-a9df-cc7c23ede7e9 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:22.837980 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39b0c3-2e2c-49db-a9df-cc7c23ede7e9 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:22.868703 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14623985-55e3-4a3c-b8f2-ace9e9329aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:22.869533 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14623985-55e3-4a3c-b8f2-ace9e9329aeb None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:22.869807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14623985-55e3-4a3c-b8f2-ace9e9329aeb None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:22.870073 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14623985-55e3-4a3c-b8f2-ace9e9329aeb None admin] PATH_INFO: `/v3/users/18285a7a7e864a03ad4b804d7543a349` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:22.871224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14623985-55e3-4a3c-b8f2-ace9e9329aeb None admin] RBAC: Authorizing `identity:get_user(user_id=18285a7a7e864a03ad4b804d7543a349)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:22.872666 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14623985-55e3-4a3c-b8f2-ace9e9329aeb None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:22.874227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 557/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:48:22 2022] GET /identity/v3/users/18285a7a7e864a03ad4b804d7543a349 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:22.879733 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9886ed-f151-4e0e-8c3f-91ebaf533004 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:22.973312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9886ed-f151-4e0e-8c3f-91ebaf533004 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:23.004252 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564a9ae-2a59-4888-9e99-505ec16ad78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:23.005091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564a9ae-2a59-4888-9e99-505ec16ad78a None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:23.005368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564a9ae-2a59-4888-9e99-505ec16ad78a None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:23.005636 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564a9ae-2a59-4888-9e99-505ec16ad78a None admin] PATH_INFO: `/v3/projects/2e6ed234dacc421a8defeed9a7c349a9` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:23.006782 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564a9ae-2a59-4888-9e99-505ec16ad78a None admin] RBAC: Authorizing `identity:get_project(project_id=2e6ed234dacc421a8defeed9a7c349a9)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:23.008204 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564a9ae-2a59-4888-9e99-505ec16ad78a None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:23.009832 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 595/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:48:22 2022] GET /identity/v3/projects/2e6ed234dacc421a8defeed9a7c349a9 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:23.015354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14623985-55e3-4a3c-b8f2-ace9e9329aeb None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:23.109291 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14623985-55e3-4a3c-b8f2-ace9e9329aeb None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:23.140449 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bb4cd-573c-4d13-ba5e-f07336f10a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:23.141257 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bb4cd-573c-4d13-ba5e-f07336f10a00 None admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:23.141535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bb4cd-573c-4d13-ba5e-f07336f10a00 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:23.141807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bb4cd-573c-4d13-ba5e-f07336f10a00 None admin] PATH_INFO: `/v3/projects/2e6ed234dacc421a8defeed9a7c349a9/users/18285a7a7e864a03ad4b804d7543a349/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:23.144399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bb4cd-573c-4d13-ba5e-f07336f10a00 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e6ed234dacc421a8defeed9a7c349a9, user_id=18285a7a7e864a03ad4b804d7543a349, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:23.145818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bb4cd-573c-4d13-ba5e-f07336f10a00 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:23.158704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 558/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:48:23 2022] PUT /identity/v3/projects/2e6ed234dacc421a8defeed9a7c349a9/users/18285a7a7e864a03ad4b804d7543a349/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:48:25.332596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596fa51-c2bb-40f5-8234-2ac8d29f8cbe None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:25.333158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596fa51-c2bb-40f5-8234-2ac8d29f8cbe None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:25.333158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596fa51-c2bb-40f5-8234-2ac8d29f8cbe None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:25.334526 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 596/1154] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:25.339998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814804bd-105c-4f5d-a8be-f676359d6342 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:25.340483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814804bd-105c-4f5d-a8be-f676359d6342 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:25.340579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814804bd-105c-4f5d-a8be-f676359d6342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:25.356661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-814804bd-105c-4f5d-a8be-f676359d6342 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:25.357812 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-814804bd-105c-4f5d-a8be-f676359d6342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:25.421925 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 559/1155] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:48:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:25.444810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596fa51-c2bb-40f5-8234-2ac8d29f8cbe None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:25.539901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596fa51-c2bb-40f5-8234-2ac8d29f8cbe None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:25.572051 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f8567-9490-4e02-b021-da205bb99ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:25.572854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f8567-9490-4e02-b021-da205bb99ea5 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:25.573138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f8567-9490-4e02-b021-da205bb99ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:25.573413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f8567-9490-4e02-b021-da205bb99ea5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:25.583069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f8567-9490-4e02-b021-da205bb99ea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:25.590559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-ba9f8567-9490-4e02-b021-da205bb99ea5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:25.590559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:25.590559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:25.590559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:25.590559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:25.590559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:25.590559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:25.590559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:25.590559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:25.590559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:25.590559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:25.590559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:25.590559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:25.590559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:25.590559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:25.590559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:25.591682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:25.591682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:25.591682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:25.591682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:25.591682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:25.591682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:25.591682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:25.591682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:25.591682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:25.591682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:25.591682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:25.591682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:48:25.591682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:25.591682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:25.591682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:25.591682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:25.592925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:25.592925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:25.592925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:25.592925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:25.592925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:25.592925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:25.592925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:25.592925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:25.592925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:25.592925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:25.592925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:25.592925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:48:25.592925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 597/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:48:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:25.597510 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814804bd-105c-4f5d-a8be-f676359d6342 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:25.689826 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814804bd-105c-4f5d-a8be-f676359d6342 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:25.720772 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63982a50-7174-48f7-aa88-06afc97ae3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:25.721418 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63982a50-7174-48f7-aa88-06afc97ae3cd None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:25.721695 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63982a50-7174-48f7-aa88-06afc97ae3cd None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:25.722108 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63982a50-7174-48f7-aa88-06afc97ae3cd None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:25.722855 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63982a50-7174-48f7-aa88-06afc97ae3cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:25.723159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63982a50-7174-48f7-aa88-06afc97ae3cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:25.724550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63982a50-7174-48f7-aa88-06afc97ae3cd None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:25.732405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 560/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:48:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:25.738540 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f8567-9490-4e02-b021-da205bb99ea5 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:25.831801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f8567-9490-4e02-b021-da205bb99ea5 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:25.863107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75586ed8-5439-4299-9840-a653b3678cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:25.863902 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75586ed8-5439-4299-9840-a653b3678cf6 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:25.864197 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75586ed8-5439-4299-9840-a653b3678cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:25.864479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75586ed8-5439-4299-9840-a653b3678cf6 None admin] PATH_INFO: `/v3/users/18285a7a7e864a03ad4b804d7543a349` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:25.865655 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75586ed8-5439-4299-9840-a653b3678cf6 None admin] RBAC: Authorizing `identity:get_user(user_id=18285a7a7e864a03ad4b804d7543a349)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:25.867063 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75586ed8-5439-4299-9840-a653b3678cf6 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:25.868702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 598/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:48:25 2022] GET /identity/v3/users/18285a7a7e864a03ad4b804d7543a349 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:25.874172 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63982a50-7174-48f7-aa88-06afc97ae3cd None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:25.966637 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63982a50-7174-48f7-aa88-06afc97ae3cd None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:25.997954 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1f367-00fc-4931-8a12-cdf7ec11da31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:25.998572 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1f367-00fc-4931-8a12-cdf7ec11da31 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:25.998846 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1f367-00fc-4931-8a12-cdf7ec11da31 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:25.999115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1f367-00fc-4931-8a12-cdf7ec11da31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:26.060664 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1f367-00fc-4931-8a12-cdf7ec11da31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:26.062055 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1f367-00fc-4931-8a12-cdf7ec11da31 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:26.156968 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 561/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:48:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:48:26.163238 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75586ed8-5439-4299-9840-a653b3678cf6 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:26.257163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75586ed8-5439-4299-9840-a653b3678cf6 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:26.288816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af603130-998f-4bdc-9821-e90eb0b85cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:26.289665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af603130-998f-4bdc-9821-e90eb0b85cf2 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:26.289943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af603130-998f-4bdc-9821-e90eb0b85cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:26.290215 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af603130-998f-4bdc-9821-e90eb0b85cf2 None admin] PATH_INFO: `/v3/projects/2e6ed234dacc421a8defeed9a7c349a9` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:26.291377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af603130-998f-4bdc-9821-e90eb0b85cf2 None admin] RBAC: Authorizing `identity:get_project(project_id=2e6ed234dacc421a8defeed9a7c349a9)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:26.292816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af603130-998f-4bdc-9821-e90eb0b85cf2 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:26.294471 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 599/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:48:26 2022] GET /identity/v3/projects/2e6ed234dacc421a8defeed9a7c349a9 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:26.301023 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1f367-00fc-4931-8a12-cdf7ec11da31 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:26.392109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1f367-00fc-4931-8a12-cdf7ec11da31 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:26.425303 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e71bfe-1be8-4fca-a547-bf2321c08260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:26.425883 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e71bfe-1be8-4fca-a547-bf2321c08260 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:26.426163 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e71bfe-1be8-4fca-a547-bf2321c08260 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:26.426438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e71bfe-1be8-4fca-a547-bf2321c08260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:26.427251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e71bfe-1be8-4fca-a547-bf2321c08260 None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=2e6ed234dacc421a8defeed9a7c349a9, user.id=18285a7a7e864a03ad4b804d7543a349) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:26.427561 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e71bfe-1be8-4fca-a547-bf2321c08260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:26.429004 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e71bfe-1be8-4fca-a547-bf2321c08260 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:26.434663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 562/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:48:26 2022] GET /identity/v3/role_assignments?user.id=18285a7a7e864a03ad4b804d7543a349&scope.project.id=2e6ed234dacc421a8defeed9a7c349a9&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:28.651826 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c68b4-388f-4179-9ab7-7bdd18b52994 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:28.652373 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c68b4-388f-4179-9ab7-7bdd18b52994 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:28.652373 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c68b4-388f-4179-9ab7-7bdd18b52994 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:28.653855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 600/1162] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:28.659374 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f9182-46aa-4c6d-b3e3-0990ec903595 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:28.659799 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f9182-46aa-4c6d-b3e3-0990ec903595 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:28.659923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f9182-46aa-4c6d-b3e3-0990ec903595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:28.676433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-e22f9182-46aa-4c6d-b3e3-0990ec903595 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:28.677582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-e22f9182-46aa-4c6d-b3e3-0990ec903595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:28.738945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 563/1163] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:48:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:28.761455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c68b4-388f-4179-9ab7-7bdd18b52994 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:28.865605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c68b4-388f-4179-9ab7-7bdd18b52994 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:28.896920 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c25387-f4d7-43c6-8dfd-ce13a3e063d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:28.897550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c25387-f4d7-43c6-8dfd-ce13a3e063d7 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:28.897830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c25387-f4d7-43c6-8dfd-ce13a3e063d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:28.898103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c25387-f4d7-43c6-8dfd-ce13a3e063d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:28.960744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c25387-f4d7-43c6-8dfd-ce13a3e063d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:28.962094 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c25387-f4d7-43c6-8dfd-ce13a3e063d7 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:29.053226 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 601/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:48:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:48:29.059441 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f9182-46aa-4c6d-b3e3-0990ec903595 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:29.151144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f9182-46aa-4c6d-b3e3-0990ec903595 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:29.182404 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e6fe8-d3a3-4930-96b9-cff5af0f1398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:29.183167 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e6fe8-d3a3-4930-96b9-cff5af0f1398 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:29.183445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e6fe8-d3a3-4930-96b9-cff5af0f1398 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:29.183715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e6fe8-d3a3-4930-96b9-cff5af0f1398 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:29.190578 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e6fe8-d3a3-4930-96b9-cff5af0f1398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:29.191988 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e6fe8-d3a3-4930-96b9-cff5af0f1398 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:29.205621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-962e6fe8-d3a3-4930-96b9-cff5af0f1398 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 13:48:29.205621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:29.205621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 10 13:48:29.205621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 10 13:48:29.205621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:48:29.205621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:48:29.205621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:48:29.205621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:48:29.205621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 10 13:48:29.205621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:48:29.205621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:48:29.205621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:48:29.205621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:29.205621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:29.205621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:29.205621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:29.205621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:29.206809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:29.206809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:29.206809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:29.206809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:29.206809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:29.206809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:29.206809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:48:29.206809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:48:29.206809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:48:29.206809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:48:29.206809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:29.206809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:29.206809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:29.206809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:29.206809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:29.206809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:29.207711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:29.207711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:48:29.207711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:29.207711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:29.207711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:29.207711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:29.207711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:29.207711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:29.207711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:29.207711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:29.207711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 10 13:48:29.207711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:48:29.207711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 13:48:29.207711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:48:29.207711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 564/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 13:48:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:29.212657 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c25387-f4d7-43c6-8dfd-ce13a3e063d7 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:29.307346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c25387-f4d7-43c6-8dfd-ce13a3e063d7 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:29.343719 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0365261-a16a-4d8f-be2e-320d0a93a713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:29.344418 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0365261-a16a-4d8f-be2e-320d0a93a713 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:29.344699 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0365261-a16a-4d8f-be2e-320d0a93a713 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:29.344975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0365261-a16a-4d8f-be2e-320d0a93a713 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:29.346286 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0365261-a16a-4d8f-be2e-320d0a93a713 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:29.346586 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0365261-a16a-4d8f-be2e-320d0a93a713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:29.347928 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0365261-a16a-4d8f-be2e-320d0a93a713 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:29.354834 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 602/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Tue May 10 13:48:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:31.541314 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1897166-e02b-485e-a377-5753b66bfc35 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:31.541882 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1897166-e02b-485e-a377-5753b66bfc35 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:31.541882 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1897166-e02b-485e-a377-5753b66bfc35 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:31.543223 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 565/1167] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:31.549150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351642c-120b-494c-ad26-e19ce9256446 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:31.549537 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351642c-120b-494c-ad26-e19ce9256446 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:31.549710 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351642c-120b-494c-ad26-e19ce9256446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:31.565899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-4351642c-120b-494c-ad26-e19ce9256446 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:31.567055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-4351642c-120b-494c-ad26-e19ce9256446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:31.629826 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 603/1168] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:48:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:31.652472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1897166-e02b-485e-a377-5753b66bfc35 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:31.748281 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1897166-e02b-485e-a377-5753b66bfc35 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:31.779875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735ee58-f7e9-47f3-b380-ca34b2ac9238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:31.780534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735ee58-f7e9-47f3-b380-ca34b2ac9238 None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:31.780817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735ee58-f7e9-47f3-b380-ca34b2ac9238 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:31.781090 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735ee58-f7e9-47f3-b380-ca34b2ac9238 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:31.781811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735ee58-f7e9-47f3-b380-ca34b2ac9238 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:31.783208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735ee58-f7e9-47f3-b380-ca34b2ac9238 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:31.799313 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 566/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Tue May 10 13:48:31 2022] POST /identity/v3/domains => generated 267 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:48:34.003357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb05144-9aca-4906-b3dd-f24e073ea992 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:34.003911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb05144-9aca-4906-b3dd-f24e073ea992 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:34.003911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb05144-9aca-4906-b3dd-f24e073ea992 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:34.005305 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 604/1170] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:34.010358 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf4594-7686-4250-aaf3-cbc7b3769b4d None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:34.010779 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf4594-7686-4250-aaf3-cbc7b3769b4d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:34.010908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf4594-7686-4250-aaf3-cbc7b3769b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:34.027148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-59bf4594-7686-4250-aaf3-cbc7b3769b4d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:34.028343 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-59bf4594-7686-4250-aaf3-cbc7b3769b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:34.092252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 567/1171] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:48:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:34.115698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb05144-9aca-4906-b3dd-f24e073ea992 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:34.214324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb05144-9aca-4906-b3dd-f24e073ea992 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:34.245693 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b295f-0d5d-43b3-a8da-4b3976e774b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:34.246535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b295f-0d5d-43b3-a8da-4b3976e774b2 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:34.246812 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b295f-0d5d-43b3-a8da-4b3976e774b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:34.247079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b295f-0d5d-43b3-a8da-4b3976e774b2 None admin] PATH_INFO: `/v3/domains/79f79553c4d549fa907fe3fc974c1503` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:34.257467 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b295f-0d5d-43b3-a8da-4b3976e774b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=79f79553c4d549fa907fe3fc974c1503)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:34.258837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b295f-0d5d-43b3-a8da-4b3976e774b2 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:34.260498 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 605/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Tue May 10 13:48:34 2022] GET /identity/v3/domains/79f79553c4d549fa907fe3fc974c1503 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:34.266510 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf4594-7686-4250-aaf3-cbc7b3769b4d None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:34.359742 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf4594-7686-4250-aaf3-cbc7b3769b4d None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:34.391166 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676c283-b70a-4e59-a980-b912c20e2be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:34.391912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676c283-b70a-4e59-a980-b912c20e2be6 None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:34.392666 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676c283-b70a-4e59-a980-b912c20e2be6 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:34.392940 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676c283-b70a-4e59-a980-b912c20e2be6 None admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:34.393637 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676c283-b70a-4e59-a980-b912c20e2be6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:34.395060 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676c283-b70a-4e59-a980-b912c20e2be6 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:34.420680 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 568/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 13:48:34 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:48:36.659636 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5679e6-ff5c-4d35-b1e8-7f4436830c40 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:36.660158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5679e6-ff5c-4d35-b1e8-7f4436830c40 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:36.660158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5679e6-ff5c-4d35-b1e8-7f4436830c40 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:36.661500 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 606/1174] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:36.666636 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630f085-8166-46b1-9eea-570cb283b6a1 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:36.667063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630f085-8166-46b1-9eea-570cb283b6a1 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:36.667190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630f085-8166-46b1-9eea-570cb283b6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:36.686039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-0630f085-8166-46b1-9eea-570cb283b6a1 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:36.687209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0630f085-8166-46b1-9eea-570cb283b6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:36.751288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 569/1175] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:48:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:36.776818 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5679e6-ff5c-4d35-b1e8-7f4436830c40 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:36.876298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5679e6-ff5c-4d35-b1e8-7f4436830c40 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:36.910319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82524832-2c90-4a41-9893-16932ae276ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:36.911187 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82524832-2c90-4a41-9893-16932ae276ee None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:36.911455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82524832-2c90-4a41-9893-16932ae276ee None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:36.911782 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82524832-2c90-4a41-9893-16932ae276ee None admin] PATH_INFO: `/v3/domains/79f79553c4d549fa907fe3fc974c1503` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:36.912992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82524832-2c90-4a41-9893-16932ae276ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=79f79553c4d549fa907fe3fc974c1503)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:36.914378 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82524832-2c90-4a41-9893-16932ae276ee None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:36.915951 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 607/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Tue May 10 13:48:36 2022] GET /identity/v3/domains/79f79553c4d549fa907fe3fc974c1503 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:36.922566 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630f085-8166-46b1-9eea-570cb283b6a1 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:37.020218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630f085-8166-46b1-9eea-570cb283b6a1 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:37.051672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55171fed-8bb8-4276-b1b1-3f3f2f1f65a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:37.052356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55171fed-8bb8-4276-b1b1-3f3f2f1f65a6 None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:37.052636 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55171fed-8bb8-4276-b1b1-3f3f2f1f65a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:37.052906 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55171fed-8bb8-4276-b1b1-3f3f2f1f65a6 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:37.053595 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55171fed-8bb8-4276-b1b1-3f3f2f1f65a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:37.055002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55171fed-8bb8-4276-b1b1-3f3f2f1f65a6 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:37.074713 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 570/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:48:36 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:48:39.296033 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382cf40-c66a-4d04-8620-afafc012594a None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:39.296650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382cf40-c66a-4d04-8620-afafc012594a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:39.296650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382cf40-c66a-4d04-8620-afafc012594a None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:39.298464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 608/1178] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:48:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:39.303565 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24f320-58f0-4ac6-84c4-726939998430 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:39.303986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24f320-58f0-4ac6-84c4-726939998430 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:39.304116 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24f320-58f0-4ac6-84c4-726939998430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:39.320883 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-de24f320-58f0-4ac6-84c4-726939998430 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:39.322043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-de24f320-58f0-4ac6-84c4-726939998430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:39.384944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 571/1179] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:48:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:39.410481 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382cf40-c66a-4d04-8620-afafc012594a None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:39.508264 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382cf40-c66a-4d04-8620-afafc012594a None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:39.539725 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62ccf4-f6e6-42ef-87f4-b78ecd84b01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:39.540508 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62ccf4-f6e6-42ef-87f4-b78ecd84b01f None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:39.540786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62ccf4-f6e6-42ef-87f4-b78ecd84b01f None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:39.541056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62ccf4-f6e6-42ef-87f4-b78ecd84b01f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:39.551081 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62ccf4-f6e6-42ef-87f4-b78ecd84b01f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:39.558533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-1d62ccf4-f6e6-42ef-87f4-b78ecd84b01f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:39.558533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:39.558533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:39.558533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:39.558533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:39.558533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:39.558533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:39.558533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:39.558533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:39.558533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:39.558533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:39.558533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:39.558533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:39.558533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:39.558533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:39.558533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:39.559714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:39.559714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:39.559714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:39.559714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:39.559714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:39.559714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:39.559714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:39.559714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:39.559714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:39.559714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:39.559714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:39.559714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:48:39.559714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:39.559714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:39.559714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:39.559714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:39.560858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:39.560858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:39.560858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:39.560858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:39.560858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:39.560858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:39.560858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:39.560858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:39.560858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:39.560858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:39.560858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:39.560858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:48:39.560858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 609/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:48:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:39.565763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24f320-58f0-4ac6-84c4-726939998430 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:39.658859 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24f320-58f0-4ac6-84c4-726939998430 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:39.690490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4736c9a-c7de-4493-a7c9-954ec90df29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:39.691131 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4736c9a-c7de-4493-a7c9-954ec90df29b None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:39.691406 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4736c9a-c7de-4493-a7c9-954ec90df29b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:39.691676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4736c9a-c7de-4493-a7c9-954ec90df29b None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:39.692434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4736c9a-c7de-4493-a7c9-954ec90df29b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:39.692733 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4736c9a-c7de-4493-a7c9-954ec90df29b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:39.694073 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4736c9a-c7de-4493-a7c9-954ec90df29b None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:39.701683 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 572/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:48:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:39.707337 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62ccf4-f6e6-42ef-87f4-b78ecd84b01f None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:39.808261 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62ccf4-f6e6-42ef-87f4-b78ecd84b01f None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:39.839506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66254263-eab3-4062-a367-e3e0f2234f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:39.840392 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66254263-eab3-4062-a367-e3e0f2234f06 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:39.840674 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66254263-eab3-4062-a367-e3e0f2234f06 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:39.840949 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66254263-eab3-4062-a367-e3e0f2234f06 None admin] PATH_INFO: `/v3/users/3a0fe704254447a58006af7404b7a7cd` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:39.853870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66254263-eab3-4062-a367-e3e0f2234f06 None admin] RBAC: Authorizing `identity:get_user(user_id=3a0fe704254447a58006af7404b7a7cd)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:39.855285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66254263-eab3-4062-a367-e3e0f2234f06 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:39.856945 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 610/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:48:39 2022] GET /identity/v3/users/3a0fe704254447a58006af7404b7a7cd => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:39.862699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4736c9a-c7de-4493-a7c9-954ec90df29b None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:39.956973 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4736c9a-c7de-4493-a7c9-954ec90df29b None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:39.987959 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e596f7b-98cc-40e4-b0a2-2414156ceb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:39.988608 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e596f7b-98cc-40e4-b0a2-2414156ceb38 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:39.988884 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e596f7b-98cc-40e4-b0a2-2414156ceb38 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:39.989151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e596f7b-98cc-40e4-b0a2-2414156ceb38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:40.050829 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e596f7b-98cc-40e4-b0a2-2414156ceb38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:40.052271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e596f7b-98cc-40e4-b0a2-2414156ceb38 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:40.142420 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 573/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:48:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:48:40.148290 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66254263-eab3-4062-a367-e3e0f2234f06 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:40.241841 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66254263-eab3-4062-a367-e3e0f2234f06 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:40.277052 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0611200-c426-44ca-b5f3-5ce29c8117c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:40.277916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0611200-c426-44ca-b5f3-5ce29c8117c4 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:40.278197 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0611200-c426-44ca-b5f3-5ce29c8117c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:40.278472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0611200-c426-44ca-b5f3-5ce29c8117c4 None admin] PATH_INFO: `/v3/projects/6d1023b6ed7c45c9a9935742518db242` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:40.279886 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0611200-c426-44ca-b5f3-5ce29c8117c4 None admin] RBAC: Authorizing `identity:get_project(project_id=6d1023b6ed7c45c9a9935742518db242)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:40.281330 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0611200-c426-44ca-b5f3-5ce29c8117c4 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:40.283673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 611/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:48:40 2022] GET /identity/v3/projects/6d1023b6ed7c45c9a9935742518db242 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:40.290039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e596f7b-98cc-40e4-b0a2-2414156ceb38 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:40.383024 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e596f7b-98cc-40e4-b0a2-2414156ceb38 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:40.415641 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c05147-0e93-4cee-97f7-15680d4e6a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:40.416247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c05147-0e93-4cee-97f7-15680d4e6a53 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:40.416530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c05147-0e93-4cee-97f7-15680d4e6a53 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:40.416801 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c05147-0e93-4cee-97f7-15680d4e6a53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:40.417622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c05147-0e93-4cee-97f7-15680d4e6a53 None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=6d1023b6ed7c45c9a9935742518db242, user.id=3a0fe704254447a58006af7404b7a7cd) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:40.417931 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c05147-0e93-4cee-97f7-15680d4e6a53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:40.419354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c05147-0e93-4cee-97f7-15680d4e6a53 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:40.425120 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 574/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:48:40 2022] GET /identity/v3/role_assignments?user.id=3a0fe704254447a58006af7404b7a7cd&scope.project.id=6d1023b6ed7c45c9a9935742518db242&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:42.628182 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c533-c587-4737-9b6f-7bfb90c9ca3b None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:42.628709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c533-c587-4737-9b6f-7bfb90c9ca3b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:42.628799 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c533-c587-4737-9b6f-7bfb90c9ca3b None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:42.630126 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 612/1186] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:42.635636 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf6d67-ef55-4e8a-8dcc-48c50ffe99fc None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:42.636058 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf6d67-ef55-4e8a-8dcc-48c50ffe99fc None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:42.636191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf6d67-ef55-4e8a-8dcc-48c50ffe99fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:42.652158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-48cf6d67-ef55-4e8a-8dcc-48c50ffe99fc None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:42.653348 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-48cf6d67-ef55-4e8a-8dcc-48c50ffe99fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:42.716325 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 575/1187] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:48:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:48:42.739095 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974c533-c587-4737-9b6f-7bfb90c9ca3b None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:42.834312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974c533-c587-4737-9b6f-7bfb90c9ca3b None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:42.865781 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c7014-fdd1-4f70-addb-eb4a8733eb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:42.866549 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c7014-fdd1-4f70-addb-eb4a8733eb40 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:42.866829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c7014-fdd1-4f70-addb-eb4a8733eb40 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:42.867105 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c7014-fdd1-4f70-addb-eb4a8733eb40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:42.876644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c7014-fdd1-4f70-addb-eb4a8733eb40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:42.884236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-974c7014-fdd1-4f70-addb-eb4a8733eb40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:42.884236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:42.884236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:42.884236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:42.884236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:42.884236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:42.884236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:42.884236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:42.884236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:42.884236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:42.884236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:42.884236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:42.884236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:42.884236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:42.884236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:42.884236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:42.885291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:42.885291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:42.885291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:42.885291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:42.885291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:42.885291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:42.885291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:42.885291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:42.885291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:42.885291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:42.885291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:42.885291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:48:42.885291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:42.885291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:42.885291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:42.885291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:42.886623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:42.886623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:42.886623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:42.886623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:42.886623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:42.886623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:42.886623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:42.886623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:42.886623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:42.886623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:42.886623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:42.886623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:48:42.886623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 613/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:48:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:42.891168 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf6d67-ef55-4e8a-8dcc-48c50ffe99fc None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:42.986091 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf6d67-ef55-4e8a-8dcc-48c50ffe99fc None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:43.017849 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee5753-435d-4160-b056-49909b6b4ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:43.018490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee5753-435d-4160-b056-49909b6b4ba3 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:43.018769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee5753-435d-4160-b056-49909b6b4ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:43.019039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee5753-435d-4160-b056-49909b6b4ba3 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:43.019770 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee5753-435d-4160-b056-49909b6b4ba3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:43.020074 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee5753-435d-4160-b056-49909b6b4ba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:43.021455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee5753-435d-4160-b056-49909b6b4ba3 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:43.029355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 576/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:48:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:43.035194 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c7014-fdd1-4f70-addb-eb4a8733eb40 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:43.129388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c7014-fdd1-4f70-addb-eb4a8733eb40 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:43.160524 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1577e-c46f-49d7-9f63-379fcfa6e46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:43.161317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1577e-c46f-49d7-9f63-379fcfa6e46b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:43.161595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1577e-c46f-49d7-9f63-379fcfa6e46b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:43.161866 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1577e-c46f-49d7-9f63-379fcfa6e46b None admin] PATH_INFO: `/v3/users/3a0fe704254447a58006af7404b7a7cd` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:43.163034 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1577e-c46f-49d7-9f63-379fcfa6e46b None admin] RBAC: Authorizing `identity:get_user(user_id=3a0fe704254447a58006af7404b7a7cd)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:43.164465 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1577e-c46f-49d7-9f63-379fcfa6e46b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:43.166050 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 614/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:48:43 2022] GET /identity/v3/users/3a0fe704254447a58006af7404b7a7cd => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:43.171671 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee5753-435d-4160-b056-49909b6b4ba3 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:43.265352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee5753-435d-4160-b056-49909b6b4ba3 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:43.296902 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7e3e1-4bc3-40af-bcb8-402698994a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:43.298261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7e3e1-4bc3-40af-bcb8-402698994a0e None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:43.298540 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7e3e1-4bc3-40af-bcb8-402698994a0e None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:43.298809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7e3e1-4bc3-40af-bcb8-402698994a0e None admin] PATH_INFO: `/v3/projects/6d1023b6ed7c45c9a9935742518db242` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:43.299967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7e3e1-4bc3-40af-bcb8-402698994a0e None admin] RBAC: Authorizing `identity:get_project(project_id=6d1023b6ed7c45c9a9935742518db242)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:43.301402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7e3e1-4bc3-40af-bcb8-402698994a0e None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:43.303053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 577/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:48:43 2022] GET /identity/v3/projects/6d1023b6ed7c45c9a9935742518db242 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:43.308754 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1577e-c46f-49d7-9f63-379fcfa6e46b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:43.400473 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1577e-c46f-49d7-9f63-379fcfa6e46b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:43.432229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be92723-8c83-4ea4-9f9a-a8bba7dd9009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:43.433061 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92723-8c83-4ea4-9f9a-a8bba7dd9009 None admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:43.433337 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92723-8c83-4ea4-9f9a-a8bba7dd9009 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:43.433602 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92723-8c83-4ea4-9f9a-a8bba7dd9009 None admin] PATH_INFO: `/v3/projects/6d1023b6ed7c45c9a9935742518db242/users/3a0fe704254447a58006af7404b7a7cd/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:43.435503 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be92723-8c83-4ea4-9f9a-a8bba7dd9009 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d1023b6ed7c45c9a9935742518db242, user_id=3a0fe704254447a58006af7404b7a7cd, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:43.436980 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be92723-8c83-4ea4-9f9a-a8bba7dd9009 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:43.448862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 615/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:48:43 2022] PUT /identity/v3/projects/6d1023b6ed7c45c9a9935742518db242/users/3a0fe704254447a58006af7404b7a7cd/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:48:45.630705 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afa52d-db69-4ce8-b060-38a08c6e4068 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:45.631218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afa52d-db69-4ce8-b060-38a08c6e4068 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:45.631309 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afa52d-db69-4ce8-b060-38a08c6e4068 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:45.632703 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 578/1193] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:48:45.637884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df66fb-e512-47c6-851a-57efd3868ff2 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:45.638270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df66fb-e512-47c6-851a-57efd3868ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:45.638440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df66fb-e512-47c6-851a-57efd3868ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:45.655401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-57df66fb-e512-47c6-851a-57efd3868ff2 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:48:45.656585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-57df66fb-e512-47c6-851a-57efd3868ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:48:45.718565 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 616/1194] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:48:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:48:45.741046 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afa52d-db69-4ce8-b060-38a08c6e4068 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:45.837545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afa52d-db69-4ce8-b060-38a08c6e4068 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:45.868735 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec0147-27b3-4ca8-b296-f1f73cfad277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:45.869498 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec0147-27b3-4ca8-b296-f1f73cfad277 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:45.869774 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec0147-27b3-4ca8-b296-f1f73cfad277 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:45.870042 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec0147-27b3-4ca8-b296-f1f73cfad277 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:45.880504 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec0147-27b3-4ca8-b296-f1f73cfad277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:48:45.887897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-a6ec0147-27b3-4ca8-b296-f1f73cfad277 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:45.887897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:48:45.887897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:48:45.887897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:48:45.887897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:48:45.887897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:48:45.887897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:48:45.887897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:48:45.887897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:48:45.887897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:48:45.887897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:48:45.887897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:48:45.887897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:48:45.887897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:48:45.887897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:48:45.887897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:48:45.889033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:48:45.889033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:48:45.889033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:48:45.889033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:48:45.889033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:48:45.889033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:48:45.889033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:48:45.889033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:48:45.889033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:48:45.889033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:48:45.889033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:48:45.889033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:48:45.889033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:48:45.889033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:48:45.889033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:48:45.889033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:48:45.890366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:48:45.890366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:48:45.890366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:48:45.890366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:48:45.890366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:48:45.890366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:48:45.890366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:48:45.890366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:48:45.890366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:48:45.890366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:48:45.890366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:48:45.890366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:48:45.890366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 579/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:48:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:48:45.895053 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df66fb-e512-47c6-851a-57efd3868ff2 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:45.986361 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df66fb-e512-47c6-851a-57efd3868ff2 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:46.017960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c3006-4079-46c2-9f81-e9deae6a3375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:46.018612 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c3006-4079-46c2-9f81-e9deae6a3375 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:46.018889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c3006-4079-46c2-9f81-e9deae6a3375 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:46.019159 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c3006-4079-46c2-9f81-e9deae6a3375 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:46.019885 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c3006-4079-46c2-9f81-e9deae6a3375 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:46.020213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c3006-4079-46c2-9f81-e9deae6a3375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:46.021555 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c3006-4079-46c2-9f81-e9deae6a3375 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:46.029469 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 617/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:48:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:46.035040 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec0147-27b3-4ca8-b296-f1f73cfad277 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:46.127929 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec0147-27b3-4ca8-b296-f1f73cfad277 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:46.158758 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef6912-cdc5-4fd4-9ecb-0eeb9f7aac75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:46.159522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef6912-cdc5-4fd4-9ecb-0eeb9f7aac75 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:46.159795 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef6912-cdc5-4fd4-9ecb-0eeb9f7aac75 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:46.160057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef6912-cdc5-4fd4-9ecb-0eeb9f7aac75 None admin] PATH_INFO: `/v3/users/3a0fe704254447a58006af7404b7a7cd` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:46.161237 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef6912-cdc5-4fd4-9ecb-0eeb9f7aac75 None admin] RBAC: Authorizing `identity:get_user(user_id=3a0fe704254447a58006af7404b7a7cd)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:46.162650 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef6912-cdc5-4fd4-9ecb-0eeb9f7aac75 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:46.164227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 580/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 13:48:46 2022] GET /identity/v3/users/3a0fe704254447a58006af7404b7a7cd => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:46.169674 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c3006-4079-46c2-9f81-e9deae6a3375 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:46.262953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c3006-4079-46c2-9f81-e9deae6a3375 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:46.294441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8951a7-4236-497d-a23b-b49a9920b134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:46.295065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8951a7-4236-497d-a23b-b49a9920b134 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:46.295345 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8951a7-4236-497d-a23b-b49a9920b134 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:46.295617 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8951a7-4236-497d-a23b-b49a9920b134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:46.357296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8951a7-4236-497d-a23b-b49a9920b134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:46.358697 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8951a7-4236-497d-a23b-b49a9920b134 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:46.454780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 618/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:48:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:48:46.460522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef6912-cdc5-4fd4-9ecb-0eeb9f7aac75 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:46.553296 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef6912-cdc5-4fd4-9ecb-0eeb9f7aac75 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:46.584686 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf37e2f-ce71-46e4-8d6a-6a419274c547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:46.585517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf37e2f-ce71-46e4-8d6a-6a419274c547 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:46.585793 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf37e2f-ce71-46e4-8d6a-6a419274c547 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:46.586061 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf37e2f-ce71-46e4-8d6a-6a419274c547 None admin] PATH_INFO: `/v3/projects/6d1023b6ed7c45c9a9935742518db242` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:46.587209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf37e2f-ce71-46e4-8d6a-6a419274c547 None admin] RBAC: Authorizing `identity:get_project(project_id=6d1023b6ed7c45c9a9935742518db242)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:46.588732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf37e2f-ce71-46e4-8d6a-6a419274c547 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:46.590390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 581/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 13:48:46 2022] GET /identity/v3/projects/6d1023b6ed7c45c9a9935742518db242 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:48:46.596426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8951a7-4236-497d-a23b-b49a9920b134 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:48:46.687842 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8951a7-4236-497d-a23b-b49a9920b134 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:48:46.720138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3f537-82c6-4677-af21-7bbb119ac2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:48:46.720745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3f537-82c6-4677-af21-7bbb119ac2a2 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:48:46.721016 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3f537-82c6-4677-af21-7bbb119ac2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:48:46.721279 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3f537-82c6-4677-af21-7bbb119ac2a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:48:46.722078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3f537-82c6-4677-af21-7bbb119ac2a2 None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=6d1023b6ed7c45c9a9935742518db242, user.id=3a0fe704254447a58006af7404b7a7cd) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:48:46.722379 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3f537-82c6-4677-af21-7bbb119ac2a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:48:46.723754 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3f537-82c6-4677-af21-7bbb119ac2a2 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:48:46.729231 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 619/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:48:46 2022] GET /identity/v3/role_assignments?user.id=3a0fe704254447a58006af7404b7a7cd&scope.project.id=6d1023b6ed7c45c9a9935742518db242&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:47.018228 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea2f1a-8b6f-40e0-b9d0-5ec3ea4362e8 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:47.020972 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea2f1a-8b6f-40e0-b9d0-5ec3ea4362e8 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:47.020972 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea2f1a-8b6f-40e0-b9d0-5ec3ea4362e8 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:47.021493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 582/1201] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:47.027039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fac460-abf8-4392-8969-af9ec3cb9b6e None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:47.027617 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fac460-abf8-4392-8969-af9ec3cb9b6e None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:47.027617 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fac460-abf8-4392-8969-af9ec3cb9b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:47.051007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-c3fac460-abf8-4392-8969-af9ec3cb9b6e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:47.052608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c3fac460-abf8-4392-8969-af9ec3cb9b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:47.139121 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 620/1202] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:49:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:47.167883 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea2f1a-8b6f-40e0-b9d0-5ec3ea4362e8 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:47.286958 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea2f1a-8b6f-40e0-b9d0-5ec3ea4362e8 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:47.327042 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d42f0d-1787-4f48-8564-eb6387cc03bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:47.328075 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d42f0d-1787-4f48-8564-eb6387cc03bc None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:47.328421 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d42f0d-1787-4f48-8564-eb6387cc03bc None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:47.328675 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d42f0d-1787-4f48-8564-eb6387cc03bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:47.340626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d42f0d-1787-4f48-8564-eb6387cc03bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:47.342843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d42f0d-1787-4f48-8564-eb6387cc03bc None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:47.363452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-c5d42f0d-1787-4f48-8564-eb6387cc03bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:47.363452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:47.363452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:47.363452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:47.363452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:47.363452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:47.363452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:47.363452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:47.363452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:47.363452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:47.363452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:47.363452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:47.363452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:49:47.363452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:49:47.363452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:49:47.368346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:49:47.368346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:47.368346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:47.368346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:47.368346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:47.368346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:47.368346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:47.368346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:47.368346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:49:47.368346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:47.368346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:47.368346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:47.368346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:47.368346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:47.368346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:47.368346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:47.368346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:47.369600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:49:47.369600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:49:47.369600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:47.369600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:49:47.369600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 583/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:49:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:47.370912 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fac460-abf8-4392-8969-af9ec3cb9b6e None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:47.490257 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fac460-abf8-4392-8969-af9ec3cb9b6e None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:47.527028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cdb90-a9d8-41b9-b2c4-de6a7f9ce806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:47.528079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cdb90-a9d8-41b9-b2c4-de6a7f9ce806 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:47.528368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cdb90-a9d8-41b9-b2c4-de6a7f9ce806 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:47.528727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cdb90-a9d8-41b9-b2c4-de6a7f9ce806 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:47.529505 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cdb90-a9d8-41b9-b2c4-de6a7f9ce806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:47.529829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cdb90-a9d8-41b9-b2c4-de6a7f9ce806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:47.531261 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cdb90-a9d8-41b9-b2c4-de6a7f9ce806 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:47.548647 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 621/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:47.550056 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d42f0d-1787-4f48-8564-eb6387cc03bc None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:47.667655 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d42f0d-1787-4f48-8564-eb6387cc03bc None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:47.706591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3143bb-008a-47de-8d94-4b538b4ad42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:47.707268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3143bb-008a-47de-8d94-4b538b4ad42f None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:47.707578 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3143bb-008a-47de-8d94-4b538b4ad42f None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:47.707849 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3143bb-008a-47de-8d94-4b538b4ad42f None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:47.708604 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3143bb-008a-47de-8d94-4b538b4ad42f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:47.710184 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3143bb-008a-47de-8d94-4b538b4ad42f None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:47.732581 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 584/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 13:49:47 2022] POST /identity/v3/users => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:49:50.165436 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e88bf6-2ff4-4291-9af8-b564d107747d None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:50.166068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e88bf6-2ff4-4291-9af8-b564d107747d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:50.166068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e88bf6-2ff4-4291-9af8-b564d107747d None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:50.167618 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 622/1206] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:50.173702 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5327048-f331-452c-8c33-aab16ebf6f93 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:50.174145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5327048-f331-452c-8c33-aab16ebf6f93 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:50.174242 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5327048-f331-452c-8c33-aab16ebf6f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:50.192366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-d5327048-f331-452c-8c33-aab16ebf6f93 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:50.193599 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d5327048-f331-452c-8c33-aab16ebf6f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:50.267556 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 585/1207] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:49:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:50.294419 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e88bf6-2ff4-4291-9af8-b564d107747d None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:50.407112 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e88bf6-2ff4-4291-9af8-b564d107747d None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:50.444079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a477671-149f-448c-8ce7-0bad1228d8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:50.444905 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a477671-149f-448c-8ce7-0bad1228d8c1 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:50.445162 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a477671-149f-448c-8ce7-0bad1228d8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:50.445475 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a477671-149f-448c-8ce7-0bad1228d8c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:50.456443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a477671-149f-448c-8ce7-0bad1228d8c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:49:50.464312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-3a477671-149f-448c-8ce7-0bad1228d8c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:49:50.464312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:50.464312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:50.464312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:50.464312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:50.464312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:50.464312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:50.464312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:50.464312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:50.464312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:50.464312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:50.464312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:50.464312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:49:50.464312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:49:50.464312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:49:50.464312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:49:50.465331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:49:50.465331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:49:50.465331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:49:50.465331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:49:50.465331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:50.465331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:50.465331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:50.465331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:50.465331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:50.465331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:50.465331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:50.465331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:49:50.465331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:50.465331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:50.465331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:50.465331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:50.466280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:50.466280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:50.466280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:50.466280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:50.466280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:49:50.466280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:49:50.466280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:49:50.466280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:49:50.466280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:49:50.466280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:49:50.466280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:49:50.466280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:49:50.466280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 623/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:49:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:50.471666 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5327048-f331-452c-8c33-aab16ebf6f93 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:50.582261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5327048-f331-452c-8c33-aab16ebf6f93 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:50.620037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4db0f-6f4f-4673-8fed-1863e6f63319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:50.620818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4db0f-6f4f-4673-8fed-1863e6f63319 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:50.621135 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4db0f-6f4f-4673-8fed-1863e6f63319 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:50.621412 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4db0f-6f4f-4673-8fed-1863e6f63319 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:50.622221 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4db0f-6f4f-4673-8fed-1863e6f63319 None admin] RBAC: Adding query filter params (name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:50.623106 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4db0f-6f4f-4673-8fed-1863e6f63319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:50.624555 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4db0f-6f4f-4673-8fed-1863e6f63319 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:50.633324 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 586/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:49:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:50.638947 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a477671-149f-448c-8ce7-0bad1228d8c1 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:50.744133 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a477671-149f-448c-8ce7-0bad1228d8c1 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:50.785541 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879f494-f1e9-4876-8871-07ce12586c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:50.786372 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879f494-f1e9-4876-8871-07ce12586c23 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:50.786641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879f494-f1e9-4876-8871-07ce12586c23 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:50.786912 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879f494-f1e9-4876-8871-07ce12586c23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:50.801458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879f494-f1e9-4876-8871-07ce12586c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:50.803086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879f494-f1e9-4876-8871-07ce12586c23 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:50.822272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-c879f494-f1e9-4876-8871-07ce12586c23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:50.822272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:50.822272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:50.822272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:50.822272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:50.822272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:50.822272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:50.822272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:50.822272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:50.822272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:50.822272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:50.822272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:50.822272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:49:50.822272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:49:50.822272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:49:50.823482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:49:50.823482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:50.823482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:50.823482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:50.823482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:50.823482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:50.823482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:50.823482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:50.823482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:49:50.823482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:50.823482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:50.823482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:50.823482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:50.823482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:50.823482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:50.823482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:50.823482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:50.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:49:50.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:49:50.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:50.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:49:50.824464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 624/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:49:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:49:50.830264 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4db0f-6f4f-4673-8fed-1863e6f63319 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:50.953011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4db0f-6f4f-4673-8fed-1863e6f63319 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:50.988841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079e9b6-a4e2-4ea2-9c6b-a62d42b1d6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:50.989544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079e9b6-a4e2-4ea2-9c6b-a62d42b1d6b1 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:50.989883 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079e9b6-a4e2-4ea2-9c6b-a62d42b1d6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:50.990162 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079e9b6-a4e2-4ea2-9c6b-a62d42b1d6b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:50.990967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079e9b6-a4e2-4ea2-9c6b-a62d42b1d6b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:50.991298 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079e9b6-a4e2-4ea2-9c6b-a62d42b1d6b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:50.992816 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079e9b6-a4e2-4ea2-9c6b-a62d42b1d6b1 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:51.011848 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879f494-f1e9-4876-8871-07ce12586c23 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:51.014215 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 587/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:51.125306 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879f494-f1e9-4876-8871-07ce12586c23 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:51.166268 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dee4c5-bf39-4d8f-b203-2262628fbfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:51.167110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dee4c5-bf39-4d8f-b203-2262628fbfbd None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:51.167388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dee4c5-bf39-4d8f-b203-2262628fbfbd None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:51.167777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dee4c5-bf39-4d8f-b203-2262628fbfbd None admin] PATH_INFO: `/v3/users/placement` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:51.177451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dee4c5-bf39-4d8f-b203-2262628fbfbd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:51.178958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dee4c5-bf39-4d8f-b203-2262628fbfbd None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:51.194277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-22dee4c5-bf39-4d8f-b203-2262628fbfbd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 13:49:51.194277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:51.194277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:51.194277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:51.194277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:51.194277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:51.194277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:51.194277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:51.194277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:51.194277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:51.194277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:51.194277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:51.194277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:49:51.194277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:49:51.194277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:49:51.194277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:51.200652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:51.201884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:51.201884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:51.201884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:49:51.201884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:49:51.201884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:49:51.201884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:49:51.201884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:49:51.201884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:49:51.201884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 13:49:51.201884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:49:51.201884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 625/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:49:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:49:51.202639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079e9b6-a4e2-4ea2-9c6b-a62d42b1d6b1 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:51.315375 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079e9b6-a4e2-4ea2-9c6b-a62d42b1d6b1 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:51.350701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452d9ee-1d6c-4f2e-ac66-c4c0e380cc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:51.355178 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452d9ee-1d6c-4f2e-ac66-c4c0e380cc37 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:51.355178 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452d9ee-1d6c-4f2e-ac66-c4c0e380cc37 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:51.355178 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452d9ee-1d6c-4f2e-ac66-c4c0e380cc37 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:51.355178 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452d9ee-1d6c-4f2e-ac66-c4c0e380cc37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:51.355178 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452d9ee-1d6c-4f2e-ac66-c4c0e380cc37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:51.355178 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452d9ee-1d6c-4f2e-ac66-c4c0e380cc37 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:51.375257 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 588/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Tue May 10 13:49:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:51.382217 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dee4c5-bf39-4d8f-b203-2262628fbfbd None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:51.487282 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dee4c5-bf39-4d8f-b203-2262628fbfbd None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:51.525393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343547d5-9509-422a-81d3-2b4bdba2aa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:51.526607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343547d5-9509-422a-81d3-2b4bdba2aa51 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:51.526607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343547d5-9509-422a-81d3-2b4bdba2aa51 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:51.526955 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343547d5-9509-422a-81d3-2b4bdba2aa51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:51.600835 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343547d5-9509-422a-81d3-2b4bdba2aa51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:51.602498 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343547d5-9509-422a-81d3-2b4bdba2aa51 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:51.711765 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 626/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:49:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:49:51.718273 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452d9ee-1d6c-4f2e-ac66-c4c0e380cc37 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:51.832671 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452d9ee-1d6c-4f2e-ac66-c4c0e380cc37 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:51.870874 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f39eb-a0d2-4de7-8fb8-80ae57c84911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:51.871806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f39eb-a0d2-4de7-8fb8-80ae57c84911 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:51.872202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f39eb-a0d2-4de7-8fb8-80ae57c84911 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:51.873016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f39eb-a0d2-4de7-8fb8-80ae57c84911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:51.884385 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f39eb-a0d2-4de7-8fb8-80ae57c84911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:51.886606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f39eb-a0d2-4de7-8fb8-80ae57c84911 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:51.906840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-167f39eb-a0d2-4de7-8fb8-80ae57c84911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:51.906840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:51.906840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:51.906840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:51.906840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:51.906840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:51.906840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:51.906840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:51.906840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:51.906840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:51.906840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:51.906840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:51.906840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:49:51.906840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:49:51.906840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:49:51.908144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:49:51.908144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:51.908144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:51.908144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:51.908144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:51.908144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:51.908144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:51.908144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:51.908144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:49:51.908144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:51.908144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:51.908144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:51.908144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:51.908144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:51.908144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:51.908144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:51.908144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:51.909278 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:49:51.909278 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:49:51.909278 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:51.909278 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:49:51.909278 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 589/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:49:51.915380 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343547d5-9509-422a-81d3-2b4bdba2aa51 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:52.029208 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343547d5-9509-422a-81d3-2b4bdba2aa51 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:52.065050 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68332d78-6f0f-499f-af1e-7748b69829c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:52.065757 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332d78-6f0f-499f-af1e-7748b69829c2 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:52.066037 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332d78-6f0f-499f-af1e-7748b69829c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:52.066307 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332d78-6f0f-499f-af1e-7748b69829c2 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:52.067020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68332d78-6f0f-499f-af1e-7748b69829c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:52.067323 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68332d78-6f0f-499f-af1e-7748b69829c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:52.068695 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68332d78-6f0f-499f-af1e-7748b69829c2 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:52.080238 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 627/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:52.085815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f39eb-a0d2-4de7-8fb8-80ae57c84911 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:52.191145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f39eb-a0d2-4de7-8fb8-80ae57c84911 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:52.230441 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dcd05-9931-40db-871c-40c590e5992b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:52.232854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dcd05-9931-40db-871c-40c590e5992b None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:52.233615 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dcd05-9931-40db-871c-40c590e5992b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:52.234043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dcd05-9931-40db-871c-40c590e5992b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:52.242934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dcd05-9931-40db-871c-40c590e5992b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:52.244725 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dcd05-9931-40db-871c-40c590e5992b None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:52.261992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-657dcd05-9931-40db-871c-40c590e5992b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:49:52.261992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:52.261992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:52.261992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:52.261992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:52.261992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:52.261992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:52.261992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:52.261992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:52.261992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:52.261992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:52.261992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:52.261992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:49:52.261992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:49:52.261992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:49:52.263199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:49:52.263199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:52.263199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:52.263199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:52.263199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:52.263199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:52.263199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:52.263199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:52.263199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:49:52.263199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:52.263199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:52.263199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:52.263199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:52.263199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:52.263199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:52.263199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:52.263199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:52.264360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:49:52.264360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:49:52.264360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:49:52.264360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:49:52.264360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:49:52.264360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:49:52.264360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:49:52.264360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:49:52.266067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 590/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:49:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:52.272410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68332d78-6f0f-499f-af1e-7748b69829c2 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:52.380597 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68332d78-6f0f-499f-af1e-7748b69829c2 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:52.418995 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bbe14-7f19-49e8-8f4a-bc09e3f23726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:52.420352 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bbe14-7f19-49e8-8f4a-bc09e3f23726 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:52.420701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bbe14-7f19-49e8-8f4a-bc09e3f23726 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:52.421048 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bbe14-7f19-49e8-8f4a-bc09e3f23726 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:52.421907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bbe14-7f19-49e8-8f4a-bc09e3f23726 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:52.422291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bbe14-7f19-49e8-8f4a-bc09e3f23726 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:52.423803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bbe14-7f19-49e8-8f4a-bc09e3f23726 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:52.441361 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 628/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:49:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:52.442976 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dcd05-9931-40db-871c-40c590e5992b None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:52.546749 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dcd05-9931-40db-871c-40c590e5992b None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:52.579600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db993c1-7911-4088-854c-70b589eeac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:52.580288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db993c1-7911-4088-854c-70b589eeac63 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:52.580570 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db993c1-7911-4088-854c-70b589eeac63 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:52.580843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db993c1-7911-4088-854c-70b589eeac63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:52.581672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db993c1-7911-4088-854c-70b589eeac63 None admin] RBAC: Adding query filter params (role.id=10053e4259ae4b3bbbdbefa96320c937, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=d8a29487b009419dbead4684bcd01cae) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:52.581981 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db993c1-7911-4088-854c-70b589eeac63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:52.583405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db993c1-7911-4088-854c-70b589eeac63 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:52.588865 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 591/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:49:52 2022] GET /identity/v3/role_assignments?user.id=d8a29487b009419dbead4684bcd01cae&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=10053e4259ae4b3bbbdbefa96320c937 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:54.924367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7917cfc-cd5d-452a-95da-db7bce34ece4 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:54.925039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7917cfc-cd5d-452a-95da-db7bce34ece4 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:54.925039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7917cfc-cd5d-452a-95da-db7bce34ece4 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:54.926313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 629/1220] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:54.932330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f230334-e9bc-4de6-a9d4-5e62acfc92b1 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:54.932857 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f230334-e9bc-4de6-a9d4-5e62acfc92b1 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:54.932941 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f230334-e9bc-4de6-a9d4-5e62acfc92b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:54.954274 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-8f230334-e9bc-4de6-a9d4-5e62acfc92b1 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:54.955835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8f230334-e9bc-4de6-a9d4-5e62acfc92b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:55.040810 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 592/1221] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:49:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:49:55.064897 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7917cfc-cd5d-452a-95da-db7bce34ece4 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:55.176634 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7917cfc-cd5d-452a-95da-db7bce34ece4 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:55.212064 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61d94d-b268-4c7f-be29-2ec326ef0774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:55.213001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d94d-b268-4c7f-be29-2ec326ef0774 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:55.213353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d94d-b268-4c7f-be29-2ec326ef0774 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:55.213652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d94d-b268-4c7f-be29-2ec326ef0774 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:55.226224 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61d94d-b268-4c7f-be29-2ec326ef0774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:49:55.235817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-7e61d94d-b268-4c7f-be29-2ec326ef0774 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:49:55.235817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:55.235817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:55.235817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:55.235817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:55.235817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:55.235817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:55.235817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:55.235817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:55.235817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:55.235817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:55.235817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:55.235817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:49:55.235817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:49:55.235817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:49:55.235817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:49:55.237318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:49:55.237318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:49:55.237318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:49:55.237318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:49:55.237318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:55.237318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:55.237318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:55.237318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:55.237318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:55.237318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:55.237318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:55.237318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:49:55.237318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:55.237318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:55.237318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:55.237318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:55.238193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:55.238193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:55.238193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:55.238193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:55.238193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:49:55.238193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:49:55.238193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:49:55.238193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:49:55.238193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:49:55.238193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:49:55.238193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:49:55.238193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:49:55.238193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 630/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:49:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:55.243247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f230334-e9bc-4de6-a9d4-5e62acfc92b1 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:55.348882 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f230334-e9bc-4de6-a9d4-5e62acfc92b1 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:55.387947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c73044-c855-465c-a643-422eff3ad371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:55.389678 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c73044-c855-465c-a643-422eff3ad371 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:55.389678 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c73044-c855-465c-a643-422eff3ad371 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:55.389678 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c73044-c855-465c-a643-422eff3ad371 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:55.392707 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c73044-c855-465c-a643-422eff3ad371 None admin] RBAC: Adding query filter params (name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:55.392707 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c73044-c855-465c-a643-422eff3ad371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:55.392707 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c73044-c855-465c-a643-422eff3ad371 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:55.401234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 593/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:49:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:55.408498 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61d94d-b268-4c7f-be29-2ec326ef0774 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:55.521178 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61d94d-b268-4c7f-be29-2ec326ef0774 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:55.556752 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1268cf7-f585-4b6f-973c-6634e7c7a148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:55.557593 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1268cf7-f585-4b6f-973c-6634e7c7a148 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:55.557870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1268cf7-f585-4b6f-973c-6634e7c7a148 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:55.558137 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1268cf7-f585-4b6f-973c-6634e7c7a148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:55.571208 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1268cf7-f585-4b6f-973c-6634e7c7a148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:55.572670 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1268cf7-f585-4b6f-973c-6634e7c7a148 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:55.588909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-d1268cf7-f585-4b6f-973c-6634e7c7a148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:55.588909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:55.588909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:55.588909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:55.588909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:55.588909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:55.588909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:55.588909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:55.588909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:55.588909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:55.588909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:55.588909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:55.588909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:49:55.588909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:49:55.588909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:49:55.590209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:49:55.590209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:55.590209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:55.590209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:55.590209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:55.590209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:55.590209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:55.590209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:55.590209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:49:55.590209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:55.590209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:55.590209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:55.590209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:55.590209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:55.590209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:55.590209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:55.590209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:55.592024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:49:55.592024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:49:55.592024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:55.592024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:49:55.592024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 631/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:55.598524 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c73044-c855-465c-a643-422eff3ad371 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:55.704678 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c73044-c855-465c-a643-422eff3ad371 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:55.742713 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63565c-4769-4c05-96d9-dfe440bfc55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:55.743365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63565c-4769-4c05-96d9-dfe440bfc55b None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:55.743645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63565c-4769-4c05-96d9-dfe440bfc55b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:55.743921 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63565c-4769-4c05-96d9-dfe440bfc55b None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:55.744665 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63565c-4769-4c05-96d9-dfe440bfc55b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:55.744970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63565c-4769-4c05-96d9-dfe440bfc55b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:55.746331 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63565c-4769-4c05-96d9-dfe440bfc55b None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:55.757793 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 594/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:49:55.764235 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1268cf7-f585-4b6f-973c-6634e7c7a148 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:55.869037 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1268cf7-f585-4b6f-973c-6634e7c7a148 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:55.901933 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f35b0-d90b-4800-9a06-461d0c653020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:55.902990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f35b0-d90b-4800-9a06-461d0c653020 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:55.903274 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f35b0-d90b-4800-9a06-461d0c653020 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:55.904122 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f35b0-d90b-4800-9a06-461d0c653020 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:55.911587 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f35b0-d90b-4800-9a06-461d0c653020 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:55.913073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f35b0-d90b-4800-9a06-461d0c653020 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:55.928014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-389f35b0-d90b-4800-9a06-461d0c653020 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 13:49:55.928014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:55.928014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:55.928014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:55.928014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:55.928014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:55.928014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:55.928014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:55.928014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:55.928014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:55.928014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:55.928014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:55.928014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:49:55.928014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:49:55.928014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:49:55.928014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:55.929665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:55.930750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:55.930750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:55.930750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:49:55.930750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:49:55.930750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:49:55.930750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:49:55.930750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:49:55.930750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:49:55.930750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 13:49:55.930750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:49:55.935511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63565c-4769-4c05-96d9-dfe440bfc55b None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:55.935960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 632/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:49:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:56.047644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63565c-4769-4c05-96d9-dfe440bfc55b None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:56.089347 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4cf6b-f59c-4a40-b489-1d82028a3a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:56.090011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4cf6b-f59c-4a40-b489-1d82028a3a7e None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:56.090289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4cf6b-f59c-4a40-b489-1d82028a3a7e None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:56.090563 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4cf6b-f59c-4a40-b489-1d82028a3a7e None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:56.091415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4cf6b-f59c-4a40-b489-1d82028a3a7e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:56.091720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4cf6b-f59c-4a40-b489-1d82028a3a7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:56.093234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4cf6b-f59c-4a40-b489-1d82028a3a7e None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:56.111773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 595/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Tue May 10 13:49:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:56.117621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f35b0-d90b-4800-9a06-461d0c653020 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:56.227174 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f35b0-d90b-4800-9a06-461d0c653020 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:56.264592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c5c63-32da-4e99-b6c9-aefecb61bfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:56.265394 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c5c63-32da-4e99-b6c9-aefecb61bfe6 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:56.265669 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c5c63-32da-4e99-b6c9-aefecb61bfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:56.265945 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c5c63-32da-4e99-b6c9-aefecb61bfe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:56.276669 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c5c63-32da-4e99-b6c9-aefecb61bfe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:56.278938 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c5c63-32da-4e99-b6c9-aefecb61bfe6 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:56.299476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-0f2c5c63-32da-4e99-b6c9-aefecb61bfe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:56.299476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:56.299476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:56.299476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:56.299476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:56.299476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:56.299476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:56.299476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:56.299476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:56.299476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:56.299476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:56.299476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:56.299476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:49:56.299476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:49:56.299476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:49:56.300761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:49:56.300761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:56.300761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:56.300761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:56.300761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:56.300761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:56.300761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:56.300761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:56.300761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:49:56.300761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:56.300761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:56.300761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:56.300761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:56.300761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:56.300761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:56.300761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:56.300761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:56.307339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:49:56.307339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:49:56.307339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:56.307339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:49:56.307339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 633/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:56.307803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4cf6b-f59c-4a40-b489-1d82028a3a7e None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:56.414974 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4cf6b-f59c-4a40-b489-1d82028a3a7e None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:56.450017 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9044e38-fe63-460f-a82b-2c0e2fd4c37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:56.451197 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044e38-fe63-460f-a82b-2c0e2fd4c37d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:56.451471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044e38-fe63-460f-a82b-2c0e2fd4c37d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:56.451763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044e38-fe63-460f-a82b-2c0e2fd4c37d None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:56.452578 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9044e38-fe63-460f-a82b-2c0e2fd4c37d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:56.452938 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9044e38-fe63-460f-a82b-2c0e2fd4c37d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:56.454201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9044e38-fe63-460f-a82b-2c0e2fd4c37d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:56.465807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 596/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:56.472324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c5c63-32da-4e99-b6c9-aefecb61bfe6 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:56.577699 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c5c63-32da-4e99-b6c9-aefecb61bfe6 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:56.618306 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c56a3-fe94-438d-9afd-57622d69e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:56.619174 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c56a3-fe94-438d-9afd-57622d69e149 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:56.619451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c56a3-fe94-438d-9afd-57622d69e149 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:56.619870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c56a3-fe94-438d-9afd-57622d69e149 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:56.632674 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c56a3-fe94-438d-9afd-57622d69e149 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:56.634321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c56a3-fe94-438d-9afd-57622d69e149 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:56.651298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-3c2c56a3-fe94-438d-9afd-57622d69e149 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:49:56.651298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:56.651298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:56.651298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:56.651298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:56.651298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:56.651298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:56.651298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:56.651298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:56.651298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:56.651298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:56.651298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:56.651298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:49:56.651298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:49:56.651298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:49:56.652861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:49:56.652861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:56.652861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:56.652861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:56.652861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:56.652861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:56.652861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:56.652861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:56.652861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:49:56.652861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:56.652861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:56.652861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:56.652861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:56.652861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:56.652861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:56.652861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:56.652861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:56.654570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:49:56.654570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:49:56.654570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:49:56.654570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:49:56.654570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:49:56.654570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:49:56.654570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:49:56.654570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:49:56.654570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 634/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:49:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:56.659722 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9044e38-fe63-460f-a82b-2c0e2fd4c37d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:56.769060 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9044e38-fe63-460f-a82b-2c0e2fd4c37d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:56.803895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e5018-6740-48d1-830c-f653de97c684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:56.804829 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e5018-6740-48d1-830c-f653de97c684 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:56.805254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e5018-6740-48d1-830c-f653de97c684 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:56.805716 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e5018-6740-48d1-830c-f653de97c684 None admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:56.806484 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e5018-6740-48d1-830c-f653de97c684 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:56.806790 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e5018-6740-48d1-830c-f653de97c684 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:56.808239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e5018-6740-48d1-830c-f653de97c684 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:56.820391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 597/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:49:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:56.827280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c56a3-fe94-438d-9afd-57622d69e149 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:56.933280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c56a3-fe94-438d-9afd-57622d69e149 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:56.972421 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c26f17-7a73-49cd-adc4-69cd4d4e5a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:56.973474 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c26f17-7a73-49cd-adc4-69cd4d4e5a77 None admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:56.973767 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c26f17-7a73-49cd-adc4-69cd4d4e5a77 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:56.974422 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c26f17-7a73-49cd-adc4-69cd4d4e5a77 None admin] PATH_INFO: `/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/d8a29487b009419dbead4684bcd01cae/roles/10053e4259ae4b3bbbdbefa96320c937` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:56.989979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c26f17-7a73-49cd-adc4-69cd4d4e5a77 None admin] RBAC: Authorizing `identity:create_grant(project_id=9613de9a3bc9461d9d348e5b66b8d684, user_id=d8a29487b009419dbead4684bcd01cae, role_id=10053e4259ae4b3bbbdbefa96320c937)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:56.991392 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c26f17-7a73-49cd-adc4-69cd4d4e5a77 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:57.005875 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 635/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:49:56 2022] PUT /identity/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/d8a29487b009419dbead4684bcd01cae/roles/10053e4259ae4b3bbbdbefa96320c937 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:49:59.263266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf48a19-30ae-46c7-8f4c-61971c46cd66 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:59.263871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf48a19-30ae-46c7-8f4c-61971c46cd66 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:59.263871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf48a19-30ae-46c7-8f4c-61971c46cd66 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:59.265379 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 598/1233] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:49:59.270801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0b163-06e0-4990-b3a6-3bea10cd5301 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:59.271216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0b163-06e0-4990-b3a6-3bea10cd5301 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:59.271347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0b163-06e0-4990-b3a6-3bea10cd5301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:59.288091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-89b0b163-06e0-4990-b3a6-3bea10cd5301 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:49:59.289280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-89b0b163-06e0-4990-b3a6-3bea10cd5301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:49:59.355052 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 636/1234] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:49:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:49:59.379003 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf48a19-30ae-46c7-8f4c-61971c46cd66 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:59.486830 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf48a19-30ae-46c7-8f4c-61971c46cd66 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:59.521625 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e64804-5c26-426c-9518-9707abba452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:59.522381 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e64804-5c26-426c-9518-9707abba452e None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:59.522698 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e64804-5c26-426c-9518-9707abba452e None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:59.522903 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e64804-5c26-426c-9518-9707abba452e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:59.533630 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e64804-5c26-426c-9518-9707abba452e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:49:59.541760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-e9e64804-5c26-426c-9518-9707abba452e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 13:49:59.541760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:59.541760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:59.541760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:59.541760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:59.541760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:59.541760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:59.541760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:59.541760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:59.541760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:59.541760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:59.541760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:59.541760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:49:59.541760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:49:59.541760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:49:59.541760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:49:59.542945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:49:59.542945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:49:59.542945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:49:59.542945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:49:59.542945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:59.542945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:59.542945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:59.542945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:59.542945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:59.542945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:59.542945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:59.542945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:49:59.542945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:59.542945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:59.542945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:59.542945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:59.544917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:59.544917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:59.544917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:59.544917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:59.544917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:49:59.544917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:49:59.544917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:49:59.544917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:49:59.544917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:49:59.544917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:49:59.544917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 13:49:59.544917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:49:59.544917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 599/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 13:49:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:59.550629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0b163-06e0-4990-b3a6-3bea10cd5301 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:59.655186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0b163-06e0-4990-b3a6-3bea10cd5301 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:59.688929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50821bff-4992-4cf1-a146-75055b857d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:59.689598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50821bff-4992-4cf1-a146-75055b857d94 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:59.689881 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50821bff-4992-4cf1-a146-75055b857d94 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:59.690154 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50821bff-4992-4cf1-a146-75055b857d94 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:59.690893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50821bff-4992-4cf1-a146-75055b857d94 None admin] RBAC: Adding query filter params (name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:49:59.691201 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50821bff-4992-4cf1-a146-75055b857d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:59.692644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50821bff-4992-4cf1-a146-75055b857d94 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:59.700523 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 637/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 13:49:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:49:59.706840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e64804-5c26-426c-9518-9707abba452e None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:49:59.811467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e64804-5c26-426c-9518-9707abba452e None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:49:59.848968 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff008b-ac52-40a5-b355-50b13653d176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:49:59.849986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff008b-ac52-40a5-b355-50b13653d176 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:49:59.850269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff008b-ac52-40a5-b355-50b13653d176 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:49:59.850540 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff008b-ac52-40a5-b355-50b13653d176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:49:59.864250 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff008b-ac52-40a5-b355-50b13653d176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:49:59.866004 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff008b-ac52-40a5-b355-50b13653d176 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:49:59.885283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-40ff008b-ac52-40a5-b355-50b13653d176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:59.885283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:49:59.885283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:49:59.885283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:49:59.885283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:49:59.885283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:49:59.885283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:49:59.885283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:49:59.885283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:49:59.885283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:49:59.885283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:49:59.885283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:49:59.885283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:49:59.885283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:49:59.885283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:49:59.886248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:49:59.886248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:49:59.886248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:49:59.886248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:49:59.886248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:49:59.886248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:49:59.886248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:49:59.886248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:49:59.886248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:49:59.886248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:49:59.886248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:49:59.886248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:49:59.886248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:49:59.886248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:49:59.886248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:49:59.886248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:49:59.886248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:49:59.887176 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:49:59.887176 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:49:59.887176 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:49:59.887176 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:49:59.887176 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 600/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:49:59.893065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50821bff-4992-4cf1-a146-75055b857d94 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:00.012189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50821bff-4992-4cf1-a146-75055b857d94 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:00.048147 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183ae2d-7338-4bf2-888e-24961b11f98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:00.048866 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183ae2d-7338-4bf2-888e-24961b11f98e None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:00.049130 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183ae2d-7338-4bf2-888e-24961b11f98e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:00.049398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183ae2d-7338-4bf2-888e-24961b11f98e None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:00.050209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183ae2d-7338-4bf2-888e-24961b11f98e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:00.050596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183ae2d-7338-4bf2-888e-24961b11f98e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:00.052210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183ae2d-7338-4bf2-888e-24961b11f98e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:00.069825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 638/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:00.071037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff008b-ac52-40a5-b355-50b13653d176 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:00.176468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff008b-ac52-40a5-b355-50b13653d176 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:00.210370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44964d9-f098-449c-8555-d6aa423e634a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:00.211160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44964d9-f098-449c-8555-d6aa423e634a None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:00.211438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44964d9-f098-449c-8555-d6aa423e634a None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:00.211710 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44964d9-f098-449c-8555-d6aa423e634a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:00.220534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44964d9-f098-449c-8555-d6aa423e634a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:00.221970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44964d9-f098-449c-8555-d6aa423e634a None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:00.236039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-c44964d9-f098-449c-8555-d6aa423e634a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 13:50:00.236039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:00.236039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:00.236039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:00.236039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:00.236039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:00.236039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:00.236039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:00.236039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:00.236039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:00.236039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:00.236039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:00.236039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:50:00.236039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:50:00.236039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:50:00.236039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:00.237254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:00.238659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:00.238659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:00.238659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:50:00.238659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:50:00.238659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:50:00.238659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:50:00.238659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:50:00.238659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:50:00.238659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 13:50:00.238659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:50:00.243793 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 601/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:50:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:50:00.243909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183ae2d-7338-4bf2-888e-24961b11f98e None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:00.344118 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183ae2d-7338-4bf2-888e-24961b11f98e None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:00.380242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce736b-057e-4a3e-a698-639c61a75fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:00.380934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce736b-057e-4a3e-a698-639c61a75fa3 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:00.381205 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce736b-057e-4a3e-a698-639c61a75fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:00.381478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce736b-057e-4a3e-a698-639c61a75fa3 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:00.382347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce736b-057e-4a3e-a698-639c61a75fa3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:00.382599 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce736b-057e-4a3e-a698-639c61a75fa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:00.384006 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce736b-057e-4a3e-a698-639c61a75fa3 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:00.405780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 639/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Tue May 10 13:50:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:50:00.411238 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44964d9-f098-449c-8555-d6aa423e634a None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:00.517083 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44964d9-f098-449c-8555-d6aa423e634a None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:00.551402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4098d1e-728b-4806-850b-72f52fefbd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:00.552046 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4098d1e-728b-4806-850b-72f52fefbd9c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:00.552357 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4098d1e-728b-4806-850b-72f52fefbd9c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:00.552624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4098d1e-728b-4806-850b-72f52fefbd9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:00.621370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4098d1e-728b-4806-850b-72f52fefbd9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:00.622858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4098d1e-728b-4806-850b-72f52fefbd9c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:00.721842 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 602/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:50:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:50:00.727852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce736b-057e-4a3e-a698-639c61a75fa3 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:00.834365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce736b-057e-4a3e-a698-639c61a75fa3 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:00.869963 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886921b6-081a-4ff1-b9cb-ce725a27f7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:00.870762 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886921b6-081a-4ff1-b9cb-ce725a27f7a3 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:00.871043 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886921b6-081a-4ff1-b9cb-ce725a27f7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:00.871318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886921b6-081a-4ff1-b9cb-ce725a27f7a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:00.881456 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886921b6-081a-4ff1-b9cb-ce725a27f7a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:00.882816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886921b6-081a-4ff1-b9cb-ce725a27f7a3 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:00.900694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-886921b6-081a-4ff1-b9cb-ce725a27f7a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:50:00.900694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:00.900694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:00.900694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:00.900694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:00.900694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:00.900694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:00.900694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:00.900694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:00.900694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:00.900694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:00.900694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:00.900694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:50:00.900694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:50:00.900694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:50:00.901852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:50:00.901852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:00.901852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:00.901852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:00.901852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:00.901852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:00.901852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:00.901852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:00.901852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:50:00.901852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:00.901852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:00.901852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:00.901852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:00.901852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:00.901852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:00.901852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:00.901852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:00.903777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:50:00.903777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:50:00.903777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:50:00.903777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:50:00.903777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 640/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:50:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:00.908637 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4098d1e-728b-4806-850b-72f52fefbd9c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:01.023111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4098d1e-728b-4806-850b-72f52fefbd9c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:01.059820 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ec813-82d7-4994-a7b9-200ff92ec895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:01.060477 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ec813-82d7-4994-a7b9-200ff92ec895 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:01.060753 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ec813-82d7-4994-a7b9-200ff92ec895 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:01.061026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ec813-82d7-4994-a7b9-200ff92ec895 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:01.061735 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ec813-82d7-4994-a7b9-200ff92ec895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:01.062040 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ec813-82d7-4994-a7b9-200ff92ec895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:01.063392 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ec813-82d7-4994-a7b9-200ff92ec895 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:01.074586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 603/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:01.080733 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886921b6-081a-4ff1-b9cb-ce725a27f7a3 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:01.181089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886921b6-081a-4ff1-b9cb-ce725a27f7a3 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:01.218653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3fba8-fb04-45b1-b4be-45b8ac1aeb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:01.219447 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3fba8-fb04-45b1-b4be-45b8ac1aeb21 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:01.219741 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3fba8-fb04-45b1-b4be-45b8ac1aeb21 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:01.219994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3fba8-fb04-45b1-b4be-45b8ac1aeb21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:01.227242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3fba8-fb04-45b1-b4be-45b8ac1aeb21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:01.228757 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3fba8-fb04-45b1-b4be-45b8ac1aeb21 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:01.244909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-7df3fba8-fb04-45b1-b4be-45b8ac1aeb21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:50:01.244909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:01.244909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:01.244909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:01.244909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:01.244909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:01.244909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:01.244909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:01.244909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:01.244909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:01.244909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:01.244909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:01.244909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:50:01.244909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:50:01.244909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:50:01.245953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:50:01.245953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:01.245953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:01.245953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:01.245953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:01.245953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:01.245953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:01.245953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:01.245953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:50:01.245953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:01.245953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:01.245953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:01.245953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:01.245953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:01.245953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:01.245953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:01.245953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:01.246959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:50:01.246959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:50:01.246959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:50:01.246959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:50:01.246959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:50:01.246959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:50:01.246959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:50:01.246959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:50:01.252182 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 641/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:50:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:01.253420 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ec813-82d7-4994-a7b9-200ff92ec895 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:01.358037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ec813-82d7-4994-a7b9-200ff92ec895 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:01.394512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc8c94-866f-480e-bbfa-f62aa6885253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:01.395221 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc8c94-866f-480e-bbfa-f62aa6885253 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:01.395500 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc8c94-866f-480e-bbfa-f62aa6885253 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:01.395777 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc8c94-866f-480e-bbfa-f62aa6885253 None admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:01.396638 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc8c94-866f-480e-bbfa-f62aa6885253 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:01.397037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc8c94-866f-480e-bbfa-f62aa6885253 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:01.398520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc8c94-866f-480e-bbfa-f62aa6885253 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:01.412021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 604/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:50:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:50:01.418708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3fba8-fb04-45b1-b4be-45b8ac1aeb21 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:01.525215 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3fba8-fb04-45b1-b4be-45b8ac1aeb21 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:01.558254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbecdb1-443f-4a27-b5a2-d8ef6386780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:01.558911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbecdb1-443f-4a27-b5a2-d8ef6386780c None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:01.559190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbecdb1-443f-4a27-b5a2-d8ef6386780c None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:01.560041 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbecdb1-443f-4a27-b5a2-d8ef6386780c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:01.560842 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbecdb1-443f-4a27-b5a2-d8ef6386780c None admin] RBAC: Adding query filter params (role.id=10053e4259ae4b3bbbdbefa96320c937, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=d8a29487b009419dbead4684bcd01cae) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:01.561155 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbecdb1-443f-4a27-b5a2-d8ef6386780c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:01.562562 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbecdb1-443f-4a27-b5a2-d8ef6386780c None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:01.568453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 642/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:50:01 2022] GET /identity/v3/role_assignments?user.id=d8a29487b009419dbead4684bcd01cae&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=10053e4259ae4b3bbbdbefa96320c937 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:50:03.904893 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30dac3-782a-498a-9187-7e3f20cbcd91 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:03.905575 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30dac3-782a-498a-9187-7e3f20cbcd91 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:03.905575 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30dac3-782a-498a-9187-7e3f20cbcd91 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:03.906898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 605/1247] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:50:03.912344 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9cb15-9be5-4f4f-a19b-1797d7b6a0ca None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:03.912791 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9cb15-9be5-4f4f-a19b-1797d7b6a0ca None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:03.912894 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9cb15-9be5-4f4f-a19b-1797d7b6a0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:03.931915 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f0d9cb15-9be5-4f4f-a19b-1797d7b6a0ca None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:50:03.933179 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f0d9cb15-9be5-4f4f-a19b-1797d7b6a0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:50:04.023209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 643/1248] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:50:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:50:04.047032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30dac3-782a-498a-9187-7e3f20cbcd91 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:04.154715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30dac3-782a-498a-9187-7e3f20cbcd91 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:04.192082 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98f1a9-103e-4585-b2c0-a938fdebfe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:04.192817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98f1a9-103e-4585-b2c0-a938fdebfe2b None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:04.193195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98f1a9-103e-4585-b2c0-a938fdebfe2b None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:04.193461 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98f1a9-103e-4585-b2c0-a938fdebfe2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:04.204126 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98f1a9-103e-4585-b2c0-a938fdebfe2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:50:04.212550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-0e98f1a9-103e-4585-b2c0-a938fdebfe2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:50:04.212550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:04.212550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:04.212550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:04.212550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:04.212550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:04.212550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:04.212550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:04.212550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:04.212550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:04.212550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:04.212550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:04.212550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:50:04.212550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:50:04.212550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:50:04.212550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:50:04.213817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:50:04.213817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:50:04.213817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:50:04.213817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:50:04.213817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:04.213817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:04.213817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:04.213817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:04.213817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:04.213817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:04.213817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:04.213817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:50:04.213817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:04.213817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:04.213817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:04.213817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:04.214759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:04.214759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:04.214759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:04.214759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:04.214759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:50:04.214759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:50:04.214759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:50:04.214759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:50:04.214759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:50:04.214759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:50:04.214759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:50:04.214759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:50:04.214759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 606/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:50:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:50:04.219966 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9cb15-9be5-4f4f-a19b-1797d7b6a0ca None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:04.330186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9cb15-9be5-4f4f-a19b-1797d7b6a0ca None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:04.367653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac4b3c-785c-4061-b412-d4c7975fdb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:04.368364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac4b3c-785c-4061-b412-d4c7975fdb74 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:04.368681 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac4b3c-785c-4061-b412-d4c7975fdb74 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:04.368951 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac4b3c-785c-4061-b412-d4c7975fdb74 None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:04.369796 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac4b3c-785c-4061-b412-d4c7975fdb74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:04.370119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac4b3c-785c-4061-b412-d4c7975fdb74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:04.371588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac4b3c-785c-4061-b412-d4c7975fdb74 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:04.380927 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 644/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:50:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:50:04.386608 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98f1a9-103e-4585-b2c0-a938fdebfe2b None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:04.508607 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98f1a9-103e-4585-b2c0-a938fdebfe2b None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:04.553630 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041cae3-dd64-4ce5-906f-d34bd3de4a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:04.554520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041cae3-dd64-4ce5-906f-d34bd3de4a74 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:04.554826 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041cae3-dd64-4ce5-906f-d34bd3de4a74 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:04.555075 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041cae3-dd64-4ce5-906f-d34bd3de4a74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:04.568394 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041cae3-dd64-4ce5-906f-d34bd3de4a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:04.569677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041cae3-dd64-4ce5-906f-d34bd3de4a74 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:04.592133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-6041cae3-dd64-4ce5-906f-d34bd3de4a74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:50:04.592133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:04.592133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:04.592133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:04.592133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:04.592133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:04.592133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:04.592133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:04.592133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:04.592133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:04.592133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:04.592133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:04.592133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:50:04.592133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:50:04.592133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:50:04.593427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:50:04.593427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:04.593427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:04.593427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:04.593427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:04.593427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:04.593427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:04.593427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:04.593427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:50:04.593427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:04.593427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:04.593427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:04.593427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:04.593427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:04.593427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:04.593427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:04.593427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:04.594587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:50:04.594587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:50:04.594587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:50:04.594587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:50:04.594587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 607/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:04.600948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac4b3c-785c-4061-b412-d4c7975fdb74 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:04.717741 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac4b3c-785c-4061-b412-d4c7975fdb74 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:04.754942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd0832-26ee-47c7-af62-4ae57d76b3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:04.755612 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd0832-26ee-47c7-af62-4ae57d76b3d9 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:04.755889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd0832-26ee-47c7-af62-4ae57d76b3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:04.756159 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd0832-26ee-47c7-af62-4ae57d76b3d9 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:04.756992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd0832-26ee-47c7-af62-4ae57d76b3d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:04.757293 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd0832-26ee-47c7-af62-4ae57d76b3d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:04.758730 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd0832-26ee-47c7-af62-4ae57d76b3d9 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:04.771854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 645/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:04.777784 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041cae3-dd64-4ce5-906f-d34bd3de4a74 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:04.880971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041cae3-dd64-4ce5-906f-d34bd3de4a74 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:04.919554 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70a5f8-9543-4c86-af4c-4cb9e7b2f1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:04.920399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70a5f8-9543-4c86-af4c-4cb9e7b2f1fd None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:04.920714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70a5f8-9543-4c86-af4c-4cb9e7b2f1fd None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:04.921035 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70a5f8-9543-4c86-af4c-4cb9e7b2f1fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:04.931214 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70a5f8-9543-4c86-af4c-4cb9e7b2f1fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:04.932741 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70a5f8-9543-4c86-af4c-4cb9e7b2f1fd None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:04.947546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-4f70a5f8-9543-4c86-af4c-4cb9e7b2f1fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 13:50:04.947546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:04.947546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:04.947546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:04.947546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:04.947546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:04.947546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:04.947546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:04.947546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:04.947546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:04.947546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:04.947546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:04.947546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:50:04.947546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:50:04.947546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:50:04.947546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:04.948624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:04.954858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:04.954858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:04.954858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:50:04.954858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:50:04.954858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:50:04.954858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:50:04.954858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:50:04.954858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:50:04.954858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 13:50:04.954858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:50:04.954858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 608/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:50:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:04.955483 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd0832-26ee-47c7-af62-4ae57d76b3d9 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:05.063216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd0832-26ee-47c7-af62-4ae57d76b3d9 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:05.101523 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4089927-4bdc-4175-94ac-f9cee2bacf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:05.102186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4089927-4bdc-4175-94ac-f9cee2bacf33 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:05.102470 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4089927-4bdc-4175-94ac-f9cee2bacf33 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:05.102747 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4089927-4bdc-4175-94ac-f9cee2bacf33 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:05.103579 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4089927-4bdc-4175-94ac-f9cee2bacf33 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:05.103883 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4089927-4bdc-4175-94ac-f9cee2bacf33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:05.105356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4089927-4bdc-4175-94ac-f9cee2bacf33 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:05.125731 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 646/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Tue May 10 13:50:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:50:05.131583 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70a5f8-9543-4c86-af4c-4cb9e7b2f1fd None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:05.250271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70a5f8-9543-4c86-af4c-4cb9e7b2f1fd None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:05.289385 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af6c45-df75-4c89-912e-147587142b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:05.290029 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af6c45-df75-4c89-912e-147587142b4d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:05.290449 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af6c45-df75-4c89-912e-147587142b4d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:05.290756 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af6c45-df75-4c89-912e-147587142b4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:05.369797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af6c45-df75-4c89-912e-147587142b4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:05.371427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af6c45-df75-4c89-912e-147587142b4d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:05.475057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 609/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:50:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:50:05.481820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4089927-4bdc-4175-94ac-f9cee2bacf33 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:05.585156 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4089927-4bdc-4175-94ac-f9cee2bacf33 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:05.620904 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c3b44-f4bb-4e70-b86b-aabe74c6d05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:05.622255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c3b44-f4bb-4e70-b86b-aabe74c6d05a None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:05.622538 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c3b44-f4bb-4e70-b86b-aabe74c6d05a None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:05.622807 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c3b44-f4bb-4e70-b86b-aabe74c6d05a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:05.633698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c3b44-f4bb-4e70-b86b-aabe74c6d05a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:05.635205 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c3b44-f4bb-4e70-b86b-aabe74c6d05a None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:05.653727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-970c3b44-f4bb-4e70-b86b-aabe74c6d05a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:50:05.653727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:05.653727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:05.653727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:05.653727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:05.653727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:05.653727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:05.653727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:05.653727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:05.653727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:05.653727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:05.653727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:05.653727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:50:05.653727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:50:05.653727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:50:05.654899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:50:05.654899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:05.654899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:05.654899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:05.654899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:05.654899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:05.654899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:05.654899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:05.654899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:50:05.654899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:05.654899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:05.654899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:05.654899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:05.654899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:05.654899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:05.654899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:05.654899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:05.656047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:50:05.656047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:50:05.656047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:50:05.656047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:50:05.659662 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 647/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:05.660976 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af6c45-df75-4c89-912e-147587142b4d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:05.767903 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af6c45-df75-4c89-912e-147587142b4d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:05.809224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a8d67-b2c6-46c0-bfac-2b7217c5d417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:05.810057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a8d67-b2c6-46c0-bfac-2b7217c5d417 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:05.810386 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a8d67-b2c6-46c0-bfac-2b7217c5d417 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:05.810729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a8d67-b2c6-46c0-bfac-2b7217c5d417 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:05.811533 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a8d67-b2c6-46c0-bfac-2b7217c5d417 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:05.811858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a8d67-b2c6-46c0-bfac-2b7217c5d417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:05.813412 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a8d67-b2c6-46c0-bfac-2b7217c5d417 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:05.826199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 610/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:05.832050 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c3b44-f4bb-4e70-b86b-aabe74c6d05a None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:05.944673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c3b44-f4bb-4e70-b86b-aabe74c6d05a None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:05.986654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f6e77-b554-408d-8a02-d7e3c8a6e020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:05.987483 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f6e77-b554-408d-8a02-d7e3c8a6e020 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:05.988003 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f6e77-b554-408d-8a02-d7e3c8a6e020 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:05.988571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f6e77-b554-408d-8a02-d7e3c8a6e020 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:05.996856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f6e77-b554-408d-8a02-d7e3c8a6e020 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:05.998672 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f6e77-b554-408d-8a02-d7e3c8a6e020 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:06.013862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-527f6e77-b554-408d-8a02-d7e3c8a6e020 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:50:06.013862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:06.013862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:06.013862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:06.013862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:06.013862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:06.013862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:06.013862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:06.013862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:06.013862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:06.013862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:06.013862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:06.013862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:50:06.013862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:50:06.013862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:50:06.014988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:50:06.014988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:06.014988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:06.014988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:06.014988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:06.014988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:06.014988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:06.014988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:06.014988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:50:06.014988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:06.014988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:06.014988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:06.014988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:06.014988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:06.014988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:06.014988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:06.014988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:06.015950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:50:06.015950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:50:06.015950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:50:06.015950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:50:06.015950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:50:06.015950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:50:06.015950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:50:06.015950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:50:06.015950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 648/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:50:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:06.021165 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a8d67-b2c6-46c0-bfac-2b7217c5d417 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:06.128186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a8d67-b2c6-46c0-bfac-2b7217c5d417 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:06.164188 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe0058-ccdd-4f75-9c08-2f739c273807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:06.164866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe0058-ccdd-4f75-9c08-2f739c273807 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:06.165147 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe0058-ccdd-4f75-9c08-2f739c273807 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:06.165420 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe0058-ccdd-4f75-9c08-2f739c273807 None admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:06.166243 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe0058-ccdd-4f75-9c08-2f739c273807 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:06.166553 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe0058-ccdd-4f75-9c08-2f739c273807 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:06.168000 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe0058-ccdd-4f75-9c08-2f739c273807 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:06.180919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 611/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:50:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:06.187346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f6e77-b554-408d-8a02-d7e3c8a6e020 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:06.289858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f6e77-b554-408d-8a02-d7e3c8a6e020 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:06.323866 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bfd98-60f8-4b01-b686-4263ed16ad7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:06.324570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bfd98-60f8-4b01-b686-4263ed16ad7e None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:06.325380 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bfd98-60f8-4b01-b686-4263ed16ad7e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:06.325652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bfd98-60f8-4b01-b686-4263ed16ad7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:06.326490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bfd98-60f8-4b01-b686-4263ed16ad7e None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=d8a29487b009419dbead4684bcd01cae) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:06.326796 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bfd98-60f8-4b01-b686-4263ed16ad7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:06.328239 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bfd98-60f8-4b01-b686-4263ed16ad7e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:06.334150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 649/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:50:06 2022] GET /identity/v3/role_assignments?user.id=d8a29487b009419dbead4684bcd01cae&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:50:08.579215 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fb4f1-8151-412b-b9a4-02939e9b0f41 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:08.579740 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fb4f1-8151-412b-b9a4-02939e9b0f41 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:08.579740 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fb4f1-8151-412b-b9a4-02939e9b0f41 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:08.581163 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 612/1261] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:50:08.586354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a890d8-881c-4492-bbce-03b0d9ba638e None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:08.586751 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a890d8-881c-4492-bbce-03b0d9ba638e None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:08.586899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a890d8-881c-4492-bbce-03b0d9ba638e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:08.602941 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-02a890d8-881c-4492-bbce-03b0d9ba638e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:50:08.604077 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-02a890d8-881c-4492-bbce-03b0d9ba638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:50:08.665857 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 650/1262] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:50:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:50:08.687853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fb4f1-8151-412b-b9a4-02939e9b0f41 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:08.783442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fb4f1-8151-412b-b9a4-02939e9b0f41 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:08.815559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449b548-10d7-458e-8094-b8f9d8217154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:08.816360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449b548-10d7-458e-8094-b8f9d8217154 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:08.816641 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449b548-10d7-458e-8094-b8f9d8217154 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:08.816910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449b548-10d7-458e-8094-b8f9d8217154 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:08.826403 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449b548-10d7-458e-8094-b8f9d8217154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:50:08.833856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-0449b548-10d7-458e-8094-b8f9d8217154 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:50:08.833856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:08.833856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:08.833856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:08.833856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:08.833856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:08.833856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:08.833856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:08.833856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:08.833856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:08.833856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:08.833856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:08.833856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:50:08.833856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:50:08.833856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:50:08.833856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:50:08.834961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:50:08.834961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:50:08.834961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:50:08.834961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:50:08.834961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:08.834961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:08.834961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:08.834961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:08.834961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:08.834961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:08.834961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:08.834961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:50:08.834961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:08.834961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:08.834961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:08.834961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:08.835890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:08.835890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:08.835890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:08.835890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:08.835890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:50:08.835890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:50:08.835890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:50:08.835890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:50:08.835890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:50:08.835890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:50:08.835890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:50:08.835890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:50:08.835890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 613/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:50:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:08.841062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a890d8-881c-4492-bbce-03b0d9ba638e None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:08.936444 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a890d8-881c-4492-bbce-03b0d9ba638e None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:08.973479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db14ea-43d4-4417-8ee1-d330b127f35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:08.974233 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db14ea-43d4-4417-8ee1-d330b127f35e None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:08.974424 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db14ea-43d4-4417-8ee1-d330b127f35e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:08.974664 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db14ea-43d4-4417-8ee1-d330b127f35e None admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:08.975440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db14ea-43d4-4417-8ee1-d330b127f35e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:08.975737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db14ea-43d4-4417-8ee1-d330b127f35e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:08.977107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db14ea-43d4-4417-8ee1-d330b127f35e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:08.985677 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 651/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:50:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:08.991498 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449b548-10d7-458e-8094-b8f9d8217154 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:09.088867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449b548-10d7-458e-8094-b8f9d8217154 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:09.120757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6af74a-56b9-44b5-a567-680f581f959c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:09.122157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6af74a-56b9-44b5-a567-680f581f959c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:09.122438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6af74a-56b9-44b5-a567-680f581f959c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:09.122706 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6af74a-56b9-44b5-a567-680f581f959c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:09.132771 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6af74a-56b9-44b5-a567-680f581f959c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:09.134201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6af74a-56b9-44b5-a567-680f581f959c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:09.150389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-1c6af74a-56b9-44b5-a567-680f581f959c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:50:09.150389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:09.150389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:09.150389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:09.150389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:09.150389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:09.150389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:09.150389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:09.150389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:09.150389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:09.150389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:09.150389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:09.150389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:50:09.150389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:50:09.150389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:50:09.151419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:50:09.151419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:09.151419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:09.151419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:09.151419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:09.151419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:09.151419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:09.151419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:09.151419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:50:09.151419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:09.151419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:09.151419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:09.151419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:09.151419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:09.151419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:09.151419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:09.151419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:09.153363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:50:09.153363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:50:09.153363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:50:09.153363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:50:09.153363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 614/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:09.158325 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db14ea-43d4-4417-8ee1-d330b127f35e None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:09.250868 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db14ea-43d4-4417-8ee1-d330b127f35e None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:09.281909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8393f-3a63-4bc8-81e4-4bccdbe8d316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:09.282551 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8393f-3a63-4bc8-81e4-4bccdbe8d316 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:09.282827 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8393f-3a63-4bc8-81e4-4bccdbe8d316 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:09.283097 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8393f-3a63-4bc8-81e4-4bccdbe8d316 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:09.283808 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8393f-3a63-4bc8-81e4-4bccdbe8d316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:09.284109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8393f-3a63-4bc8-81e4-4bccdbe8d316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:09.285471 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8393f-3a63-4bc8-81e4-4bccdbe8d316 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:09.297063 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 652/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:09.302680 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6af74a-56b9-44b5-a567-680f581f959c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:09.406048 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6af74a-56b9-44b5-a567-680f581f959c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:09.437714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30689b-c3fd-4c83-980a-08640d860817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:09.438498 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30689b-c3fd-4c83-980a-08640d860817 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:09.438776 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30689b-c3fd-4c83-980a-08640d860817 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:09.439046 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30689b-c3fd-4c83-980a-08640d860817 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:09.446974 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30689b-c3fd-4c83-980a-08640d860817 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:09.448430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30689b-c3fd-4c83-980a-08640d860817 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:09.462198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-9c30689b-c3fd-4c83-980a-08640d860817 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 13:50:09.462198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:09.462198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:09.462198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:09.462198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:09.462198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:09.462198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:09.462198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:09.462198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:09.462198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:09.462198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:09.462198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:09.462198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:50:09.462198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:50:09.462198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:50:09.462198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:09.463623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:09.464869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:09.464869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:09.464869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:50:09.464869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:50:09.464869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:50:09.464869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:50:09.464869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:50:09.464869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:50:09.464869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 13:50:09.464869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:50:09.464869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 615/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:50:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:09.469799 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8393f-3a63-4bc8-81e4-4bccdbe8d316 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:09.563017 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8393f-3a63-4bc8-81e4-4bccdbe8d316 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:09.595289 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a18a8-fa81-4c6e-b60c-54c81f5aad38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:09.595949 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a18a8-fa81-4c6e-b60c-54c81f5aad38 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:09.596265 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a18a8-fa81-4c6e-b60c-54c81f5aad38 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:09.596542 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a18a8-fa81-4c6e-b60c-54c81f5aad38 None admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:09.597366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a18a8-fa81-4c6e-b60c-54c81f5aad38 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:09.597675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a18a8-fa81-4c6e-b60c-54c81f5aad38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:09.599068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a18a8-fa81-4c6e-b60c-54c81f5aad38 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:09.615858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 653/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Tue May 10 13:50:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:09.621274 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30689b-c3fd-4c83-980a-08640d860817 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:09.715051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30689b-c3fd-4c83-980a-08640d860817 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:09.746333 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c4e5a-1086-49ab-a687-10cb8dd2cc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:09.747125 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c4e5a-1086-49ab-a687-10cb8dd2cc87 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:09.747400 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c4e5a-1086-49ab-a687-10cb8dd2cc87 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:09.747670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c4e5a-1086-49ab-a687-10cb8dd2cc87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:09.757545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c4e5a-1086-49ab-a687-10cb8dd2cc87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:09.758964 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c4e5a-1086-49ab-a687-10cb8dd2cc87 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:09.775569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-511c4e5a-1086-49ab-a687-10cb8dd2cc87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:50:09.775569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:09.775569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:09.775569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:09.775569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:09.775569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:09.775569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:09.775569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:09.775569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:09.775569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:09.775569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:09.775569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:09.775569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:50:09.775569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:50:09.775569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:50:09.776661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:50:09.776661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:09.776661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:09.776661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:09.776661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:09.776661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:09.776661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:09.776661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:09.776661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:50:09.776661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:09.776661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:09.776661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:09.776661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:09.776661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:09.776661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:09.776661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:09.776661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:09.778616 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:50:09.778616 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:50:09.778616 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:50:09.778616 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:50:09.778616 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 616/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:09.784816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a18a8-fa81-4c6e-b60c-54c81f5aad38 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:09.876972 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a18a8-fa81-4c6e-b60c-54c81f5aad38 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:09.909169 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde34b97-cd30-4f10-8564-3d882812d569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:09.909813 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde34b97-cd30-4f10-8564-3d882812d569 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:09.910096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde34b97-cd30-4f10-8564-3d882812d569 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:09.910367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde34b97-cd30-4f10-8564-3d882812d569 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:09.911066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde34b97-cd30-4f10-8564-3d882812d569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:09.911364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde34b97-cd30-4f10-8564-3d882812d569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:09.912734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde34b97-cd30-4f10-8564-3d882812d569 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:09.923597 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 654/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:09.930756 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c4e5a-1086-49ab-a687-10cb8dd2cc87 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:10.031678 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c4e5a-1086-49ab-a687-10cb8dd2cc87 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:10.063206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6daa6f-5527-4fc6-abfc-37f9543381dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:10.063975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6daa6f-5527-4fc6-abfc-37f9543381dc None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:10.064284 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6daa6f-5527-4fc6-abfc-37f9543381dc None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:10.064562 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6daa6f-5527-4fc6-abfc-37f9543381dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:10.070888 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6daa6f-5527-4fc6-abfc-37f9543381dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:10.072331 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6daa6f-5527-4fc6-abfc-37f9543381dc None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:10.086591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-fe6daa6f-5527-4fc6-abfc-37f9543381dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:50:10.086591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:10.086591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:10.086591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:10.086591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:10.086591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:10.086591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:10.086591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:10.086591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:10.086591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:10.086591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:10.086591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:10.086591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:50:10.086591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:50:10.086591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:50:10.087514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:50:10.087514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:10.087514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:10.087514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:10.087514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:10.087514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:10.087514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:10.087514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:10.087514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:50:10.087514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:10.087514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:10.087514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:10.087514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:10.087514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:10.087514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:10.087514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:10.087514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:10.088663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:50:10.088663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:50:10.088663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:50:10.088663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:50:10.088663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:50:10.088663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:50:10.088663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:50:10.088663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:50:10.088663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 617/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:50:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:10.093615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde34b97-cd30-4f10-8564-3d882812d569 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:10.187133 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde34b97-cd30-4f10-8564-3d882812d569 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:10.218313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd6460-178d-4f19-8e55-c185fe59d363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:10.218951 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd6460-178d-4f19-8e55-c185fe59d363 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:10.219228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd6460-178d-4f19-8e55-c185fe59d363 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:10.219499 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd6460-178d-4f19-8e55-c185fe59d363 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:10.220288 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd6460-178d-4f19-8e55-c185fe59d363 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:10.220593 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd6460-178d-4f19-8e55-c185fe59d363 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:10.221975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd6460-178d-4f19-8e55-c185fe59d363 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:10.233222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 655/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:50:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:50:10.238979 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6daa6f-5527-4fc6-abfc-37f9543381dc None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:10.331470 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6daa6f-5527-4fc6-abfc-37f9543381dc None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:10.362872 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d9a12-c55c-4919-9621-ffb7c3adb8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:10.363723 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d9a12-c55c-4919-9621-ffb7c3adb8d9 None admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:10.363996 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d9a12-c55c-4919-9621-ffb7c3adb8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:10.364294 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d9a12-c55c-4919-9621-ffb7c3adb8d9 None admin] PATH_INFO: `/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/d8a29487b009419dbead4684bcd01cae/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:10.366175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d9a12-c55c-4919-9621-ffb7c3adb8d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9613de9a3bc9461d9d348e5b66b8d684, user_id=d8a29487b009419dbead4684bcd01cae, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:10.367570 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d9a12-c55c-4919-9621-ffb7c3adb8d9 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:10.380569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 618/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 13:50:10 2022] PUT /identity/v3/projects/9613de9a3bc9461d9d348e5b66b8d684/users/d8a29487b009419dbead4684bcd01cae/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:50:12.589458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de5299-15e7-4006-9f04-5fb55b7277b3 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:12.590006 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de5299-15e7-4006-9f04-5fb55b7277b3 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:12.590006 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de5299-15e7-4006-9f04-5fb55b7277b3 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:12.591375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 656/1274] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:50:12.596687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d61e3-3bfd-4b1a-9fd7-6d48e5429ae3 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:12.597115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d61e3-3bfd-4b1a-9fd7-6d48e5429ae3 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:12.597242 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d61e3-3bfd-4b1a-9fd7-6d48e5429ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:12.613732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-9b9d61e3-3bfd-4b1a-9fd7-6d48e5429ae3 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:50:12.614875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-9b9d61e3-3bfd-4b1a-9fd7-6d48e5429ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:50:12.676963 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 619/1275] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:50:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:50:12.699972 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de5299-15e7-4006-9f04-5fb55b7277b3 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:12.794992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de5299-15e7-4006-9f04-5fb55b7277b3 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:12.827752 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff732b-5d77-4c13-8e5e-4887860c5842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:12.828569 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff732b-5d77-4c13-8e5e-4887860c5842 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:12.828850 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff732b-5d77-4c13-8e5e-4887860c5842 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:12.829121 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff732b-5d77-4c13-8e5e-4887860c5842 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:12.838914 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff732b-5d77-4c13-8e5e-4887860c5842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 13:50:12.846484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-bfff732b-5d77-4c13-8e5e-4887860c5842 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:50:12.846484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:12.846484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:12.846484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:12.846484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:12.846484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:12.846484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:12.846484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:12.846484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:12.846484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:12.846484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:12.846484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:12.846484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 13:50:12.846484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 13:50:12.846484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 13:50:12.846484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 13:50:12.847573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 13:50:12.847573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 13:50:12.847573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 13:50:12.847573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 13:50:12.847573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:12.847573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:12.847573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:12.847573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:12.847573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:12.847573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:12.847573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:12.847573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:50:12.847573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:12.847573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:12.847573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:12.847573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:12.848641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:12.848641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:12.848641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:12.848641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:12.848641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 13:50:12.848641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 13:50:12.848641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 13:50:12.848641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 13:50:12.848641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 13:50:12.848641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 13:50:12.848641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 13:50:12.848641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:50:12.848641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 657/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 13:50:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:12.853796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d61e3-3bfd-4b1a-9fd7-6d48e5429ae3 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:12.955273 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d61e3-3bfd-4b1a-9fd7-6d48e5429ae3 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:12.988910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43e304-a70c-4d57-a65b-3dd553d8b460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:12.989556 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e304-a70c-4d57-a65b-3dd553d8b460 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:12.989836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e304-a70c-4d57-a65b-3dd553d8b460 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:12.990110 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e304-a70c-4d57-a65b-3dd553d8b460 None admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:12.990845 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43e304-a70c-4d57-a65b-3dd553d8b460 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:12.991148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43e304-a70c-4d57-a65b-3dd553d8b460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:12.992589 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43e304-a70c-4d57-a65b-3dd553d8b460 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:13.000314 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 620/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 13:50:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:13.008537 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff732b-5d77-4c13-8e5e-4887860c5842 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:13.101712 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff732b-5d77-4c13-8e5e-4887860c5842 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:13.132809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91911cc-87a8-4ba8-82b4-99a14d1eef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:13.133576 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91911cc-87a8-4ba8-82b4-99a14d1eef7e None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:13.133852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91911cc-87a8-4ba8-82b4-99a14d1eef7e None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:13.134123 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91911cc-87a8-4ba8-82b4-99a14d1eef7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:13.144014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91911cc-87a8-4ba8-82b4-99a14d1eef7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:13.145456 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91911cc-87a8-4ba8-82b4-99a14d1eef7e None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:13.162327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-f91911cc-87a8-4ba8-82b4-99a14d1eef7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:50:13.162327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:13.162327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:13.162327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:13.162327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:13.162327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:13.162327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:13.162327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:13.162327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:13.162327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:13.162327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:13.162327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:13.162327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:50:13.162327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:50:13.162327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:50:13.163398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:50:13.163398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:13.163398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:13.163398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:13.163398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:13.163398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:13.163398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:13.163398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:13.163398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:50:13.163398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:13.163398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:13.163398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:13.163398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:13.163398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:13.163398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:13.163398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:13.163398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:13.164698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:50:13.164698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:50:13.164698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:50:13.164698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:50:13.164698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 658/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:13.169658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43e304-a70c-4d57-a65b-3dd553d8b460 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:13.261230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43e304-a70c-4d57-a65b-3dd553d8b460 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:13.292704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e808a3-10c4-44ee-b493-867989b546e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:13.293926 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e808a3-10c4-44ee-b493-867989b546e8 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:13.294201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e808a3-10c4-44ee-b493-867989b546e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:13.294468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e808a3-10c4-44ee-b493-867989b546e8 None admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:13.295172 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e808a3-10c4-44ee-b493-867989b546e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:13.295470 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e808a3-10c4-44ee-b493-867989b546e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:13.296826 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e808a3-10c4-44ee-b493-867989b546e8 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:13.307809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 621/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:50:13.313278 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91911cc-87a8-4ba8-82b4-99a14d1eef7e None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:13.412307 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91911cc-87a8-4ba8-82b4-99a14d1eef7e None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:13.444880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacb1c3-45a5-43d4-94db-5a0e22f5c1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:13.445670 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacb1c3-45a5-43d4-94db-5a0e22f5c1f7 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:13.445945 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacb1c3-45a5-43d4-94db-5a0e22f5c1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:13.446214 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacb1c3-45a5-43d4-94db-5a0e22f5c1f7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:13.453345 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacb1c3-45a5-43d4-94db-5a0e22f5c1f7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:13.454752 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacb1c3-45a5-43d4-94db-5a0e22f5c1f7 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:13.468969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-5dacb1c3-45a5-43d4-94db-5a0e22f5c1f7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 13:50:13.468969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:13.468969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:13.468969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:13.468969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:13.468969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:13.468969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:13.468969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:13.468969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:13.468969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:13.468969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:13.468969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:13.468969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 13:50:13.468969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 13:50:13.468969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 13:50:13.468969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:13.470096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:13.471453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:13.471453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:13.471453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 13:50:13.471453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 13:50:13.471453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 13:50:13.471453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 13:50:13.471453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 13:50:13.471453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 13:50:13.471453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 13:50:13.471453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:50:13.471453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 659/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:50:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:13.475830 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e808a3-10c4-44ee-b493-867989b546e8 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:13.568950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e808a3-10c4-44ee-b493-867989b546e8 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:13.600676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8617c0-9697-4a45-9f6a-31d8b109b221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:13.601325 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8617c0-9697-4a45-9f6a-31d8b109b221 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:13.601603 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8617c0-9697-4a45-9f6a-31d8b109b221 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:13.601873 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8617c0-9697-4a45-9f6a-31d8b109b221 None admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:13.602679 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8617c0-9697-4a45-9f6a-31d8b109b221 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:13.602983 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8617c0-9697-4a45-9f6a-31d8b109b221 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:13.604399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8617c0-9697-4a45-9f6a-31d8b109b221 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:13.620835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 622/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Tue May 10 13:50:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:13.626250 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacb1c3-45a5-43d4-94db-5a0e22f5c1f7 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:13.719985 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacb1c3-45a5-43d4-94db-5a0e22f5c1f7 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:13.750383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269e632-9e55-4e34-a770-c488ee642c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:13.751004 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269e632-9e55-4e34-a770-c488ee642c98 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:13.751278 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269e632-9e55-4e34-a770-c488ee642c98 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:13.751545 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269e632-9e55-4e34-a770-c488ee642c98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:13.813600 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269e632-9e55-4e34-a770-c488ee642c98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:13.815011 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269e632-9e55-4e34-a770-c488ee642c98 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:13.912753 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 660/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 13:50:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 13:50:13.918988 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8617c0-9697-4a45-9f6a-31d8b109b221 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:14.018266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8617c0-9697-4a45-9f6a-31d8b109b221 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:14.049801 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b27857-40e5-4be9-a22b-4c0b4939e32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:14.050571 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b27857-40e5-4be9-a22b-4c0b4939e32c None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:14.050845 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b27857-40e5-4be9-a22b-4c0b4939e32c None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:14.051111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b27857-40e5-4be9-a22b-4c0b4939e32c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:14.060985 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b27857-40e5-4be9-a22b-4c0b4939e32c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:14.062397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b27857-40e5-4be9-a22b-4c0b4939e32c None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:14.078783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-d5b27857-40e5-4be9-a22b-4c0b4939e32c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:50:14.078783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:14.078783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:14.078783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:14.078783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:14.078783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:14.078783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:14.078783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:14.078783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:14.078783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:14.078783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:14.078783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:14.078783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 13:50:14.078783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 13:50:14.078783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 13:50:14.079854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 13:50:14.079854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:14.079854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:14.079854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:14.079854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:14.079854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:14.079854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:14.079854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:14.079854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:50:14.079854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:14.079854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:14.079854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:14.079854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:14.079854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:14.079854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:14.079854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:14.079854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:14.081107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 13:50:14.081107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 13:50:14.081107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 13:50:14.081107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:50:14.081107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 623/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:14.085687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269e632-9e55-4e34-a770-c488ee642c98 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:14.181324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269e632-9e55-4e34-a770-c488ee642c98 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:14.212216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484db8c9-3e88-47f6-a1db-baac822cbbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:14.212870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484db8c9-3e88-47f6-a1db-baac822cbbc6 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:14.213148 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484db8c9-3e88-47f6-a1db-baac822cbbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:14.213420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484db8c9-3e88-47f6-a1db-baac822cbbc6 None admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:14.214124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484db8c9-3e88-47f6-a1db-baac822cbbc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:14.214426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484db8c9-3e88-47f6-a1db-baac822cbbc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:14.216314 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484db8c9-3e88-47f6-a1db-baac822cbbc6 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:14.226819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 661/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 13:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:50:14.232928 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b27857-40e5-4be9-a22b-4c0b4939e32c None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:14.325829 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b27857-40e5-4be9-a22b-4c0b4939e32c None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:14.357902 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcc6b1-e2bb-4831-aa48-a035b1da7655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:14.358671 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcc6b1-e2bb-4831-aa48-a035b1da7655 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:14.358952 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcc6b1-e2bb-4831-aa48-a035b1da7655 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:14.359227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcc6b1-e2bb-4831-aa48-a035b1da7655 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:14.365647 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcc6b1-e2bb-4831-aa48-a035b1da7655 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:14.367063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcc6b1-e2bb-4831-aa48-a035b1da7655 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:14.380272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application [None req-d2bcc6b1-e2bb-4831-aa48-a035b1da7655 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:50:14.380272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:14.380272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:14.380272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:14.380272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:14.380272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:14.380272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:14.380272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:14.380272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:14.380272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:14.380272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:14.380272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:14.380272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 13:50:14.380272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 13:50:14.380272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 13:50:14.381354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 13:50:14.381354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:14.381354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:14.381354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:14.381354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:14.381354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:14.381354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:14.381354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:14.381354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application with Lock( May 10 13:50:14.381354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:14.381354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:14.381354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:14.381354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:14.381354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:14.381354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:14.381354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:14.381354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:14.382419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 13:50:14.382419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 13:50:14.382419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 13:50:14.382419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 13:50:14.382419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 13:50:14.382419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 13:50:14.382419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 13:50:14.382419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: ERROR keystone.server.flask.application May 10 13:50:14.382419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 624/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 13:50:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 13:50:14.387189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484db8c9-3e88-47f6-a1db-baac822cbbc6 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:14.482719 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484db8c9-3e88-47f6-a1db-baac822cbbc6 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:14.514177 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd54526-680c-4aaf-ab89-05684a3994c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:14.514831 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd54526-680c-4aaf-ab89-05684a3994c6 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:14.515111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd54526-680c-4aaf-ab89-05684a3994c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:14.515384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd54526-680c-4aaf-ab89-05684a3994c6 None admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:14.516156 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd54526-680c-4aaf-ab89-05684a3994c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:14.516485 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd54526-680c-4aaf-ab89-05684a3994c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:14.517888 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd54526-680c-4aaf-ab89-05684a3994c6 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:14.529956 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 662/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 13:50:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:14.535902 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcc6b1-e2bb-4831-aa48-a035b1da7655 None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:14.630282 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcc6b1-e2bb-4831-aa48-a035b1da7655 None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:14.662589 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ebdd9-7c6b-4138-bfa9-1ae68af04546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:14.663220 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ebdd9-7c6b-4138-bfa9-1ae68af04546 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:14.663498 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ebdd9-7c6b-4138-bfa9-1ae68af04546 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:14.663768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ebdd9-7c6b-4138-bfa9-1ae68af04546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:14.664610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ebdd9-7c6b-4138-bfa9-1ae68af04546 None admin] RBAC: Adding query filter params (role.id=ef3b4e4f0c1e44ffb59235164ffac17d, scope.project.id=9613de9a3bc9461d9d348e5b66b8d684, user.id=d8a29487b009419dbead4684bcd01cae) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:14.664920 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ebdd9-7c6b-4138-bfa9-1ae68af04546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:14.666328 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ebdd9-7c6b-4138-bfa9-1ae68af04546 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:14.671878 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 625/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 13:50:14 2022] GET /identity/v3/role_assignments?user.id=d8a29487b009419dbead4684bcd01cae&scope.project.id=9613de9a3bc9461d9d348e5b66b8d684&role.id=ef3b4e4f0c1e44ffb59235164ffac17d => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:16.874630 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1744464-72ab-45c3-b82d-5ee287a67cbf None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:16.875143 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1744464-72ab-45c3-b82d-5ee287a67cbf None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:16.875235 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1744464-72ab-45c3-b82d-5ee287a67cbf None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:16.876572 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 663/1288] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:50:16.881628 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869723cc-e822-40ba-8466-f8e850e2b030 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:16.882017 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869723cc-e822-40ba-8466-f8e850e2b030 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:16.882187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869723cc-e822-40ba-8466-f8e850e2b030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:16.899078 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-869723cc-e822-40ba-8466-f8e850e2b030 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:50:16.900275 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-869723cc-e822-40ba-8466-f8e850e2b030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:50:16.970462 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 626/1289] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:50:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:50:16.994219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1744464-72ab-45c3-b82d-5ee287a67cbf None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:17.093866 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1744464-72ab-45c3-b82d-5ee287a67cbf None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:17.125160 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929ea62-a947-4dcd-b94a-240a13fa9d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:17.125879 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929ea62-a947-4dcd-b94a-240a13fa9d22 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:17.126153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929ea62-a947-4dcd-b94a-240a13fa9d22 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:17.126421 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929ea62-a947-4dcd-b94a-240a13fa9d22 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:17.127052 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929ea62-a947-4dcd-b94a-240a13fa9d22 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:17.128407 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929ea62-a947-4dcd-b94a-240a13fa9d22 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:17.140340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-9929ea62-a947-4dcd-b94a-240a13fa9d22 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:50:17.140340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:17.140340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:50:17.140340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:50:17.140340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:50:17.140340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:50:17.140340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:50:17.140340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:50:17.140340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:50:17.140340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:50:17.140340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:50:17.140340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:50:17.140340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:17.140340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:17.140340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:17.140340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:17.140340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:17.141564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:17.141564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:17.141564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:17.141564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:17.141564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:17.141564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:17.141564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:50:17.141564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:50:17.141564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:50:17.141564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:50:17.141564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:17.141564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:17.141564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:17.141564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:17.141564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:17.141564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:17.142622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:17.142622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:50:17.142622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:17.142622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:17.142622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:17.142622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:17.142622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:17.142622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:17.142622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:17.142622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:17.142622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:50:17.142622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:50:17.142622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:50:17.142622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:50:17.142622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 664/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 13:50:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:17.147455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869723cc-e822-40ba-8466-f8e850e2b030 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:17.243730 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869723cc-e822-40ba-8466-f8e850e2b030 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:17.276249 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cee74-9d28-42b1-bdc7-3133c7009cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:17.276889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cee74-9d28-42b1-bdc7-3133c7009cee None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:17.277443 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cee74-9d28-42b1-bdc7-3133c7009cee None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:17.277728 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cee74-9d28-42b1-bdc7-3133c7009cee None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:17.278425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cee74-9d28-42b1-bdc7-3133c7009cee None admin] RBAC: Adding query filter params (name=placement) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:17.278728 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cee74-9d28-42b1-bdc7-3133c7009cee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:17.280075 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cee74-9d28-42b1-bdc7-3133c7009cee None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:17.284685 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 627/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Tue May 10 13:50:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:17.290175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929ea62-a947-4dcd-b94a-240a13fa9d22 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:17.382027 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929ea62-a947-4dcd-b94a-240a13fa9d22 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:17.413567 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd6a21-6280-4c4a-a0ae-487c137b80c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:17.414213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd6a21-6280-4c4a-a0ae-487c137b80c7 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:17.414486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd6a21-6280-4c4a-a0ae-487c137b80c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:17.414752 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd6a21-6280-4c4a-a0ae-487c137b80c7 None admin] PATH_INFO: `/v3/services` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:17.415436 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd6a21-6280-4c4a-a0ae-487c137b80c7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:17.415734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd6a21-6280-4c4a-a0ae-487c137b80c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:17.417087 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd6a21-6280-4c4a-a0ae-487c137b80c7 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:17.421804 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 665/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Tue May 10 13:50:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:19.595338 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea787591-caa7-43dd-90db-6a9fc670af02 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:19.595887 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea787591-caa7-43dd-90db-6a9fc670af02 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:19.595887 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea787591-caa7-43dd-90db-6a9fc670af02 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:19.597278 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 628/1293] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:50:19.602285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eac1b-703e-413b-91b5-aa3b06fb3d14 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:19.602716 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eac1b-703e-413b-91b5-aa3b06fb3d14 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:19.602835 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eac1b-703e-413b-91b5-aa3b06fb3d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:19.619562 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-798eac1b-703e-413b-91b5-aa3b06fb3d14 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:50:19.620754 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-798eac1b-703e-413b-91b5-aa3b06fb3d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:50:19.682995 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 666/1294] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:50:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 13:50:19.705549 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea787591-caa7-43dd-90db-6a9fc670af02 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:19.801932 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea787591-caa7-43dd-90db-6a9fc670af02 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:19.833414 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807841c-8d88-406f-869b-db13f2354a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:19.834061 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807841c-8d88-406f-869b-db13f2354a51 None admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:19.834343 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807841c-8d88-406f-869b-db13f2354a51 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:19.834617 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807841c-8d88-406f-869b-db13f2354a51 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:19.835332 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807841c-8d88-406f-869b-db13f2354a51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:19.836737 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807841c-8d88-406f-869b-db13f2354a51 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:19.849601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 629/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 13:50:19 2022] POST /identity/v3/services => generated 246 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:50:22.087516 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46329bd-b11b-4b4f-a351-2b0e8f3cd81a None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:22.088100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46329bd-b11b-4b4f-a351-2b0e8f3cd81a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:22.088100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46329bd-b11b-4b4f-a351-2b0e8f3cd81a None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:22.089785 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 667/1296] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:50:22.095851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbbe23-dfd9-45ea-bd6c-352c2462cd7c None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:22.096345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbbe23-dfd9-45ea-bd6c-352c2462cd7c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:22.096579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbbe23-dfd9-45ea-bd6c-352c2462cd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:22.115707 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-54fbbe23-dfd9-45ea-bd6c-352c2462cd7c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:50:22.117059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-54fbbe23-dfd9-45ea-bd6c-352c2462cd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:50:22.186353 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 630/1297] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:50:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:50:22.208635 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46329bd-b11b-4b4f-a351-2b0e8f3cd81a None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:22.302787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46329bd-b11b-4b4f-a351-2b0e8f3cd81a None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:22.333964 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c3657-4746-4e8c-9c79-0ea697c7e025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:22.334737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c3657-4746-4e8c-9c79-0ea697c7e025 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:22.335011 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c3657-4746-4e8c-9c79-0ea697c7e025 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:22.335276 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c3657-4746-4e8c-9c79-0ea697c7e025 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:22.335905 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c3657-4746-4e8c-9c79-0ea697c7e025 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:22.337263 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c3657-4746-4e8c-9c79-0ea697c7e025 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:22.349158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-d66c3657-4746-4e8c-9c79-0ea697c7e025 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:50:22.349158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:22.349158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:50:22.349158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:50:22.349158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:50:22.349158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:50:22.349158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:50:22.349158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:50:22.349158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:50:22.349158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:50:22.349158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:50:22.349158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:50:22.349158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:22.349158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:22.349158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:22.349158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:22.349158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:22.350355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:22.350355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:22.350355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:22.350355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:22.350355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:22.350355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:22.350355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:50:22.350355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:50:22.350355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:50:22.350355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:50:22.350355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:22.350355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:22.350355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:22.350355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:22.350355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:22.350355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:22.351440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:22.351440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:50:22.351440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:22.351440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:22.351440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:22.351440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:22.351440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:22.351440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:22.351440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:22.351440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:22.351440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:50:22.351440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:50:22.351440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:50:22.351440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:50:22.351440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 668/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 13:50:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:22.356708 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbbe23-dfd9-45ea-bd6c-352c2462cd7c None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:22.448473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbbe23-dfd9-45ea-bd6c-352c2462cd7c None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:22.480889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794b7b1-6553-4103-85bf-b42e69a1f82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:22.481339 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794b7b1-6553-4103-85bf-b42e69a1f82d None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:22.481619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794b7b1-6553-4103-85bf-b42e69a1f82d None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:22.481892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794b7b1-6553-4103-85bf-b42e69a1f82d None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:22.482580 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794b7b1-6553-4103-85bf-b42e69a1f82d None admin] RBAC: Adding query filter params (name=placement) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:22.482880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794b7b1-6553-4103-85bf-b42e69a1f82d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:22.484256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794b7b1-6553-4103-85bf-b42e69a1f82d None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:22.489141 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 631/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Tue May 10 13:50:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 13:50:22.495005 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c3657-4746-4e8c-9c79-0ea697c7e025 None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:22.587924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c3657-4746-4e8c-9c79-0ea697c7e025 None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:22.619668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d7801-1dab-4f02-8942-33143ce05a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:22.620333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d7801-1dab-4f02-8942-33143ce05a00 None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:22.620621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d7801-1dab-4f02-8942-33143ce05a00 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:22.620925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d7801-1dab-4f02-8942-33143ce05a00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:22.621698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d7801-1dab-4f02-8942-33143ce05a00 None admin] RBAC: Adding query filter params (interface=public, service_id=a920da0f16524fcfa5d11a6ed4da9d90, region_id=RegionOne) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:22.622007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d7801-1dab-4f02-8942-33143ce05a00 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:22.623346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d7801-1dab-4f02-8942-33143ce05a00 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:22.628120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 669/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Tue May 10 13:50:22 2022] GET /identity/v3/endpoints?service_id=a920da0f16524fcfa5d11a6ed4da9d90&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:22.633541 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794b7b1-6553-4103-85bf-b42e69a1f82d None admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:22.727051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794b7b1-6553-4103-85bf-b42e69a1f82d None admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:22.757989 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6be01c-800e-4385-bec9-0f759aba1f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:22.758623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6be01c-800e-4385-bec9-0f759aba1f97 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:22.758901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6be01c-800e-4385-bec9-0f759aba1f97 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:22.759173 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6be01c-800e-4385-bec9-0f759aba1f97 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:22.759840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6be01c-800e-4385-bec9-0f759aba1f97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:22.761212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6be01c-800e-4385-bec9-0f759aba1f97 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:22.768155 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 632/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 13:50:22 2022] GET /identity/v3/services => generated 2191 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:50:24.952263 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e0342-a567-4f10-9321-2cf963c7b8cf None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:24.952810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e0342-a567-4f10-9321-2cf963c7b8cf None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:24.952810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e0342-a567-4f10-9321-2cf963c7b8cf None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:24.954196 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 670/1302] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:50:24.959311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342eb75-b927-4da2-9c55-7d9c35fe745e None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:24.959678 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342eb75-b927-4da2-9c55-7d9c35fe745e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:24.959862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342eb75-b927-4da2-9c55-7d9c35fe745e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:24.976494 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-7342eb75-b927-4da2-9c55-7d9c35fe745e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:50:24.977652 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-7342eb75-b927-4da2-9c55-7d9c35fe745e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:50:25.040781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 633/1303] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:50:24 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 13:50:25.064223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e0342-a567-4f10-9321-2cf963c7b8cf None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:25.159949 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e0342-a567-4f10-9321-2cf963c7b8cf None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:25.191731 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e62cf-eec1-4ff7-909f-565c87f9ba7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:25.192534 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e62cf-eec1-4ff7-909f-565c87f9ba7b None admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:25.192812 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e62cf-eec1-4ff7-909f-565c87f9ba7b None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:25.193084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e62cf-eec1-4ff7-909f-565c87f9ba7b None admin] PATH_INFO: `/v3/services/placement` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:25.193724 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e62cf-eec1-4ff7-909f-565c87f9ba7b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:25.195053 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e62cf-eec1-4ff7-909f-565c87f9ba7b None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:25.206916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application [None req-746e62cf-eec1-4ff7-909f-565c87f9ba7b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:50:25.206916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:25.206916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 13:50:25.206916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 13:50:25.206916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 13:50:25.206916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 13:50:25.206916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 13:50:25.206916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:50:25.206916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:50:25.206916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:50:25.206916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 13:50:25.206916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:50:25.206916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 13:50:25.206916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 13:50:25.206916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 13:50:25.206916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 13:50:25.206916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 13:50:25.208055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 13:50:25.208055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 13:50:25.208055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 13:50:25.208055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 13:50:25.208055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 13:50:25.208055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 13:50:25.208055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 13:50:25.208055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 13:50:25.208055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 13:50:25.208055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 13:50:25.208055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 13:50:25.208055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 13:50:25.208055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 13:50:25.208055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 13:50:25.208055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 13:50:25.208055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.get_or_create( May 10 13:50:25.209135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 13:50:25.209135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application with Lock( May 10 13:50:25.209135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 13:50:25.209135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self._enter() May 10 13:50:25.209135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 13:50:25.209135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 13:50:25.209135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 13:50:25.209135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application return self.creator() May 10 13:50:25.209135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 13:50:25.209135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application created_value = creator( May 10 13:50:25.209135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 13:50:25.209135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 13:50:25.209135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 13:50:25.209135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: ERROR keystone.server.flask.application May 10 13:50:25.209135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 671/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 13:50:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 13:50:25.213893 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342eb75-b927-4da2-9c55-7d9c35fe745e None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:25.306049 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342eb75-b927-4da2-9c55-7d9c35fe745e None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:25.338356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f6ef9-17b5-4649-adea-49cb44fdabe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:25.338994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f6ef9-17b5-4649-adea-49cb44fdabe8 None admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:25.339276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f6ef9-17b5-4649-adea-49cb44fdabe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:25.339549 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f6ef9-17b5-4649-adea-49cb44fdabe8 None admin] PATH_INFO: `/v3/services` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:25.340269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f6ef9-17b5-4649-adea-49cb44fdabe8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:50:25.340575 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f6ef9-17b5-4649-adea-49cb44fdabe8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:25.341918 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f6ef9-17b5-4649-adea-49cb44fdabe8 None admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:25.346794 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 634/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Tue May 10 13:50:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:50:25.352410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e62cf-eec1-4ff7-909f-565c87f9ba7b None admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:50:25.446078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e62cf-eec1-4ff7-909f-565c87f9ba7b None admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:50:25.477168 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44990df-fdc0-446f-b887-33de0a712848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:50:25.477744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44990df-fdc0-446f-b887-33de0a712848 None admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:50:25.478017 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44990df-fdc0-446f-b887-33de0a712848 None admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:50:25.478284 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44990df-fdc0-446f-b887-33de0a712848 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:50:25.479005 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44990df-fdc0-446f-b887-33de0a712848 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:50:25.480355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44990df-fdc0-446f-b887-33de0a712848 None admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:50:25.497603 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 672/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 13:50:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:51:28.868291 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af1221-0765-41d3-a034-f2b54036866c None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:28.868885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af1221-0765-41d3-a034-f2b54036866c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:28.868885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af1221-0765-41d3-a034-f2b54036866c None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:28.870200 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 635/1307] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:28.876032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae8266-2482-48c4-80e1-a482d42b117f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:28.876501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae8266-2482-48c4-80e1-a482d42b117f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:28.876604 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae8266-2482-48c4-80e1-a482d42b117f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:28.996919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-12ae8266-2482-48c4-80e1-a482d42b117f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:28.998213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-12ae8266-2482-48c4-80e1-a482d42b117f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:29.124806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 673/1308] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:51:29.169209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f33a60-04cb-4ceb-b4ba-892d69612444 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:29.169771 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f33a60-04cb-4ceb-b4ba-892d69612444 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:29.170296 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f33a60-04cb-4ceb-b4ba-892d69612444 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:29.173084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 636/1309] 10.222.0.49 () {54 vars in 964 bytes} [Tue May 10 13:51:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:29.179921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad713f-e87e-4c66-9d0e-a660939f62c2 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:29.180440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad713f-e87e-4c66-9d0e-a660939f62c2 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:29.180817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad713f-e87e-4c66-9d0e-a660939f62c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:29.277805 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-fbad713f-e87e-4c66-9d0e-a660939f62c2 None None] MFA Rules not processed for user `930f350dad954c7783f479bbb25c1f46`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:29.279314 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-fbad713f-e87e-4c66-9d0e-a660939f62c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:29.368255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 674/1310] 10.222.0.49 () {58 vars in 1061 bytes} [Tue May 10 13:51:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:51:29.379728 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f33a60-04cb-4ceb-b4ba-892d69612444 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:29.381409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-58f33a60-04cb-4ceb-b4ba-892d69612444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:29.489308 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f33a60-04cb-4ceb-b4ba-892d69612444 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:29.561321 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044905a-9212-4cb7-be78-8085f71a68f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:29.561966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044905a-9212-4cb7-be78-8085f71a68f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:29.562360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044905a-9212-4cb7-be78-8085f71a68f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:29.562641 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044905a-9212-4cb7-be78-8085f71a68f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:29.564317 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-1044905a-9212-4cb7-be78-8085f71a68f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:29.681302 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044905a-9212-4cb7-be78-8085f71a68f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:29.682653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044905a-9212-4cb7-be78-8085f71a68f8 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:29.702846 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 637/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:51:32.257904 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1b8ef-dd70-428f-ae75-503a9d136efa None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:32.258418 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1b8ef-dd70-428f-ae75-503a9d136efa None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:32.258513 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1b8ef-dd70-428f-ae75-503a9d136efa None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:32.259919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 675/1312] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:32.265485 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b585fc-a945-4090-8329-c922f2d024ee None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:32.266062 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b585fc-a945-4090-8329-c922f2d024ee None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:32.266062 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b585fc-a945-4090-8329-c922f2d024ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:32.344481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-89b585fc-a945-4090-8329-c922f2d024ee None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:32.352210 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-89b585fc-a945-4090-8329-c922f2d024ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:32.450932 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 638/1313] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:51:32.488577 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1b8ef-dd70-428f-ae75-503a9d136efa None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:32.490114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-22f1b8ef-dd70-428f-ae75-503a9d136efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:32.591120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1b8ef-dd70-428f-ae75-503a9d136efa None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:32.661364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2387859-9a14-4542-b942-59c763e11060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:32.661999 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2387859-9a14-4542-b942-59c763e11060 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:32.662273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2387859-9a14-4542-b942-59c763e11060 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:32.662543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2387859-9a14-4542-b942-59c763e11060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:32.664131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e2387859-9a14-4542-b942-59c763e11060 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:32.768444 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2387859-9a14-4542-b942-59c763e11060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:32.769903 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2387859-9a14-4542-b942-59c763e11060 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:32.788830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 676/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:51:35.360994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cd186-4573-4ae3-9366-b98943aba034 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:35.361610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cd186-4573-4ae3-9366-b98943aba034 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:35.361610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cd186-4573-4ae3-9366-b98943aba034 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:35.362890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 639/1315] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:35.368021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571dd66-74c1-46fc-ab6c-3dc38255a77e None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:35.368449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571dd66-74c1-46fc-ab6c-3dc38255a77e None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:35.368617 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571dd66-74c1-46fc-ab6c-3dc38255a77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:35.431901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-b571dd66-74c1-46fc-ab6c-3dc38255a77e None None] MFA Rules not processed for user `f8ba6a1b884747dbaf2896a3adc5c00f`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:35.433167 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b571dd66-74c1-46fc-ab6c-3dc38255a77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:35.526678 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 677/1316] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:51:35 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:51:35.566169 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cd186-4573-4ae3-9366-b98943aba034 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:35.567663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-cb3cd186-4573-4ae3-9366-b98943aba034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:35.667772 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cd186-4573-4ae3-9366-b98943aba034 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:35.737115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c6d53-5589-4f6d-a851-2863bb0bf2b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:35.737752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c6d53-5589-4f6d-a851-2863bb0bf2b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:35.738031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c6d53-5589-4f6d-a851-2863bb0bf2b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:35.738300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c6d53-5589-4f6d-a851-2863bb0bf2b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:35.739909 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ed4c6d53-5589-4f6d-a851-2863bb0bf2b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:35.842806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c6d53-5589-4f6d-a851-2863bb0bf2b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:35.844241 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c6d53-5589-4f6d-a851-2863bb0bf2b0 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:35.862851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 640/1317] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:51:35 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:51:38.645822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c885a-08fd-4806-b80a-b32674409062 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:38.646349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c885a-08fd-4806-b80a-b32674409062 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:38.646349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c885a-08fd-4806-b80a-b32674409062 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:38.647695 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 678/1318] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:38.653718 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c4583-8be8-4b09-853b-9eab8d2995fa None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:38.654145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c4583-8be8-4b09-853b-9eab8d2995fa None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:38.654254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c4583-8be8-4b09-853b-9eab8d2995fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:38.715868 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-b89c4583-8be8-4b09-853b-9eab8d2995fa None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:38.717105 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b89c4583-8be8-4b09-853b-9eab8d2995fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:38.809949 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 641/1319] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:51:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:51:38.863487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b74544-1ab7-4e44-9b13-b0c68bd2c81f None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:38.863767 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b74544-1ab7-4e44-9b13-b0c68bd2c81f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:38.864059 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b74544-1ab7-4e44-9b13-b0c68bd2c81f None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:38.865508 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 679/1320] 10.222.0.49 () {54 vars in 964 bytes} [Tue May 10 13:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:38.872033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e1b2f-fa71-4a6c-ad03-8f1dffa868d2 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:38.872347 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e1b2f-fa71-4a6c-ad03-8f1dffa868d2 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:38.872641 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e1b2f-fa71-4a6c-ad03-8f1dffa868d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:38.946649 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-481e1b2f-fa71-4a6c-ad03-8f1dffa868d2 None None] MFA Rules not processed for user `930f350dad954c7783f479bbb25c1f46`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:38.947837 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-481e1b2f-fa71-4a6c-ad03-8f1dffa868d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:39.019897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 642/1321] 10.222.0.49 () {58 vars in 1061 bytes} [Tue May 10 13:51:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:51:39.029403 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b74544-1ab7-4e44-9b13-b0c68bd2c81f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:39.030873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f3b74544-1ab7-4e44-9b13-b0c68bd2c81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:39.127853 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b74544-1ab7-4e44-9b13-b0c68bd2c81f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:39.196747 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f1c38-10bf-4543-845b-f62b190de261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:39.197309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f1c38-10bf-4543-845b-f62b190de261 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:39.197587 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f1c38-10bf-4543-845b-f62b190de261 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:39.197857 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f1c38-10bf-4543-845b-f62b190de261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:39.199449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-793f1c38-10bf-4543-845b-f62b190de261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:39.302267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f1c38-10bf-4543-845b-f62b190de261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:39.303711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f1c38-10bf-4543-845b-f62b190de261 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:39.321313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 680/1322] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:51:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 13:51:42.694734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e615ed-508e-4b9e-a3c0-1b0f591d6c3f None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:42.695268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e615ed-508e-4b9e-a3c0-1b0f591d6c3f None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:42.695268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e615ed-508e-4b9e-a3c0-1b0f591d6c3f None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:42.696578 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 643/1323] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:42.702322 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003886e9-3450-4d2c-8688-a6768311b002 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:42.702743 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003886e9-3450-4d2c-8688-a6768311b002 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:42.702895 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003886e9-3450-4d2c-8688-a6768311b002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:42.764492 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-003886e9-3450-4d2c-8688-a6768311b002 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:42.765661 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-003886e9-3450-4d2c-8688-a6768311b002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:42.856962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 681/1324] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:51:42.892515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e615ed-508e-4b9e-a3c0-1b0f591d6c3f None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:42.894007 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-90e615ed-508e-4b9e-a3c0-1b0f591d6c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:42.995963 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e615ed-508e-4b9e-a3c0-1b0f591d6c3f None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:43.065854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae200b-8bdf-4d9a-b28c-61d89aeefcfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:43.066503 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae200b-8bdf-4d9a-b28c-61d89aeefcfd service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:43.066781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae200b-8bdf-4d9a-b28c-61d89aeefcfd service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:43.067053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae200b-8bdf-4d9a-b28c-61d89aeefcfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:43.068690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-cdae200b-8bdf-4d9a-b28c-61d89aeefcfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:43.172812 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae200b-8bdf-4d9a-b28c-61d89aeefcfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:43.174239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae200b-8bdf-4d9a-b28c-61d89aeefcfd service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:43.192223 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 644/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:51:45.470975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2b619-04bd-4fb6-a9a8-bff6fed40d13 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:45.471506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2b619-04bd-4fb6-a9a8-bff6fed40d13 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:45.471506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2b619-04bd-4fb6-a9a8-bff6fed40d13 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:45.473085 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 682/1326] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:45.478443 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12425584-a710-46d5-9941-b3b780882fb4 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:45.478839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12425584-a710-46d5-9941-b3b780882fb4 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:45.479101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12425584-a710-46d5-9941-b3b780882fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:45.543304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-12425584-a710-46d5-9941-b3b780882fb4 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:45.544490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-12425584-a710-46d5-9941-b3b780882fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:45.636522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 645/1327] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:51:45.672604 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2b619-04bd-4fb6-a9a8-bff6fed40d13 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:45.674169 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d8e2b619-04bd-4fb6-a9a8-bff6fed40d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:45.774861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2b619-04bd-4fb6-a9a8-bff6fed40d13 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:45.845571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a34ba-9b1a-4025-a668-f9d777e8637d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:45.846204 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a34ba-9b1a-4025-a668-f9d777e8637d service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:45.846469 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a34ba-9b1a-4025-a668-f9d777e8637d service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:45.846740 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a34ba-9b1a-4025-a668-f9d777e8637d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:45.848347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b18a34ba-9b1a-4025-a668-f9d777e8637d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:45.951764 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a34ba-9b1a-4025-a668-f9d777e8637d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:45.953128 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a34ba-9b1a-4025-a668-f9d777e8637d service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:45.970847 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 683/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:51:48.273611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d5ec0-8c85-4e6f-95c4-0c2cc751d7e7 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:48.274182 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d5ec0-8c85-4e6f-95c4-0c2cc751d7e7 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:48.274182 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d5ec0-8c85-4e6f-95c4-0c2cc751d7e7 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:48.275958 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 646/1329] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:48.281930 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd0381-90cc-4e6b-9026-6d6071035999 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:48.282419 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd0381-90cc-4e6b-9026-6d6071035999 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:48.282518 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd0381-90cc-4e6b-9026-6d6071035999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:48.345820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f4dd0381-90cc-4e6b-9026-6d6071035999 None None] MFA Rules not processed for user `f8ba6a1b884747dbaf2896a3adc5c00f`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:48.347016 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f4dd0381-90cc-4e6b-9026-6d6071035999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:48.441069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 684/1330] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:51:48 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:51:48.485617 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d5ec0-8c85-4e6f-95c4-0c2cc751d7e7 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:48.487248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-528d5ec0-8c85-4e6f-95c4-0c2cc751d7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:48.591363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d5ec0-8c85-4e6f-95c4-0c2cc751d7e7 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:48.661876 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0750964-d514-48cf-a4fe-5a91a0073059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:48.662520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0750964-d514-48cf-a4fe-5a91a0073059 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:48.662797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0750964-d514-48cf-a4fe-5a91a0073059 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:48.663070 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0750964-d514-48cf-a4fe-5a91a0073059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:48.664723 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b0750964-d514-48cf-a4fe-5a91a0073059 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:48.769535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0750964-d514-48cf-a4fe-5a91a0073059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:48.770967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0750964-d514-48cf-a4fe-5a91a0073059 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:48.789168 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 647/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:51:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:51:51.264273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e575051-4c43-40ce-8971-0af01a5db5f8 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:51.264743 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e575051-4c43-40ce-8971-0af01a5db5f8 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:51.264840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e575051-4c43-40ce-8971-0af01a5db5f8 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:51.266185 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 685/1332] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:51.271901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9620bd-86ba-4e60-9194-d37ae7a8ee4a None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:51.272438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9620bd-86ba-4e60-9194-d37ae7a8ee4a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:51.272550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9620bd-86ba-4e60-9194-d37ae7a8ee4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:51.340203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-6f9620bd-86ba-4e60-9194-d37ae7a8ee4a None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:51.341391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-6f9620bd-86ba-4e60-9194-d37ae7a8ee4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:51.433809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 648/1333] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:51:51.470163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e575051-4c43-40ce-8971-0af01a5db5f8 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:51.471660 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-5e575051-4c43-40ce-8971-0af01a5db5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:51.570412 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e575051-4c43-40ce-8971-0af01a5db5f8 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:51.642747 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfec615-bf85-4ae6-ab70-f9fb2bb9caee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:51.643391 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfec615-bf85-4ae6-ab70-f9fb2bb9caee service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:51.643667 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfec615-bf85-4ae6-ab70-f9fb2bb9caee service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:51.643943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfec615-bf85-4ae6-ab70-f9fb2bb9caee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:51.645587 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-acfec615-bf85-4ae6-ab70-f9fb2bb9caee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:51.755785 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfec615-bf85-4ae6-ab70-f9fb2bb9caee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:51.757240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfec615-bf85-4ae6-ab70-f9fb2bb9caee service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:51.775470 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 686/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:51:54.047312 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1957daf-2043-4fd8-8789-7c3e53f82a7c None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:54.047746 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1957daf-2043-4fd8-8789-7c3e53f82a7c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:54.047865 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1957daf-2043-4fd8-8789-7c3e53f82a7c None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:54.049254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 649/1335] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:54.054489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f86213-b365-4bad-a6ab-8c9652617e0b None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:54.054906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f86213-b365-4bad-a6ab-8c9652617e0b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:54.055047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f86213-b365-4bad-a6ab-8c9652617e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:54.117138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f3f86213-b365-4bad-a6ab-8c9652617e0b None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:54.118313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f3f86213-b365-4bad-a6ab-8c9652617e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:54.211121 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 687/1336] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:51:54.251498 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1957daf-2043-4fd8-8789-7c3e53f82a7c None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:54.253075 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b1957daf-2043-4fd8-8789-7c3e53f82a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:54.350920 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1957daf-2043-4fd8-8789-7c3e53f82a7c None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:54.422426 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45014e-b41c-4f7d-bbf6-c4bf342d3b0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:54.423068 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45014e-b41c-4f7d-bbf6-c4bf342d3b0a service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:54.423412 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45014e-b41c-4f7d-bbf6-c4bf342d3b0a service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:54.423686 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45014e-b41c-4f7d-bbf6-c4bf342d3b0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:54.425340 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-da45014e-b41c-4f7d-bbf6-c4bf342d3b0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:54.529431 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45014e-b41c-4f7d-bbf6-c4bf342d3b0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:54.530858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45014e-b41c-4f7d-bbf6-c4bf342d3b0a service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:54.548729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 650/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:51:57.107730 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995b2c7-80c0-40ac-be21-2935fbdd2900 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:57.108283 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995b2c7-80c0-40ac-be21-2935fbdd2900 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:57.108379 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995b2c7-80c0-40ac-be21-2935fbdd2900 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:57.109690 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 688/1338] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:51:57.114856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca239b1-3c47-40d6-9fcd-272ad0cfcfa6 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:57.115296 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca239b1-3c47-40d6-9fcd-272ad0cfcfa6 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:57.115394 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca239b1-3c47-40d6-9fcd-272ad0cfcfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:57.178569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-4ca239b1-3c47-40d6-9fcd-272ad0cfcfa6 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:51:57.181424 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-4ca239b1-3c47-40d6-9fcd-272ad0cfcfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:57.271842 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 651/1339] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:51:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:51:57.308012 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995b2c7-80c0-40ac-be21-2935fbdd2900 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:51:57.309550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c995b2c7-80c0-40ac-be21-2935fbdd2900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:57.407758 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995b2c7-80c0-40ac-be21-2935fbdd2900 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:51:57.477737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c49e5a-a162-4c90-87a1-612fd4d62bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:51:57.478305 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c49e5a-a162-4c90-87a1-612fd4d62bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:51:57.478581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c49e5a-a162-4c90-87a1-612fd4d62bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:51:57.479409 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c49e5a-a162-4c90-87a1-612fd4d62bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:51:57.481047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-19c49e5a-a162-4c90-87a1-612fd4d62bf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:51:57.586247 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c49e5a-a162-4c90-87a1-612fd4d62bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:51:57.587665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c49e5a-a162-4c90-87a1-612fd4d62bf6 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:51:57.606917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 689/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:51:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:52:01.927657 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2f56f-e576-46eb-a1ab-61527b6a3bf3 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:01.928219 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2f56f-e576-46eb-a1ab-61527b6a3bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:01.928219 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2f56f-e576-46eb-a1ab-61527b6a3bf3 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:01.929561 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 652/1341] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:01.935981 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e6136-c70a-4207-a07a-dab925bd2e2c None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:01.936440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e6136-c70a-4207-a07a-dab925bd2e2c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:01.936561 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e6136-c70a-4207-a07a-dab925bd2e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:02.003500 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-bd8e6136-c70a-4207-a07a-dab925bd2e2c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:02.004698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-bd8e6136-c70a-4207-a07a-dab925bd2e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:02.106689 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 690/1342] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:02.144335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2f56f-e576-46eb-a1ab-61527b6a3bf3 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:02.146445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-fed2f56f-e576-46eb-a1ab-61527b6a3bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:02.244010 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2f56f-e576-46eb-a1ab-61527b6a3bf3 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:02.247678 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348170a-d897-45f4-902c-5d6491806ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:02.248353 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348170a-d897-45f4-902c-5d6491806ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:02.248777 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348170a-d897-45f4-902c-5d6491806ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:02.249058 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348170a-d897-45f4-902c-5d6491806ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:02.258277 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348170a-d897-45f4-902c-5d6491806ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:02.259731 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348170a-d897-45f4-902c-5d6491806ed3 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:02.269489 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 653/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:52:05.094328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e12bc8-ae74-47f1-9c38-7fe2b851cd8a None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:05.094865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e12bc8-ae74-47f1-9c38-7fe2b851cd8a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:05.094865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e12bc8-ae74-47f1-9c38-7fe2b851cd8a None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:05.099957 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 691/1344] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:52:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:05.101286 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9cbc8-b6a5-4aac-945d-f5219cd378c5 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:05.101689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9cbc8-b6a5-4aac-945d-f5219cd378c5 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:05.101834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9cbc8-b6a5-4aac-945d-f5219cd378c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:05.129961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-0ab9cbc8-b6a5-4aac-945d-f5219cd378c5 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:05.131123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0ab9cbc8-b6a5-4aac-945d-f5219cd378c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:05.209293 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 654/1345] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:52:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:52:05.248553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e12bc8-ae74-47f1-9c38-7fe2b851cd8a None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:05.259970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e12bc8-ae74-47f1-9c38-7fe2b851cd8a None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:05.263528 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75544df-5caf-4220-b479-2e557b52d63b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:05.264262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75544df-5caf-4220-b479-2e557b52d63b service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:05.264612 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75544df-5caf-4220-b479-2e557b52d63b service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:05.265057 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75544df-5caf-4220-b479-2e557b52d63b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:05.274229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75544df-5caf-4220-b479-2e557b52d63b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:05.276545 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75544df-5caf-4220-b479-2e557b52d63b service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:05.286081 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 692/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:52:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:52:09.587435 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a754b4a-d852-4bf2-9a19-459fd19a4d3e None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:09.588509 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a754b4a-d852-4bf2-9a19-459fd19a4d3e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:09.588509 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a754b4a-d852-4bf2-9a19-459fd19a4d3e None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:09.589845 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 655/1347] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:09.595145 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc1a1f-653c-4cd7-b780-0a5879b9de19 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:09.595517 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc1a1f-653c-4cd7-b780-0a5879b9de19 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:09.595517 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc1a1f-653c-4cd7-b780-0a5879b9de19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:09.613845 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-16fc1a1f-653c-4cd7-b780-0a5879b9de19 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:09.615015 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-16fc1a1f-653c-4cd7-b780-0a5879b9de19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:09.622783 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 693/1348] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:09.659705 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a754b4a-d852-4bf2-9a19-459fd19a4d3e None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:09.670775 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a754b4a-d852-4bf2-9a19-459fd19a4d3e None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:09.674265 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bef96-4bd4-46b7-83a7-eff404d6ad93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:09.674892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bef96-4bd4-46b7-83a7-eff404d6ad93 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:09.675167 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bef96-4bd4-46b7-83a7-eff404d6ad93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:09.675437 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bef96-4bd4-46b7-83a7-eff404d6ad93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:09.684112 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bef96-4bd4-46b7-83a7-eff404d6ad93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:09.685552 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bef96-4bd4-46b7-83a7-eff404d6ad93 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:09.694689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 656/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:52:14.944981 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b5541-11ed-441e-8ce7-50a638ffe4e7 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:14.945459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b5541-11ed-441e-8ce7-50a638ffe4e7 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:14.945570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b5541-11ed-441e-8ce7-50a638ffe4e7 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:14.947176 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 694/1350] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 13:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:14.952937 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d49b6-6d3c-4a1a-8bc1-837672ba646c None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:14.953686 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d49b6-6d3c-4a1a-8bc1-837672ba646c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:14.954122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d49b6-6d3c-4a1a-8bc1-837672ba646c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:15.100453 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-266d49b6-6d3c-4a1a-8bc1-837672ba646c None None] MFA Rules not processed for user `d8a29487b009419dbead4684bcd01cae`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:15.101903 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-266d49b6-6d3c-4a1a-8bc1-837672ba646c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:15.245253 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 657/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 13:52:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:19.427359 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bf469-f754-4880-b658-f1b2c91ac82b None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:19.427906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bf469-f754-4880-b658-f1b2c91ac82b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:19.427906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bf469-f754-4880-b658-f1b2c91ac82b None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:19.429588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 695/1352] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 13:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:19.435308 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078256-c37d-4266-b68a-5473cb22808e None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:19.436340 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078256-c37d-4266-b68a-5473cb22808e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:19.436867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078256-c37d-4266-b68a-5473cb22808e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:19.457846 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-15078256-c37d-4266-b68a-5473cb22808e None None] MFA Rules not processed for user `d8a29487b009419dbead4684bcd01cae`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:19.459392 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-15078256-c37d-4266-b68a-5473cb22808e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:19.469505 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 658/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 13:52:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:20.993393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502ccaa-b94c-4146-8c7c-99b69ebb0c77 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:20.994417 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502ccaa-b94c-4146-8c7c-99b69ebb0c77 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:20.994417 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502ccaa-b94c-4146-8c7c-99b69ebb0c77 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:20.995989 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 696/1354] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 13:52:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:21.001072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f0563-0c10-4cb5-a60f-c43d1e96a617 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:21.001500 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f0563-0c10-4cb5-a60f-c43d1e96a617 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:21.001764 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f0563-0c10-4cb5-a60f-c43d1e96a617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:21.021948 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-087f0563-0c10-4cb5-a60f-c43d1e96a617 None None] MFA Rules not processed for user `d8a29487b009419dbead4684bcd01cae`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:21.023127 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-087f0563-0c10-4cb5-a60f-c43d1e96a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:21.031975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 659/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 13:52:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:52:24.933058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2b325-e5b5-485a-af65-b794b5a69b21 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:24.933478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2b325-e5b5-485a-af65-b794b5a69b21 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:24.933600 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2b325-e5b5-485a-af65-b794b5a69b21 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:24.935112 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 697/1356] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:52:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:24.940305 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9f5f6-8759-4d9f-af04-450eceb1f949 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:24.940718 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9f5f6-8759-4d9f-af04-450eceb1f949 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:24.940853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9f5f6-8759-4d9f-af04-450eceb1f949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:24.958109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-83a9f5f6-8759-4d9f-af04-450eceb1f949 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:24.959282 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-83a9f5f6-8759-4d9f-af04-450eceb1f949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:24.967272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 660/1357] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:52:25.014229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1543f-1b8c-41c4-a2e8-e0c82ccbab08 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:25.014505 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1543f-1b8c-41c4-a2e8-e0c82ccbab08 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:25.014775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1543f-1b8c-41c4-a2e8-e0c82ccbab08 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:25.016288 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 698/1358] 10.222.0.49 () {54 vars in 961 bytes} [Tue May 10 13:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:25.021841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a30ab-20d5-49b5-ac12-0987afd5c8ea None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:25.022131 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a30ab-20d5-49b5-ac12-0987afd5c8ea None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:25.022404 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a30ab-20d5-49b5-ac12-0987afd5c8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:25.074332 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-9b6a30ab-20d5-49b5-ac12-0987afd5c8ea None None] MFA Rules not processed for user `975f10f781b94bdaa8edee39a2b1bba4`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:25.075504 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-9b6a30ab-20d5-49b5-ac12-0987afd5c8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:25.156355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 661/1359] 10.222.0.49 () {58 vars in 1058 bytes} [Tue May 10 13:52:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:52:25.162768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1543f-1b8c-41c4-a2e8-e0c82ccbab08 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:25.177460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1543f-1b8c-41c4-a2e8-e0c82ccbab08 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:25.183640 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552640e-952e-4aa2-8329-89fc0e7fdbac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:25.184385 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552640e-952e-4aa2-8329-89fc0e7fdbac service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:25.184894 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552640e-952e-4aa2-8329-89fc0e7fdbac service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:25.185169 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552640e-952e-4aa2-8329-89fc0e7fdbac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:25.193443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552640e-952e-4aa2-8329-89fc0e7fdbac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:25.195165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552640e-952e-4aa2-8329-89fc0e7fdbac service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:25.204574 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 699/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:52:27.643429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cf24a-0ebc-4265-b332-5b7a227cc4a5 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:27.643955 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cf24a-0ebc-4265-b332-5b7a227cc4a5 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:27.644091 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cf24a-0ebc-4265-b332-5b7a227cc4a5 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:27.645474 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 662/1361] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:27.650952 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d26ac-3a7e-4677-823c-ffa7ccd38750 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:27.651346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d26ac-3a7e-4677-823c-ffa7ccd38750 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:27.651499 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d26ac-3a7e-4677-823c-ffa7ccd38750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:27.669117 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-607d26ac-3a7e-4677-823c-ffa7ccd38750 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:27.670306 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-607d26ac-3a7e-4677-823c-ffa7ccd38750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:27.678305 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 700/1362] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:27.722831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cf24a-0ebc-4265-b332-5b7a227cc4a5 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:27.738531 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cf24a-0ebc-4265-b332-5b7a227cc4a5 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:27.744814 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbd817-aaef-415e-9c6f-7076adc6ee04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:27.745805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbd817-aaef-415e-9c6f-7076adc6ee04 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:27.746086 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbd817-aaef-415e-9c6f-7076adc6ee04 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:27.746354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbd817-aaef-415e-9c6f-7076adc6ee04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:27.755024 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbd817-aaef-415e-9c6f-7076adc6ee04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:27.756624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbd817-aaef-415e-9c6f-7076adc6ee04 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:27.768245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 663/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:52:30.352543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29ac82-14d0-4d3f-aa4a-0bf9e1193cbf None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:30.353058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29ac82-14d0-4d3f-aa4a-0bf9e1193cbf None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:30.353157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29ac82-14d0-4d3f-aa4a-0bf9e1193cbf None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:30.354455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 701/1364] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:30.359834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27653720-09e8-49eb-ae2d-b55e3bfb0a7b None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:30.360270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27653720-09e8-49eb-ae2d-b55e3bfb0a7b None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:30.360446 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27653720-09e8-49eb-ae2d-b55e3bfb0a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:30.378725 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-27653720-09e8-49eb-ae2d-b55e3bfb0a7b None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:30.380043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-27653720-09e8-49eb-ae2d-b55e3bfb0a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:30.396466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 664/1365] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:30.442377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44955-00bd-4b29-8e34-a7da55ed7760 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:30.442663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44955-00bd-4b29-8e34-a7da55ed7760 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:30.442941 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44955-00bd-4b29-8e34-a7da55ed7760 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:30.444349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 702/1366] 10.222.0.49 () {54 vars in 961 bytes} [Tue May 10 13:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:30.450303 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983403a2-d57b-4a0d-b98d-70f9b2cb5ca3 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:30.450590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983403a2-d57b-4a0d-b98d-70f9b2cb5ca3 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:30.450870 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983403a2-d57b-4a0d-b98d-70f9b2cb5ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:30.469859 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-983403a2-d57b-4a0d-b98d-70f9b2cb5ca3 None None] MFA Rules not processed for user `975f10f781b94bdaa8edee39a2b1bba4`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:30.471026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-983403a2-d57b-4a0d-b98d-70f9b2cb5ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:30.483223 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 665/1367] 10.222.0.49 () {58 vars in 1058 bytes} [Tue May 10 13:52:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:30.495134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac44955-00bd-4b29-8e34-a7da55ed7760 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:30.510799 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac44955-00bd-4b29-8e34-a7da55ed7760 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:30.517079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478878cf-19e5-4540-b0f5-126ca4aef2c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:30.518003 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478878cf-19e5-4540-b0f5-126ca4aef2c8 service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:30.518490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478878cf-19e5-4540-b0f5-126ca4aef2c8 service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:30.518968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478878cf-19e5-4540-b0f5-126ca4aef2c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:30.528810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478878cf-19e5-4540-b0f5-126ca4aef2c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:30.530306 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478878cf-19e5-4540-b0f5-126ca4aef2c8 service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:30.540040 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 703/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:52:32.865025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af274ae8-715f-4c62-ba3d-d611f3536803 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:32.865836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af274ae8-715f-4c62-ba3d-d611f3536803 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:32.865836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af274ae8-715f-4c62-ba3d-d611f3536803 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:32.867089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 666/1369] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:32.874617 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814368a-a837-41d2-80cc-3548bce3a65d None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:32.875284 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814368a-a837-41d2-80cc-3548bce3a65d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:32.875284 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814368a-a837-41d2-80cc-3548bce3a65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:32.909014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-2814368a-a837-41d2-80cc-3548bce3a65d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:32.911473 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-2814368a-a837-41d2-80cc-3548bce3a65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:32.940327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 704/1370] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:33.011138 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af274ae8-715f-4c62-ba3d-d611f3536803 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:33.027244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af274ae8-715f-4c62-ba3d-d611f3536803 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:33.032760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e103a-2ba4-4022-b3d4-3e72d76b9321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:33.033392 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e103a-2ba4-4022-b3d4-3e72d76b9321 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:33.033671 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e103a-2ba4-4022-b3d4-3e72d76b9321 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:33.033942 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e103a-2ba4-4022-b3d4-3e72d76b9321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:33.042854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e103a-2ba4-4022-b3d4-3e72d76b9321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:33.044457 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e103a-2ba4-4022-b3d4-3e72d76b9321 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:33.054252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 667/1371] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:52:33.275606 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b131e5-f878-414c-a993-1ef68d0c7a5a None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:33.276152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b131e5-f878-414c-a993-1ef68d0c7a5a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:33.276787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b131e5-f878-414c-a993-1ef68d0c7a5a None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:33.278779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 705/1372] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:52:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:33.284387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56465bad-e678-4388-bfe9-5dd15979257d None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:33.284671 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56465bad-e678-4388-bfe9-5dd15979257d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:33.285124 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56465bad-e678-4388-bfe9-5dd15979257d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:33.306573 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-56465bad-e678-4388-bfe9-5dd15979257d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:33.307757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-56465bad-e678-4388-bfe9-5dd15979257d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:33.315925 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 668/1373] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:33.640325 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaddef-fbe9-489d-9ffa-2b3f2478fa04 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:33.640325 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaddef-fbe9-489d-9ffa-2b3f2478fa04 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:33.640666 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaddef-fbe9-489d-9ffa-2b3f2478fa04 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:33.642067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 706/1374] 10.222.0.49 () {54 vars in 963 bytes} [Tue May 10 13:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:33.647370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2085f0-4a12-4574-908c-f2f0b1357f1a None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:33.647764 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2085f0-4a12-4574-908c-f2f0b1357f1a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:33.648157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2085f0-4a12-4574-908c-f2f0b1357f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:33.699008 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-1f2085f0-4a12-4574-908c-f2f0b1357f1a None None] MFA Rules not processed for user `7fc8efc2d5134bdba361a5c7bcfc1ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:33.700335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-1f2085f0-4a12-4574-908c-f2f0b1357f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:33.762600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 669/1375] 10.222.0.49 () {58 vars in 1060 bytes} [Tue May 10 13:52:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:33.770680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaddef-fbe9-489d-9ffa-2b3f2478fa04 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:33.783443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaddef-fbe9-489d-9ffa-2b3f2478fa04 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:33.787372 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21551975-70a3-4dbe-a951-0882e0791946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:33.788075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21551975-70a3-4dbe-a951-0882e0791946 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:33.788455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21551975-70a3-4dbe-a951-0882e0791946 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:33.788792 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21551975-70a3-4dbe-a951-0882e0791946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:33.798671 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21551975-70a3-4dbe-a951-0882e0791946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:33.800158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21551975-70a3-4dbe-a951-0882e0791946 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:33.811613 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 707/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 13:52:35.328850 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53640daa-30d3-4be0-86c1-6e045d2a016c None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:35.329450 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53640daa-30d3-4be0-86c1-6e045d2a016c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:35.329450 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53640daa-30d3-4be0-86c1-6e045d2a016c None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:35.330814 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 670/1377] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:35.336990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfcfc2-72e7-4eed-b980-71e9d662f47a None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:35.337599 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfcfc2-72e7-4eed-b980-71e9d662f47a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:35.337599 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfcfc2-72e7-4eed-b980-71e9d662f47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:35.357510 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-d0cfcfc2-72e7-4eed-b980-71e9d662f47a None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:35.358777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d0cfcfc2-72e7-4eed-b980-71e9d662f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:35.367103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 708/1378] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:35.413458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53640daa-30d3-4be0-86c1-6e045d2a016c None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:35.428385 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53640daa-30d3-4be0-86c1-6e045d2a016c None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:35.434618 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e322d-1ea0-4bd0-a52d-8a0dcf0e62d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:35.435266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e322d-1ea0-4bd0-a52d-8a0dcf0e62d5 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:35.435541 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e322d-1ea0-4bd0-a52d-8a0dcf0e62d5 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:35.435814 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e322d-1ea0-4bd0-a52d-8a0dcf0e62d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:35.444835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e322d-1ea0-4bd0-a52d-8a0dcf0e62d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:35.446445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e322d-1ea0-4bd0-a52d-8a0dcf0e62d5 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:35.456858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 671/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:52:37.754170 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b79202-c96f-400b-9c6a-de8f9f33aade None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:37.754781 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b79202-c96f-400b-9c6a-de8f9f33aade None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:37.754781 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b79202-c96f-400b-9c6a-de8f9f33aade None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:37.756070 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 709/1380] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:37.761475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5a19d-cac8-46eb-8ed3-b18ac7e800b0 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:37.762278 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5a19d-cac8-46eb-8ed3-b18ac7e800b0 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:37.762757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5a19d-cac8-46eb-8ed3-b18ac7e800b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:37.780544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-4be5a19d-cac8-46eb-8ed3-b18ac7e800b0 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:37.781721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-4be5a19d-cac8-46eb-8ed3-b18ac7e800b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:37.789910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 672/1381] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:37.838838 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b79202-c96f-400b-9c6a-de8f9f33aade None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:37.853683 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b79202-c96f-400b-9c6a-de8f9f33aade None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:37.860097 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d553a-b27e-46ea-8f7d-8501817dc8d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:37.860772 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d553a-b27e-46ea-8f7d-8501817dc8d1 service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:37.861051 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d553a-b27e-46ea-8f7d-8501817dc8d1 service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:37.861328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d553a-b27e-46ea-8f7d-8501817dc8d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:37.870649 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d553a-b27e-46ea-8f7d-8501817dc8d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:37.872240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d553a-b27e-46ea-8f7d-8501817dc8d1 service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:37.881965 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 710/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:52:40.142875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545808b-3882-4c22-b7de-b7d55e10a9ef None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:40.143434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545808b-3882-4c22-b7de-b7d55e10a9ef None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:40.143434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545808b-3882-4c22-b7de-b7d55e10a9ef None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:40.144857 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 673/1383] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:40.150832 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863348b-36fa-4ecb-969d-24bfeadfa9b8 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:40.151240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863348b-36fa-4ecb-969d-24bfeadfa9b8 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:40.151375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863348b-36fa-4ecb-969d-24bfeadfa9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:40.168946 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-7863348b-36fa-4ecb-969d-24bfeadfa9b8 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:40.170105 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-7863348b-36fa-4ecb-969d-24bfeadfa9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:40.177884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 711/1384] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:40.223206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545808b-3882-4c22-b7de-b7d55e10a9ef None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:40.239190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545808b-3882-4c22-b7de-b7d55e10a9ef None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:40.246636 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c329f4-da53-4e2d-a090-bf58371a3bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:40.247297 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c329f4-da53-4e2d-a090-bf58371a3bd1 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:40.247573 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c329f4-da53-4e2d-a090-bf58371a3bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:40.247833 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c329f4-da53-4e2d-a090-bf58371a3bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:40.256973 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c329f4-da53-4e2d-a090-bf58371a3bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:40.258657 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c329f4-da53-4e2d-a090-bf58371a3bd1 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:40.270729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 674/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:52:42.510340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbcf3e-e8e5-466b-981b-7e78583bb650 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:42.510911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbcf3e-e8e5-466b-981b-7e78583bb650 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:42.510911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbcf3e-e8e5-466b-981b-7e78583bb650 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:42.512275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 712/1386] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:52:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:42.518225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ffe54-e2b4-4b66-b383-3b57a17a6d0e None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:42.518735 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ffe54-e2b4-4b66-b383-3b57a17a6d0e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:42.518940 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ffe54-e2b4-4b66-b383-3b57a17a6d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:42.542013 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-774ffe54-e2b4-4b66-b383-3b57a17a6d0e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:42.543484 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-774ffe54-e2b4-4b66-b383-3b57a17a6d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:42.553471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 675/1387] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:42.606972 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbcf3e-e8e5-466b-981b-7e78583bb650 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:42.621808 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbcf3e-e8e5-466b-981b-7e78583bb650 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:42.627836 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33c24d-3b29-4043-874b-5ce40c7e42ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:42.628540 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33c24d-3b29-4043-874b-5ce40c7e42ca service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:42.628777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33c24d-3b29-4043-874b-5ce40c7e42ca service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:42.629047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33c24d-3b29-4043-874b-5ce40c7e42ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:42.638505 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33c24d-3b29-4043-874b-5ce40c7e42ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:42.640027 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33c24d-3b29-4043-874b-5ce40c7e42ca service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:42.649911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 713/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:52:45.192541 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c94bcd-4bbf-4460-97ac-919cfd1d882e None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:45.193069 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c94bcd-4bbf-4460-97ac-919cfd1d882e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:45.193214 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c94bcd-4bbf-4460-97ac-919cfd1d882e None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:45.194933 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 676/1389] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:45.200198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f924d4-7549-41d6-b0e7-293f7df844bf None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:45.200717 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f924d4-7549-41d6-b0e7-293f7df844bf None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:45.200872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f924d4-7549-41d6-b0e7-293f7df844bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:45.218066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-39f924d4-7549-41d6-b0e7-293f7df844bf None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:45.219246 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-39f924d4-7549-41d6-b0e7-293f7df844bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:45.227321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 714/1390] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:45.271971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c94bcd-4bbf-4460-97ac-919cfd1d882e None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:45.287015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c94bcd-4bbf-4460-97ac-919cfd1d882e None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:45.293247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953f39a-2316-43b9-9baf-3c864700f0ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:45.293898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953f39a-2316-43b9-9baf-3c864700f0ad service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:45.294184 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953f39a-2316-43b9-9baf-3c864700f0ad service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:45.294463 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953f39a-2316-43b9-9baf-3c864700f0ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:45.303109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953f39a-2316-43b9-9baf-3c864700f0ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:45.304780 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953f39a-2316-43b9-9baf-3c864700f0ad service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:45.320788 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 677/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:52:47.611542 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a01454-155f-4631-a9a7-9c8b2176d087 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:47.612150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a01454-155f-4631-a9a7-9c8b2176d087 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:47.612150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a01454-155f-4631-a9a7-9c8b2176d087 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:47.613505 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 715/1392] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:52:47.619590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341333e6-870d-4394-884b-ab1e66bf8855 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:47.620080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341333e6-870d-4394-884b-ab1e66bf8855 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:47.620228 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341333e6-870d-4394-884b-ab1e66bf8855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:47.637447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-341333e6-870d-4394-884b-ab1e66bf8855 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:47.638541 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-341333e6-870d-4394-884b-ab1e66bf8855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:47.646219 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 678/1393] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:47.689903 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a01454-155f-4631-a9a7-9c8b2176d087 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:47.704668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a01454-155f-4631-a9a7-9c8b2176d087 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:47.709972 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ef466-0589-4a2c-b119-faa1581057ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:47.710899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef466-0589-4a2c-b119-faa1581057ef service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:47.711172 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef466-0589-4a2c-b119-faa1581057ef service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:47.711777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef466-0589-4a2c-b119-faa1581057ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:47.721528 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ef466-0589-4a2c-b119-faa1581057ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:47.723303 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ef466-0589-4a2c-b119-faa1581057ef service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:47.733513 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 716/1394] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:52:49.461123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32386556-0b79-41c5-8762-6325b831d53a None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:49.461680 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32386556-0b79-41c5-8762-6325b831d53a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:49.461680 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32386556-0b79-41c5-8762-6325b831d53a None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:49.463090 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 679/1395] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:49.468433 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac4146-90ac-44fb-9ea4-1164391e6d9a None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:49.468867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac4146-90ac-44fb-9ea4-1164391e6d9a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:49.468991 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac4146-90ac-44fb-9ea4-1164391e6d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:49.487530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-9fac4146-90ac-44fb-9ea4-1164391e6d9a None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:49.488771 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-9fac4146-90ac-44fb-9ea4-1164391e6d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:49.497273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 717/1396] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:49.553273 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e515793-0dd6-4ddb-ac03-d64e3df35fd4 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:49.553557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e515793-0dd6-4ddb-ac03-d64e3df35fd4 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:49.553833 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e515793-0dd6-4ddb-ac03-d64e3df35fd4 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:49.555317 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 680/1397] 10.222.0.49 () {54 vars in 962 bytes} [Tue May 10 13:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:49.560807 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1182ec-4b54-4494-9e9e-0532daa4560a None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:49.561162 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1182ec-4b54-4494-9e9e-0532daa4560a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:49.561497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1182ec-4b54-4494-9e9e-0532daa4560a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:49.608807 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-0a1182ec-4b54-4494-9e9e-0532daa4560a None None] MFA Rules not processed for user `2d674fd1d6ab43ab982b66bb2349b625`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:49.609988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-0a1182ec-4b54-4494-9e9e-0532daa4560a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:49.667349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 718/1398] 10.222.0.49 () {58 vars in 1059 bytes} [Tue May 10 13:52:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:49.674662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e515793-0dd6-4ddb-ac03-d64e3df35fd4 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:49.685854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e515793-0dd6-4ddb-ac03-d64e3df35fd4 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:49.689369 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8200345-3a42-4cf8-8623-ced3e8d30754 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d674fd1d6ab43ab982b66bb2349b625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:49.689989 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8200345-3a42-4cf8-8623-ced3e8d30754 service glance] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:49.690317 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8200345-3a42-4cf8-8623-ced3e8d30754 service glance] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:49.690591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8200345-3a42-4cf8-8623-ced3e8d30754 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:49.699286 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8200345-3a42-4cf8-8623-ced3e8d30754 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:49.700732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8200345-3a42-4cf8-8623-ced3e8d30754 service glance] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:49.709831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 681/1399] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:52:49.970481 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08407-53a2-4ded-911b-87399f8092a4 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:49.970696 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08407-53a2-4ded-911b-87399f8092a4 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:49.970950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08407-53a2-4ded-911b-87399f8092a4 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:49.972393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 719/1400] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:49.978439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e539e-75b6-4216-8fa7-a66fadf8ac7a None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:49.978732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e539e-75b6-4216-8fa7-a66fadf8ac7a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:49.979013 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e539e-75b6-4216-8fa7-a66fadf8ac7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:49.996888 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-d43e539e-75b6-4216-8fa7-a66fadf8ac7a None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:49.998140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d43e539e-75b6-4216-8fa7-a66fadf8ac7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:50.006244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 682/1401] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:50.049824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde08407-53a2-4ded-911b-87399f8092a4 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:50.064197 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde08407-53a2-4ded-911b-87399f8092a4 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:50.069769 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98277835-a822-4807-98be-5b3f80c93bd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:50.070397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98277835-a822-4807-98be-5b3f80c93bd0 service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:50.070677 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98277835-a822-4807-98be-5b3f80c93bd0 service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:50.070954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98277835-a822-4807-98be-5b3f80c93bd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:50.079039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98277835-a822-4807-98be-5b3f80c93bd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:50.080640 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98277835-a822-4807-98be-5b3f80c93bd0 service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:50.091192 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 720/1402] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:52:50.131639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947002b-cf89-48c6-a127-f2c3c3c311ac None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:50.131923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947002b-cf89-48c6-a127-f2c3c3c311ac None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:50.132292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947002b-cf89-48c6-a127-f2c3c3c311ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:50.184523 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-8947002b-cf89-48c6-a127-f2c3c3c311ac None None] MFA Rules not processed for user `df5dcdfb4eda417ebc0af2432497617d`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:50.185755 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8947002b-cf89-48c6-a127-f2c3c3c311ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:50.253589 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 683/1403] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 13:52:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:50.302066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49f4d0-87c7-4244-b30a-6f09fb235603 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:50.302356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49f4d0-87c7-4244-b30a-6f09fb235603 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:50.302638 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49f4d0-87c7-4244-b30a-6f09fb235603 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:50.304035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 721/1404] 10.222.0.49 () {54 vars in 942 bytes} [Tue May 10 13:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:50.310837 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b816890-3937-4dbc-8b20-6e126e8fee8a None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:50.311133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b816890-3937-4dbc-8b20-6e126e8fee8a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:50.311415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b816890-3937-4dbc-8b20-6e126e8fee8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:50.361150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-1b816890-3937-4dbc-8b20-6e126e8fee8a None None] MFA Rules not processed for user `d102155cd1bd4368ad272668da1651f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:50.362337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-1b816890-3937-4dbc-8b20-6e126e8fee8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:50.438219 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 684/1405] 10.222.0.49 () {58 vars in 1039 bytes} [Tue May 10 13:52:50 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:50.447956 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49f4d0-87c7-4244-b30a-6f09fb235603 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:50.460861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49f4d0-87c7-4244-b30a-6f09fb235603 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:50.466715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6814a3e-2792-4420-935e-817c3608522d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd102155cd1bd4368ad272668da1651f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:50.467444 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6814a3e-2792-4420-935e-817c3608522d service swift] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:50.467723 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6814a3e-2792-4420-935e-817c3608522d service swift] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:50.468026 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6814a3e-2792-4420-935e-817c3608522d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:50.476225 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6814a3e-2792-4420-935e-817c3608522d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:50.477762 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6814a3e-2792-4420-935e-817c3608522d service swift] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:50.486144 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 722/1406] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 13:52:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 13:52:52.372230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd38831-808a-44f1-8bd0-5fd2a786f1b4 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:52.372791 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd38831-808a-44f1-8bd0-5fd2a786f1b4 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:52.372791 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd38831-808a-44f1-8bd0-5fd2a786f1b4 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:52.381620 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 685/1407] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:52:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:52:52.381851 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5d821-283b-4055-a899-841bd747c935 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:52.381851 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5d821-283b-4055-a899-841bd747c935 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:52.381851 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5d821-283b-4055-a899-841bd747c935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:52.416034 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-99a5d821-283b-4055-a899-841bd747c935 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:52:52.417895 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-99a5d821-283b-4055-a899-841bd747c935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:52:52.439582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 723/1408] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:52:52.483114 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd38831-808a-44f1-8bd0-5fd2a786f1b4 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:52:52.502063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd38831-808a-44f1-8bd0-5fd2a786f1b4 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:52:52.507658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10c758-c693-4578-896f-73ea3fc73b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:52:52.508342 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10c758-c693-4578-896f-73ea3fc73b2d service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:52:52.508634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10c758-c693-4578-896f-73ea3fc73b2d service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:52:52.509480 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10c758-c693-4578-896f-73ea3fc73b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:52:52.518808 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10c758-c693-4578-896f-73ea3fc73b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:52:52.520372 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10c758-c693-4578-896f-73ea3fc73b2d service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:52:52.540687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 686/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:14.266892 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005f66e-72d2-41c9-aa25-a2aba3a9473b None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:14.267568 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005f66e-72d2-41c9-aa25-a2aba3a9473b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:14.267568 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005f66e-72d2-41c9-aa25-a2aba3a9473b None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:14.268861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 724/1410] 10.222.0.49 () {54 vars in 918 bytes} [Tue May 10 13:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:14.274545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceff91d-7c50-449f-9a71-2838097bf1c6 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:14.275009 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceff91d-7c50-449f-9a71-2838097bf1c6 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:14.275106 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceff91d-7c50-449f-9a71-2838097bf1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:14.292906 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-9ceff91d-7c50-449f-9a71-2838097bf1c6 None None] MFA Rules not processed for user `d8a29487b009419dbead4684bcd01cae`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:14.294070 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-9ceff91d-7c50-449f-9a71-2838097bf1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:14.306404 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 687/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Tue May 10 13:53:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:14.321256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534247a-129d-4b42-bc9e-532d46a6bca0 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:14.321541 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534247a-129d-4b42-bc9e-532d46a6bca0 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:14.321813 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534247a-129d-4b42-bc9e-532d46a6bca0 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:14.323150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 725/1412] 10.222.0.49 () {54 vars in 918 bytes} [Tue May 10 13:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:14.327548 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0e94d-bb00-445e-87e9-eafd4b27aa91 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:14.327831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0e94d-bb00-445e-87e9-eafd4b27aa91 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:14.328109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0e94d-bb00-445e-87e9-eafd4b27aa91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:14.346382 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-e0d0e94d-bb00-445e-87e9-eafd4b27aa91 None None] MFA Rules not processed for user `975f10f781b94bdaa8edee39a2b1bba4`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:14.347564 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-e0d0e94d-bb00-445e-87e9-eafd4b27aa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:14.356651 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 688/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Tue May 10 13:53:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:17.037246 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2292f0-f3e5-44ef-bf14-0072d2708fbb None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:17.037798 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2292f0-f3e5-44ef-bf14-0072d2708fbb None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:17.037798 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2292f0-f3e5-44ef-bf14-0072d2708fbb None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:17.039141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 726/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:17.044340 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b92403-9d49-4f78-bd63-302cf15021c6 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:17.044750 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b92403-9d49-4f78-bd63-302cf15021c6 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:17.044870 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b92403-9d49-4f78-bd63-302cf15021c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:17.061749 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-b3b92403-9d49-4f78-bd63-302cf15021c6 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:17.062900 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b3b92403-9d49-4f78-bd63-302cf15021c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:17.070548 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 689/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:17.111628 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2292f0-f3e5-44ef-bf14-0072d2708fbb None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:17.125518 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2292f0-f3e5-44ef-bf14-0072d2708fbb None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:17.131130 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5b996-e76a-421c-a94f-7de150110972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:17.131761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5b996-e76a-421c-a94f-7de150110972 service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:17.132040 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5b996-e76a-421c-a94f-7de150110972 service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:17.132342 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5b996-e76a-421c-a94f-7de150110972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:17.140977 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5b996-e76a-421c-a94f-7de150110972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:17.142524 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5b996-e76a-421c-a94f-7de150110972 service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:17.153595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 727/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:18.135092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764c83a-28d7-411b-87e2-6d4abea8b2f0 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:18.135677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764c83a-28d7-411b-87e2-6d4abea8b2f0 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:18.135677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764c83a-28d7-411b-87e2-6d4abea8b2f0 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:18.137046 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 690/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:18.141970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acaa0d-3291-4d85-9272-099167ccae5b None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:18.142400 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acaa0d-3291-4d85-9272-099167ccae5b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:18.142516 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acaa0d-3291-4d85-9272-099167ccae5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:18.160678 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f9acaa0d-3291-4d85-9272-099167ccae5b None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:18.161843 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f9acaa0d-3291-4d85-9272-099167ccae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:18.170118 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 728/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:18.329026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764c83a-28d7-411b-87e2-6d4abea8b2f0 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:18.343379 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764c83a-28d7-411b-87e2-6d4abea8b2f0 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:18.348694 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d50d0-4715-497d-b091-a48cedb4f797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:18.349348 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d50d0-4715-497d-b091-a48cedb4f797 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:18.349643 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d50d0-4715-497d-b091-a48cedb4f797 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:18.349935 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d50d0-4715-497d-b091-a48cedb4f797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:18.358755 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d50d0-4715-497d-b091-a48cedb4f797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:18.360348 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d50d0-4715-497d-b091-a48cedb4f797 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:18.370313 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 691/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:19.310649 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e740d-db52-4e0d-b7d3-95dd85022d74 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:19.311170 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e740d-db52-4e0d-b7d3-95dd85022d74 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:19.311170 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e740d-db52-4e0d-b7d3-95dd85022d74 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:19.312551 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 729/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:19.317781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02327c-565e-4eeb-96c1-ad8ead97d34e None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:19.318170 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02327c-565e-4eeb-96c1-ad8ead97d34e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:19.318334 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02327c-565e-4eeb-96c1-ad8ead97d34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:19.336424 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-0a02327c-565e-4eeb-96c1-ad8ead97d34e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:19.337585 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0a02327c-565e-4eeb-96c1-ad8ead97d34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:19.345279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 692/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:19.504743 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e740d-db52-4e0d-b7d3-95dd85022d74 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:19.518848 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e740d-db52-4e0d-b7d3-95dd85022d74 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:19.524263 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0929c-5b37-45f2-ada3-c7da9b054bdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:19.524893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0929c-5b37-45f2-ada3-c7da9b054bdd service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:19.525169 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0929c-5b37-45f2-ada3-c7da9b054bdd service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:19.525439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0929c-5b37-45f2-ada3-c7da9b054bdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:19.533563 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0929c-5b37-45f2-ada3-c7da9b054bdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:19.535108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0929c-5b37-45f2-ada3-c7da9b054bdd service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:19.544691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 730/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:20.473079 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2944aa9-45b8-4830-bd47-ba75c1237db3 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:20.473662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2944aa9-45b8-4830-bd47-ba75c1237db3 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:20.473662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2944aa9-45b8-4830-bd47-ba75c1237db3 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:20.474997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 693/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:20.479980 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4500a65-1e84-4f27-8319-5f5d65b2ea46 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:20.480440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4500a65-1e84-4f27-8319-5f5d65b2ea46 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:20.480571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4500a65-1e84-4f27-8319-5f5d65b2ea46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:20.498747 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-d4500a65-1e84-4f27-8319-5f5d65b2ea46 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:20.499921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d4500a65-1e84-4f27-8319-5f5d65b2ea46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:20.507763 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 731/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:20.657569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2944aa9-45b8-4830-bd47-ba75c1237db3 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:20.671317 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2944aa9-45b8-4830-bd47-ba75c1237db3 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:20.676627 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dda808-98e7-482f-8b4f-b5b50ae30586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:20.677249 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dda808-98e7-482f-8b4f-b5b50ae30586 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:20.677525 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dda808-98e7-482f-8b4f-b5b50ae30586 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:20.677797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dda808-98e7-482f-8b4f-b5b50ae30586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:20.686116 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dda808-98e7-482f-8b4f-b5b50ae30586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:20.687681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dda808-98e7-482f-8b4f-b5b50ae30586 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:20.697328 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 694/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:21.623828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d6b74-3318-4cab-a067-76d73c550f37 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:21.624442 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d6b74-3318-4cab-a067-76d73c550f37 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:21.624442 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d6b74-3318-4cab-a067-76d73c550f37 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:21.625793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 732/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:21.630768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c24d0-8506-484a-b653-ae0429b219b3 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:21.631206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c24d0-8506-484a-b653-ae0429b219b3 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:21.631318 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c24d0-8506-484a-b653-ae0429b219b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:21.649621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-7d0c24d0-8506-484a-b653-ae0429b219b3 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:21.650978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-7d0c24d0-8506-484a-b653-ae0429b219b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:21.658644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 695/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:21.807081 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d6b74-3318-4cab-a067-76d73c550f37 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:21.821695 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d6b74-3318-4cab-a067-76d73c550f37 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:21.827042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577e111-6834-4302-99a5-65f410a3709e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:21.827664 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577e111-6834-4302-99a5-65f410a3709e service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:21.827945 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577e111-6834-4302-99a5-65f410a3709e service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:21.828246 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577e111-6834-4302-99a5-65f410a3709e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:21.836236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577e111-6834-4302-99a5-65f410a3709e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:21.838302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577e111-6834-4302-99a5-65f410a3709e service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:21.847382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 733/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:22.706603 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace018d-1abe-4743-963f-65817a119800 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:22.707183 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace018d-1abe-4743-963f-65817a119800 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:22.707183 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace018d-1abe-4743-963f-65817a119800 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:22.708529 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 696/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:22.713702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e0181-56b4-449e-846a-54394046250c None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:22.714120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e0181-56b4-449e-846a-54394046250c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:22.714259 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e0181-56b4-449e-846a-54394046250c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:22.732469 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-ce4e0181-56b4-449e-846a-54394046250c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:22.733622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ce4e0181-56b4-449e-846a-54394046250c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:22.741269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 734/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:22.891715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace018d-1abe-4743-963f-65817a119800 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:22.906520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace018d-1abe-4743-963f-65817a119800 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:22.911930 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24401202-c5a2-4e87-869b-852c500970d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:22.912591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24401202-c5a2-4e87-869b-852c500970d9 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:22.912870 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24401202-c5a2-4e87-869b-852c500970d9 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:22.913146 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24401202-c5a2-4e87-869b-852c500970d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:22.921586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24401202-c5a2-4e87-869b-852c500970d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:22.923152 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24401202-c5a2-4e87-869b-852c500970d9 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:22.932340 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 697/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:23.805308 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32390ce6-03cb-4f50-a304-120bd85f91a1 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:23.805846 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32390ce6-03cb-4f50-a304-120bd85f91a1 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:23.805846 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32390ce6-03cb-4f50-a304-120bd85f91a1 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:23.807140 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 735/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:23.812086 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4955be-5c8d-448e-b64c-f91307ecef21 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:23.812763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4955be-5c8d-448e-b64c-f91307ecef21 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:23.813048 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4955be-5c8d-448e-b64c-f91307ecef21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:23.830402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-ae4955be-5c8d-448e-b64c-f91307ecef21 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:23.831578 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ae4955be-5c8d-448e-b64c-f91307ecef21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:23.839969 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 698/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:23.989086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32390ce6-03cb-4f50-a304-120bd85f91a1 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:24.003314 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32390ce6-03cb-4f50-a304-120bd85f91a1 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:24.008593 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1390c8-4330-4491-89b7-d358d5b27cee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:24.009215 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1390c8-4330-4491-89b7-d358d5b27cee service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:24.009490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1390c8-4330-4491-89b7-d358d5b27cee service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:24.009756 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1390c8-4330-4491-89b7-d358d5b27cee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:24.017687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1390c8-4330-4491-89b7-d358d5b27cee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:24.019247 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1390c8-4330-4491-89b7-d358d5b27cee service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:24.029033 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 736/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:24.898245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691257d4-3302-442e-aa81-b37808debce2 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:24.898780 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691257d4-3302-442e-aa81-b37808debce2 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:24.898780 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691257d4-3302-442e-aa81-b37808debce2 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:24.900190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 699/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:24.905433 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d09f-62f7-4299-a739-976046690ac8 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:24.905862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d09f-62f7-4299-a739-976046690ac8 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:24.905995 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d09f-62f7-4299-a739-976046690ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:24.923801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-1bf7d09f-62f7-4299-a739-976046690ac8 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:24.925001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-1bf7d09f-62f7-4299-a739-976046690ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:24.933376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 737/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:25.083946 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691257d4-3302-442e-aa81-b37808debce2 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:25.098116 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691257d4-3302-442e-aa81-b37808debce2 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:25.104018 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0efdb-e281-449c-8963-e6e0de33c8bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:25.104671 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0efdb-e281-449c-8963-e6e0de33c8bf service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:25.104947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0efdb-e281-449c-8963-e6e0de33c8bf service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:25.105216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0efdb-e281-449c-8963-e6e0de33c8bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:25.113062 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0efdb-e281-449c-8963-e6e0de33c8bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:25.114764 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0efdb-e281-449c-8963-e6e0de33c8bf service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:25.124566 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 700/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:26.000256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc46e20-5e36-427c-99e1-c0b4f4b022d6 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:26.000820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc46e20-5e36-427c-99e1-c0b4f4b022d6 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:26.000820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc46e20-5e36-427c-99e1-c0b4f4b022d6 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:26.002169 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 738/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:26.007197 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe406b1-0346-405c-8f0f-062d2860d005 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:26.007602 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe406b1-0346-405c-8f0f-062d2860d005 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:26.007741 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe406b1-0346-405c-8f0f-062d2860d005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:26.025613 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-dbe406b1-0346-405c-8f0f-062d2860d005 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:26.027032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-dbe406b1-0346-405c-8f0f-062d2860d005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:26.034801 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 701/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:26.184755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc46e20-5e36-427c-99e1-c0b4f4b022d6 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:26.199325 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc46e20-5e36-427c-99e1-c0b4f4b022d6 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:26.204718 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f918f8-320c-48fa-97f2-eb83dd3a195b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:26.205345 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f918f8-320c-48fa-97f2-eb83dd3a195b service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:26.205628 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f918f8-320c-48fa-97f2-eb83dd3a195b service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:26.205904 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f918f8-320c-48fa-97f2-eb83dd3a195b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:26.213837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f918f8-320c-48fa-97f2-eb83dd3a195b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:26.215387 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f918f8-320c-48fa-97f2-eb83dd3a195b service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:26.224589 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 739/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:28.304350 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cf0ff-34cc-4982-9953-c251d8be31f2 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:28.304888 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cf0ff-34cc-4982-9953-c251d8be31f2 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:28.304888 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cf0ff-34cc-4982-9953-c251d8be31f2 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:28.306366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 702/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:28.311558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6e15e-f5a4-48ac-8f98-de161ad34b42 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:28.312005 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6e15e-f5a4-48ac-8f98-de161ad34b42 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:28.312116 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6e15e-f5a4-48ac-8f98-de161ad34b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:28.329673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-24f6e15e-f5a4-48ac-8f98-de161ad34b42 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:28.330839 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-24f6e15e-f5a4-48ac-8f98-de161ad34b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:28.339233 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 740/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:53:28.377067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cf0ff-34cc-4982-9953-c251d8be31f2 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:28.387608 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cf0ff-34cc-4982-9953-c251d8be31f2 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:28.391227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba9c09-fdf2-4a28-b71a-b30bd9e8ffdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:28.391855 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba9c09-fdf2-4a28-b71a-b30bd9e8ffdf service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:28.392134 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba9c09-fdf2-4a28-b71a-b30bd9e8ffdf service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:28.392439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba9c09-fdf2-4a28-b71a-b30bd9e8ffdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:28.402061 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba9c09-fdf2-4a28-b71a-b30bd9e8ffdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:28.403468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba9c09-fdf2-4a28-b71a-b30bd9e8ffdf service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:28.412632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 703/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:30.784224 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec9986-f68b-4755-8a5d-3df45fad4201 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:30.784785 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec9986-f68b-4755-8a5d-3df45fad4201 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:30.785056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec9986-f68b-4755-8a5d-3df45fad4201 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:30.786478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 741/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:30.792526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4a266-0be1-4bd7-9aa9-482dc15d3c36 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:30.793021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4a266-0be1-4bd7-9aa9-482dc15d3c36 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:30.793114 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4a266-0be1-4bd7-9aa9-482dc15d3c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:30.810208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-7ae4a266-0be1-4bd7-9aa9-482dc15d3c36 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:30.811384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-7ae4a266-0be1-4bd7-9aa9-482dc15d3c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:30.819301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 704/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:30.857274 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec9986-f68b-4755-8a5d-3df45fad4201 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:30.867619 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec9986-f68b-4755-8a5d-3df45fad4201 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:30.871577 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92a583-b900-49ec-9b08-a15f4629a028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:30.872223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a583-b900-49ec-9b08-a15f4629a028 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:30.872505 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a583-b900-49ec-9b08-a15f4629a028 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:30.872777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a583-b900-49ec-9b08-a15f4629a028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:30.881392 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92a583-b900-49ec-9b08-a15f4629a028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:30.882799 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92a583-b900-49ec-9b08-a15f4629a028 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:30.892657 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 742/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:33.390623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9aa58-986f-4a15-bc50-fcc661186569 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:33.391092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9aa58-986f-4a15-bc50-fcc661186569 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:33.391260 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9aa58-986f-4a15-bc50-fcc661186569 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:33.392681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 705/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:33.398240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dc63f-cef0-447d-8af1-8444646720fd None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:33.398673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dc63f-cef0-447d-8af1-8444646720fd None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:33.398789 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dc63f-cef0-447d-8af1-8444646720fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:33.417299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-371dc63f-cef0-447d-8af1-8444646720fd None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:33.418460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-371dc63f-cef0-447d-8af1-8444646720fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:33.426082 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 743/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:33.463757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9aa58-986f-4a15-bc50-fcc661186569 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:33.465437 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-44d9aa58-986f-4a15-bc50-fcc661186569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:33.478674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9aa58-986f-4a15-bc50-fcc661186569 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:33.482105 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee630f9d-7992-4746-800a-315ead41da45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:33.482725 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee630f9d-7992-4746-800a-315ead41da45 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:33.483003 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee630f9d-7992-4746-800a-315ead41da45 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:33.483275 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee630f9d-7992-4746-800a-315ead41da45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:33.491847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee630f9d-7992-4746-800a-315ead41da45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:33.493689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee630f9d-7992-4746-800a-315ead41da45 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:33.502387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 706/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:35.848417 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7cfdb-c122-46a0-a245-9ffa4e4374c6 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:35.848986 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7cfdb-c122-46a0-a245-9ffa4e4374c6 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:35.848986 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7cfdb-c122-46a0-a245-9ffa4e4374c6 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:35.850321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 744/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:35.856893 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993686ba-a651-4dcb-bf44-fe99781eac2e None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:35.857331 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993686ba-a651-4dcb-bf44-fe99781eac2e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:35.857447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993686ba-a651-4dcb-bf44-fe99781eac2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:35.875140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-993686ba-a651-4dcb-bf44-fe99781eac2e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:35.876355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-993686ba-a651-4dcb-bf44-fe99781eac2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:35.884324 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 707/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:35.922202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7cfdb-c122-46a0-a245-9ffa4e4374c6 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:35.933699 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7cfdb-c122-46a0-a245-9ffa4e4374c6 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:35.937245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0716f23-6f01-4339-b98b-8283facebe22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:35.937870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0716f23-6f01-4339-b98b-8283facebe22 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:35.938151 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0716f23-6f01-4339-b98b-8283facebe22 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:35.938428 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0716f23-6f01-4339-b98b-8283facebe22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:35.947358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0716f23-6f01-4339-b98b-8283facebe22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:35.948814 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0716f23-6f01-4339-b98b-8283facebe22 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:35.958218 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 745/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:38.228664 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55853209-1787-49e4-9ed5-614dc8f3a28c None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:38.229235 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55853209-1787-49e4-9ed5-614dc8f3a28c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:38.229235 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55853209-1787-49e4-9ed5-614dc8f3a28c None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:38.230561 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 708/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:38.235921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85cc2e-c1ff-48b0-b0c8-6849bf02c8ab None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:38.236421 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85cc2e-c1ff-48b0-b0c8-6849bf02c8ab None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:38.236535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85cc2e-c1ff-48b0-b0c8-6849bf02c8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:38.254325 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-4f85cc2e-c1ff-48b0-b0c8-6849bf02c8ab None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:38.255502 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-4f85cc2e-c1ff-48b0-b0c8-6849bf02c8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:38.264186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 746/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:38.302102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55853209-1787-49e4-9ed5-614dc8f3a28c None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:38.313307 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55853209-1787-49e4-9ed5-614dc8f3a28c None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:38.316742 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037aacbf-7922-45b0-aa59-9142f7465d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:38.317364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aacbf-7922-45b0-aa59-9142f7465d03 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:38.317638 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aacbf-7922-45b0-aa59-9142f7465d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:38.317910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aacbf-7922-45b0-aa59-9142f7465d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:38.327132 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037aacbf-7922-45b0-aa59-9142f7465d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:38.328579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037aacbf-7922-45b0-aa59-9142f7465d03 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:38.337562 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 709/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 13:53:40.568605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1689a-3e1a-42e7-84df-a5c00c92c270 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:40.569180 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1689a-3e1a-42e7-84df-a5c00c92c270 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:40.569180 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1689a-3e1a-42e7-84df-a5c00c92c270 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:40.570560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 747/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:40.576497 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cf809-7117-423f-88be-ea94b498dc4c None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:40.576928 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cf809-7117-423f-88be-ea94b498dc4c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:40.577053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cf809-7117-423f-88be-ea94b498dc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:40.594174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-bb2cf809-7117-423f-88be-ea94b498dc4c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:40.595342 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-bb2cf809-7117-423f-88be-ea94b498dc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:40.603019 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 710/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:40.641560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1689a-3e1a-42e7-84df-a5c00c92c270 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:40.652570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1689a-3e1a-42e7-84df-a5c00c92c270 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:40.656098 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f8151-92ec-4404-92fa-70c420d11dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:40.656762 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f8151-92ec-4404-92fa-70c420d11dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:40.657039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f8151-92ec-4404-92fa-70c420d11dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:40.657316 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f8151-92ec-4404-92fa-70c420d11dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:40.666070 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f8151-92ec-4404-92fa-70c420d11dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:40.667472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f8151-92ec-4404-92fa-70c420d11dc1 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:40.676649 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 748/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:42.922480 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276ce6f-ab12-4081-a8d2-d8f4932e6265 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:42.923042 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276ce6f-ab12-4081-a8d2-d8f4932e6265 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:42.923042 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276ce6f-ab12-4081-a8d2-d8f4932e6265 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:42.924436 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 711/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:42.929719 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724b129-1f03-4a6a-8f7a-7c8b359855df None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:42.930678 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724b129-1f03-4a6a-8f7a-7c8b359855df None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:42.930790 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724b129-1f03-4a6a-8f7a-7c8b359855df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:42.949479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-8724b129-1f03-4a6a-8f7a-7c8b359855df None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:42.950694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-8724b129-1f03-4a6a-8f7a-7c8b359855df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:42.958454 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 749/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:42.995461 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276ce6f-ab12-4081-a8d2-d8f4932e6265 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:43.006045 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276ce6f-ab12-4081-a8d2-d8f4932e6265 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:43.009593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d29d62-78a2-4af9-a311-369523ea9838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:43.010341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d29d62-78a2-4af9-a311-369523ea9838 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:43.010625 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d29d62-78a2-4af9-a311-369523ea9838 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:43.010900 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d29d62-78a2-4af9-a311-369523ea9838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:43.019665 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d29d62-78a2-4af9-a311-369523ea9838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:43.021136 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d29d62-78a2-4af9-a311-369523ea9838 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:43.030475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 712/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 13:53:45.379833 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fab612-6296-48a2-8836-ec942bca54e4 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:45.380400 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fab612-6296-48a2-8836-ec942bca54e4 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:45.380492 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fab612-6296-48a2-8836-ec942bca54e4 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:45.381813 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 750/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:53:45.387734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37759d20-1dbf-4b73-8564-e26017624974 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:45.388142 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37759d20-1dbf-4b73-8564-e26017624974 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:45.388297 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37759d20-1dbf-4b73-8564-e26017624974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:45.406267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-37759d20-1dbf-4b73-8564-e26017624974 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:45.407440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-37759d20-1dbf-4b73-8564-e26017624974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:45.415217 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 713/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:45.451608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fab612-6296-48a2-8836-ec942bca54e4 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:45.462680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fab612-6296-48a2-8836-ec942bca54e4 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:45.466312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b001f8c-accf-4d55-bd6d-2d6b296cb28f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:45.466928 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b001f8c-accf-4d55-bd6d-2d6b296cb28f service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:45.467202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b001f8c-accf-4d55-bd6d-2d6b296cb28f service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:45.467477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b001f8c-accf-4d55-bd6d-2d6b296cb28f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:45.476038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b001f8c-accf-4d55-bd6d-2d6b296cb28f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:45.477470 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b001f8c-accf-4d55-bd6d-2d6b296cb28f service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:45.486528 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 751/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:47.714360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373742c-3256-4c66-8809-1872abc9fc41 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:47.714903 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373742c-3256-4c66-8809-1872abc9fc41 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:47.714903 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373742c-3256-4c66-8809-1872abc9fc41 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:47.716639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 714/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:53:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:53:47.722849 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bd16a-9299-4776-8cc2-57e4f057feed None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:47.723309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bd16a-9299-4776-8cc2-57e4f057feed None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:47.723414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bd16a-9299-4776-8cc2-57e4f057feed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:47.740813 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-cb5bd16a-9299-4776-8cc2-57e4f057feed None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:47.741978 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cb5bd16a-9299-4776-8cc2-57e4f057feed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:47.749616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 752/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:47.785555 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373742c-3256-4c66-8809-1872abc9fc41 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:47.795840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373742c-3256-4c66-8809-1872abc9fc41 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:47.799311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301ddcb-4556-47f3-a667-50756395c2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:47.799954 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301ddcb-4556-47f3-a667-50756395c2ed service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:47.800261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301ddcb-4556-47f3-a667-50756395c2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:47.800534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301ddcb-4556-47f3-a667-50756395c2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:47.809572 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301ddcb-4556-47f3-a667-50756395c2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:47.810981 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301ddcb-4556-47f3-a667-50756395c2ed service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:47.820026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 715/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:53:50.044722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195e23d-d755-4c94-96b4-038e855d0aa9 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:50.045294 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195e23d-d755-4c94-96b4-038e855d0aa9 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:50.045294 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195e23d-d755-4c94-96b4-038e855d0aa9 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:50.046640 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 753/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:53:50.052009 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf11e90-c664-4658-9cc9-5473443f8f4d None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:50.052480 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf11e90-c664-4658-9cc9-5473443f8f4d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:50.052601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf11e90-c664-4658-9cc9-5473443f8f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:50.070269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-8bf11e90-c664-4658-9cc9-5473443f8f4d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:53:50.071450 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8bf11e90-c664-4658-9cc9-5473443f8f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:53:50.079189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 716/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:53:50.115268 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195e23d-d755-4c94-96b4-038e855d0aa9 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:53:50.125725 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195e23d-d755-4c94-96b4-038e855d0aa9 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:53:50.129229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca666df-19ad-4ee2-8741-7d88f3d4dea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:53:50.129840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca666df-19ad-4ee2-8741-7d88f3d4dea0 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:53:50.130122 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca666df-19ad-4ee2-8741-7d88f3d4dea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:53:50.130378 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca666df-19ad-4ee2-8741-7d88f3d4dea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:53:50.138957 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca666df-19ad-4ee2-8741-7d88f3d4dea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:53:50.140368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca666df-19ad-4ee2-8741-7d88f3d4dea0 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:53:50.149926 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 754/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 13:54:23.397208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b094e1e-c777-49a5-a6f6-1ee06f38f80d None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:23.398258 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b094e1e-c777-49a5-a6f6-1ee06f38f80d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:23.398375 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b094e1e-c777-49a5-a6f6-1ee06f38f80d None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:23.399718 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 717/1471] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:54:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:23.405170 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0aba4e-3430-4096-a833-e4c99626ff44 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:23.405610 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0aba4e-3430-4096-a833-e4c99626ff44 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:23.405763 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0aba4e-3430-4096-a833-e4c99626ff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:23.423645 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-9d0aba4e-3430-4096-a833-e4c99626ff44 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:23.424856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-9d0aba4e-3430-4096-a833-e4c99626ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:23.432667 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 755/1472] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:23.479328 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95a2e3-bf6e-4d23-ad6b-e7a02880ef18 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:23.479612 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95a2e3-bf6e-4d23-ad6b-e7a02880ef18 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:23.479883 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95a2e3-bf6e-4d23-ad6b-e7a02880ef18 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:23.481270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 718/1473] 10.222.0.49 () {54 vars in 962 bytes} [Tue May 10 13:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:23.485986 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b65f5c-ccfd-48b6-9a8b-06eb5dd52094 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:23.486275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b65f5c-ccfd-48b6-9a8b-06eb5dd52094 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:23.486555 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b65f5c-ccfd-48b6-9a8b-06eb5dd52094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:23.503921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-38b65f5c-ccfd-48b6-9a8b-06eb5dd52094 None None] MFA Rules not processed for user `2d674fd1d6ab43ab982b66bb2349b625`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:23.505113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-38b65f5c-ccfd-48b6-9a8b-06eb5dd52094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:23.511971 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 756/1474] 10.222.0.49 () {58 vars in 1059 bytes} [Tue May 10 13:54:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:23.518853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95a2e3-bf6e-4d23-ad6b-e7a02880ef18 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:23.530137 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95a2e3-bf6e-4d23-ad6b-e7a02880ef18 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:23.533640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20c0de-b262-4843-a770-e1b99b90e74e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d674fd1d6ab43ab982b66bb2349b625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:23.534251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20c0de-b262-4843-a770-e1b99b90e74e service glance] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:23.534529 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20c0de-b262-4843-a770-e1b99b90e74e service glance] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:23.534803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20c0de-b262-4843-a770-e1b99b90e74e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:23.543389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20c0de-b262-4843-a770-e1b99b90e74e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:23.544830 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20c0de-b262-4843-a770-e1b99b90e74e service glance] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:23.554941 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 719/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:54:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:25.859521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43366842-0edb-43a8-8a1f-877aed594b28 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:25.860067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43366842-0edb-43a8-8a1f-877aed594b28 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:25.860067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43366842-0edb-43a8-8a1f-877aed594b28 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:25.861497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 757/1476] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:25.868957 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76a39e-98ba-4678-88b0-32a1aaaadb4d None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:25.869406 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76a39e-98ba-4678-88b0-32a1aaaadb4d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:25.869572 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76a39e-98ba-4678-88b0-32a1aaaadb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:25.886840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-df76a39e-98ba-4678-88b0-32a1aaaadb4d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:25.888020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-df76a39e-98ba-4678-88b0-32a1aaaadb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:25.895821 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 720/1477] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:25.919360 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43366842-0edb-43a8-8a1f-877aed594b28 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:25.932237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43366842-0edb-43a8-8a1f-877aed594b28 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:25.936738 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72dfaf-7055-478e-bd8a-3bb51055acc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:25.937374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72dfaf-7055-478e-bd8a-3bb51055acc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:25.937672 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72dfaf-7055-478e-bd8a-3bb51055acc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:25.937929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72dfaf-7055-478e-bd8a-3bb51055acc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:25.938648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72dfaf-7055-478e-bd8a-3bb51055acc9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:25.940468 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: WARNING py.warnings [None req-cd72dfaf-7055-478e-bd8a-3bb51055acc9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 13:54:25.940468 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: warnings.warn(msg) May 10 13:54:25.940468 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: May 10 13:54:25.941599 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72dfaf-7055-478e-bd8a-3bb51055acc9 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:25.960183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 758/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 13:54:25 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:54:28.202677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac815f55-fe85-4c33-a550-9a2b42915a86 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:28.203209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac815f55-fe85-4c33-a550-9a2b42915a86 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:28.203209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac815f55-fe85-4c33-a550-9a2b42915a86 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:28.204558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 721/1479] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:28.209698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac2410-56fd-4eac-baa0-486b11b17bb5 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:28.210168 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac2410-56fd-4eac-baa0-486b11b17bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:28.210268 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac2410-56fd-4eac-baa0-486b11b17bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:28.229251 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-11ac2410-56fd-4eac-baa0-486b11b17bb5 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:28.230478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-11ac2410-56fd-4eac-baa0-486b11b17bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:28.240572 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 759/1480] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:28.286252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac815f55-fe85-4c33-a550-9a2b42915a86 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:28.300575 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac815f55-fe85-4c33-a550-9a2b42915a86 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:28.306785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31e571-51bf-4e58-ac6f-1ac8cafe467d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:28.307444 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31e571-51bf-4e58-ac6f-1ac8cafe467d service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:28.307722 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31e571-51bf-4e58-ac6f-1ac8cafe467d service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:28.307991 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31e571-51bf-4e58-ac6f-1ac8cafe467d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:28.316062 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31e571-51bf-4e58-ac6f-1ac8cafe467d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:28.317653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31e571-51bf-4e58-ac6f-1ac8cafe467d service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:28.326736 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 722/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:54:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:30.707396 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ab7b8-962e-4ff3-856d-3cb8051b0fb7 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:30.707879 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ab7b8-962e-4ff3-856d-3cb8051b0fb7 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:30.707979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ab7b8-962e-4ff3-856d-3cb8051b0fb7 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:30.709354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 760/1482] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:30.715149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627f49b-455d-4dbf-93e0-6fef75d2ef95 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:30.715590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627f49b-455d-4dbf-93e0-6fef75d2ef95 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:30.715711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627f49b-455d-4dbf-93e0-6fef75d2ef95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:30.733818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-9627f49b-455d-4dbf-93e0-6fef75d2ef95 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:30.734992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-9627f49b-455d-4dbf-93e0-6fef75d2ef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:30.742755 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 723/1483] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:30.778261 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ab7b8-962e-4ff3-856d-3cb8051b0fb7 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:30.790236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ab7b8-962e-4ff3-856d-3cb8051b0fb7 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:30.794539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b5d9a-9f5d-425d-84ce-c2e5db427b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:30.795187 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b5d9a-9f5d-425d-84ce-c2e5db427b4d service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:30.795467 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b5d9a-9f5d-425d-84ce-c2e5db427b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:30.795744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b5d9a-9f5d-425d-84ce-c2e5db427b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:30.805138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b5d9a-9f5d-425d-84ce-c2e5db427b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:30.806543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b5d9a-9f5d-425d-84ce-c2e5db427b4d service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:30.816386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 761/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:54:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:33.118197 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c3cdc-8314-4f9c-9abf-fb258f038c56 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:33.118726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c3cdc-8314-4f9c-9abf-fb258f038c56 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:33.118726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c3cdc-8314-4f9c-9abf-fb258f038c56 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:33.120109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 724/1485] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:33.125231 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8c786-6614-4530-8a82-6bc9407f2c3a None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:33.125710 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8c786-6614-4530-8a82-6bc9407f2c3a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:33.125824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8c786-6614-4530-8a82-6bc9407f2c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:33.143530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-a7a8c786-6614-4530-8a82-6bc9407f2c3a None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:33.144734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a7a8c786-6614-4530-8a82-6bc9407f2c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:33.152685 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 762/1486] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:33.190106 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c3cdc-8314-4f9c-9abf-fb258f038c56 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:33.201243 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c3cdc-8314-4f9c-9abf-fb258f038c56 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:33.204707 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869a37f-5fb9-44b6-8b28-3552b59175dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:33.205321 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869a37f-5fb9-44b6-8b28-3552b59175dc service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:33.205598 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869a37f-5fb9-44b6-8b28-3552b59175dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:33.205867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869a37f-5fb9-44b6-8b28-3552b59175dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:33.214463 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869a37f-5fb9-44b6-8b28-3552b59175dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:33.215865 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869a37f-5fb9-44b6-8b28-3552b59175dc service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:33.224970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 725/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 13:54:35.568483 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629e081-16b7-45e8-8c5f-877a0d3bdff3 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:35.569123 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629e081-16b7-45e8-8c5f-877a0d3bdff3 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:35.569123 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629e081-16b7-45e8-8c5f-877a0d3bdff3 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:35.570408 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 763/1488] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:54:35.575809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89547d6-91ca-4e40-9a14-0a2b330332ab None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:35.576252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89547d6-91ca-4e40-9a14-0a2b330332ab None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:35.576399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89547d6-91ca-4e40-9a14-0a2b330332ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:35.596364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-a89547d6-91ca-4e40-9a14-0a2b330332ab None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:35.597557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a89547d6-91ca-4e40-9a14-0a2b330332ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:35.607551 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 726/1489] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:35.648415 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629e081-16b7-45e8-8c5f-877a0d3bdff3 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:35.659166 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629e081-16b7-45e8-8c5f-877a0d3bdff3 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:35.663366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a497c0f-6be9-4bad-bb0c-cf4e66a72945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:35.663999 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a497c0f-6be9-4bad-bb0c-cf4e66a72945 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:35.664427 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a497c0f-6be9-4bad-bb0c-cf4e66a72945 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:35.664704 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a497c0f-6be9-4bad-bb0c-cf4e66a72945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:35.673388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a497c0f-6be9-4bad-bb0c-cf4e66a72945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:35.674809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a497c0f-6be9-4bad-bb0c-cf4e66a72945 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:35.684840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 764/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:54:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:54:38.079611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86f317-472e-4cae-915d-e83c5217dced None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:38.080205 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86f317-472e-4cae-915d-e83c5217dced None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:38.080205 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86f317-472e-4cae-915d-e83c5217dced None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:38.081548 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 727/1491] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 13:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:54:38.087230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673568e-4825-4471-9bea-51a3b8d91031 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:38.087672 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673568e-4825-4471-9bea-51a3b8d91031 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:38.087782 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673568e-4825-4471-9bea-51a3b8d91031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:38.105628 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-0673568e-4825-4471-9bea-51a3b8d91031 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:54:38.106824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-0673568e-4825-4471-9bea-51a3b8d91031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:54:38.114697 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 765/1492] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 13:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:54:38.152589 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86f317-472e-4cae-915d-e83c5217dced None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:54:38.163652 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86f317-472e-4cae-915d-e83c5217dced None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:54:38.167135 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1148a6e-7a26-49a0-b38e-70670da0c139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:54:38.167748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1148a6e-7a26-49a0-b38e-70670da0c139 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:54:38.168023 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1148a6e-7a26-49a0-b38e-70670da0c139 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:54:38.168324 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1148a6e-7a26-49a0-b38e-70670da0c139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:54:38.176854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1148a6e-7a26-49a0-b38e-70670da0c139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:54:38.178251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1148a6e-7a26-49a0-b38e-70670da0c139 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:54:38.187269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 728/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:54:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:56:05.092815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d7e99-a17f-4547-81f1-aae5ce67f014 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:05.093338 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d7e99-a17f-4547-81f1-aae5ce67f014 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:05.093438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d7e99-a17f-4547-81f1-aae5ce67f014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:05.111163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-ba4d7e99-a17f-4547-81f1-aae5ce67f014 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:56:05.112357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ba4d7e99-a17f-4547-81f1-aae5ce67f014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:56:05.120578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 766/1494] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:56:05.129741 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5165b8-7c20-469f-805e-08dd1b373617 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:05.130222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5165b8-7c20-469f-805e-08dd1b373617 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:05.130324 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5165b8-7c20-469f-805e-08dd1b373617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:05.148101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-7c5165b8-7c20-469f-805e-08dd1b373617 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:56:05.149302 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-7c5165b8-7c20-469f-805e-08dd1b373617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:56:05.157279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 729/1495] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:56:05.162169 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d7e99-a17f-4547-81f1-aae5ce67f014 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:56:05.171624 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d7e99-a17f-4547-81f1-aae5ce67f014 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:56:05.176944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da882c2-5f5c-499c-af46-7bdc5578d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:56:05.177602 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da882c2-5f5c-499c-af46-7bdc5578d0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:05.177887 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da882c2-5f5c-499c-af46-7bdc5578d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:05.178167 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da882c2-5f5c-499c-af46-7bdc5578d0a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:05.178886 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da882c2-5f5c-499c-af46-7bdc5578d0a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:56:05.179191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da882c2-5f5c-499c-af46-7bdc5578d0a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:56:05.180234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: WARNING py.warnings [None req-2da882c2-5f5c-499c-af46-7bdc5578d0a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:56:05.180234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: warnings.warn(msg) May 10 13:56:05.180234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: May 10 13:56:05.181112 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da882c2-5f5c-499c-af46-7bdc5578d0a1 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:56:05.192496 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 767/1496] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 13:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:56:05.200447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5165b8-7c20-469f-805e-08dd1b373617 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:56:05.209225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5165b8-7c20-469f-805e-08dd1b373617 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:56:05.213724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbc6fe-9f5d-448b-8495-8157ef85c72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:56:05.214349 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbc6fe-9f5d-448b-8495-8157ef85c72f admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:05.214627 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbc6fe-9f5d-448b-8495-8157ef85c72f admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:05.214900 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbc6fe-9f5d-448b-8495-8157ef85c72f admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:05.215570 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbc6fe-9f5d-448b-8495-8157ef85c72f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:56:05.217405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: WARNING py.warnings [None req-e3dbc6fe-9f5d-448b-8495-8157ef85c72f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 13:56:05.217405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: warnings.warn(msg) May 10 13:56:05.217405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: May 10 13:56:05.218595 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbc6fe-9f5d-448b-8495-8157ef85c72f admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:56:05.252465 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 730/1497] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 13:56:05 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:56:05.258846 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da882c2-5f5c-499c-af46-7bdc5578d0a1 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:56:05.269338 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da882c2-5f5c-499c-af46-7bdc5578d0a1 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:56:05.323212 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b79b1-e3d4-44b6-91ba-2321dee32cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:56:05.323809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b79b1-e3d4-44b6-91ba-2321dee32cfe admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:05.324091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b79b1-e3d4-44b6-91ba-2321dee32cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:05.324410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b79b1-e3d4-44b6-91ba-2321dee32cfe admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:05.325097 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b79b1-e3d4-44b6-91ba-2321dee32cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:56:05.326578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: WARNING py.warnings [None req-f91b79b1-e3d4-44b6-91ba-2321dee32cfe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 13:56:05.326578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: warnings.warn(msg) May 10 13:56:05.326578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: May 10 13:56:05.327791 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b79b1-e3d4-44b6-91ba-2321dee32cfe admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:56:05.346838 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 768/1498] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 13:56:05 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:56:05.351764 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbc6fe-9f5d-448b-8495-8157ef85c72f admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:56:05.361660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbc6fe-9f5d-448b-8495-8157ef85c72f admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:56:05.366909 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b171b4f-c10f-41e5-b079-c2b20da56808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:56:05.367552 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171b4f-c10f-41e5-b079-c2b20da56808 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:05.367831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171b4f-c10f-41e5-b079-c2b20da56808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:05.368103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171b4f-c10f-41e5-b079-c2b20da56808 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:05.368857 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b171b4f-c10f-41e5-b079-c2b20da56808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:56:05.369853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: WARNING py.warnings [None req-2b171b4f-c10f-41e5-b079-c2b20da56808 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:56:05.369853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: warnings.warn(msg) May 10 13:56:05.369853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: May 10 13:56:05.370731 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b171b4f-c10f-41e5-b079-c2b20da56808 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:56:05.383170 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 731/1499] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:56:05.386960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b79b1-e3d4-44b6-91ba-2321dee32cfe admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:56:05.396759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b79b1-e3d4-44b6-91ba-2321dee32cfe admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:56:05.401759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f416d03-3917-4158-baa8-81df447898dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:56:05.402409 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f416d03-3917-4158-baa8-81df447898dd admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:05.402687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f416d03-3917-4158-baa8-81df447898dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:05.402958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f416d03-3917-4158-baa8-81df447898dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:05.403672 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f416d03-3917-4158-baa8-81df447898dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:56:05.404694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: WARNING py.warnings [None req-9f416d03-3917-4158-baa8-81df447898dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:56:05.404694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: warnings.warn(msg) May 10 13:56:05.404694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: May 10 13:56:05.405580 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f416d03-3917-4158-baa8-81df447898dd admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:56:05.418880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 769/1500] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:56:05.422839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b171b4f-c10f-41e5-b079-c2b20da56808 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:56:05.433105 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b171b4f-c10f-41e5-b079-c2b20da56808 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:56:05.437526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484a57c-0900-441c-8e6b-884ebdc98d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:56:05.438389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484a57c-0900-441c-8e6b-884ebdc98d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:05.438664 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484a57c-0900-441c-8e6b-884ebdc98d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:05.438933 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484a57c-0900-441c-8e6b-884ebdc98d90 admin admin] PATH_INFO: `/v3/projects/c53bfc7a03c54163936bdef7fbcb8505/users/ceb497f8fe1342549a6072615de96eff/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:05.452808 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484a57c-0900-441c-8e6b-884ebdc98d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c53bfc7a03c54163936bdef7fbcb8505, user_id=ceb497f8fe1342549a6072615de96eff, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:56:05.453817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: WARNING py.warnings [None req-d484a57c-0900-441c-8e6b-884ebdc98d90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 13:56:05.453817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: warnings.warn(msg) May 10 13:56:05.453817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: May 10 13:56:05.455717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484a57c-0900-441c-8e6b-884ebdc98d90 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:56:05.469469 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 732/1501] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 13:56:05 2022] PUT /identity/v3/projects/c53bfc7a03c54163936bdef7fbcb8505/users/ceb497f8fe1342549a6072615de96eff/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:56:05.481216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e4e72-c381-4015-8578-7c887120b5a4 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:05.481506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e4e72-c381-4015-8578-7c887120b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:05.481782 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e4e72-c381-4015-8578-7c887120b5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:05.506352 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-5a7e4e72-c381-4015-8578-7c887120b5a4 None None] MFA Rules not processed for user `ceb497f8fe1342549a6072615de96eff`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:56:05.507529 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-5a7e4e72-c381-4015-8578-7c887120b5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:56:05.569567 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 770/1502] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:56:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:56:05.583275 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f659c4d-4734-465f-b96e-f8d58e2b2571 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:05.583559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f659c4d-4734-465f-b96e-f8d58e2b2571 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:05.583834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f659c4d-4734-465f-b96e-f8d58e2b2571 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:05.585212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 733/1503] 10.222.0.49 () {54 vars in 963 bytes} [Tue May 10 13:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:56:05.589936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38b03a-6ab4-4aae-ba8b-14e34787ce58 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:05.590223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38b03a-6ab4-4aae-ba8b-14e34787ce58 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:05.590497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38b03a-6ab4-4aae-ba8b-14e34787ce58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:05.608309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-5d38b03a-6ab4-4aae-ba8b-14e34787ce58 None None] MFA Rules not processed for user `7fc8efc2d5134bdba361a5c7bcfc1ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:56:05.609487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-5d38b03a-6ab4-4aae-ba8b-14e34787ce58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:56:05.657063 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 771/1504] 10.222.0.49 () {58 vars in 1060 bytes} [Tue May 10 13:56:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:56:05.665078 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f659c4d-4734-465f-b96e-f8d58e2b2571 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:56:05.675301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f659c4d-4734-465f-b96e-f8d58e2b2571 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:56:05.678803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507456f3-2b66-40a9-87e9-15002e04a10f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:56:05.679421 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507456f3-2b66-40a9-87e9-15002e04a10f service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:05.679700 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507456f3-2b66-40a9-87e9-15002e04a10f service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:05.679972 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507456f3-2b66-40a9-87e9-15002e04a10f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:05.687933 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507456f3-2b66-40a9-87e9-15002e04a10f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:56:05.689382 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507456f3-2b66-40a9-87e9-15002e04a10f service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:56:05.697837 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 734/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:56:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:56:05.739811 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddeab3-e093-4d3a-b690-97cbdbc6699a None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:05.740101 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddeab3-e093-4d3a-b690-97cbdbc6699a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:05.740431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddeab3-e093-4d3a-b690-97cbdbc6699a None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:05.741864 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 772/1506] 10.222.0.49 () {52 vars in 829 bytes} [Tue May 10 13:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:56:05.745383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507456f3-2b66-40a9-87e9-15002e04a10f service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:56:05.805426 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507456f3-2b66-40a9-87e9-15002e04a10f service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:56:05.809928 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcafd1-f0df-47c2-9d09-5ab723c0864e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:56:05.810782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcafd1-f0df-47c2-9d09-5ab723c0864e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:05.811062 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcafd1-f0df-47c2-9d09-5ab723c0864e admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:05.811337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcafd1-f0df-47c2-9d09-5ab723c0864e admin admin] PATH_INFO: `/v3/users/ceb497f8fe1342549a6072615de96eff` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:05.812540 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcafd1-f0df-47c2-9d09-5ab723c0864e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb497f8fe1342549a6072615de96eff)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:56:05.813535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: WARNING py.warnings [None req-eedcafd1-f0df-47c2-9d09-5ab723c0864e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 13:56:05.813535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: warnings.warn(msg) May 10 13:56:05.813535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: May 10 13:56:05.814733 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcafd1-f0df-47c2-9d09-5ab723c0864e admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:56:05.875618 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-eedcafd1-f0df-47c2-9d09-5ab723c0864e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb497f8fe1342549a6072615de96eff'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:56:05.876377 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-eedcafd1-f0df-47c2-9d09-5ab723c0864e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb497f8fe1342549a6072615de96eff'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:56:05.894110 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-eedcafd1-f0df-47c2-9d09-5ab723c0864e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb497f8fe1342549a6072615de96eff'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:56:05.903763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-eedcafd1-f0df-47c2-9d09-5ab723c0864e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb497f8fe1342549a6072615de96eff'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:56:05.904411 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-eedcafd1-f0df-47c2-9d09-5ab723c0864e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb497f8fe1342549a6072615de96eff'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:56:05.921165 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 735/1507] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 13:56:05 2022] DELETE /identity/v3/users/ceb497f8fe1342549a6072615de96eff => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:56:05.925648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873bf1-697e-4b59-b53f-3bac1d0bd4f1 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:05.925934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873bf1-697e-4b59-b53f-3bac1d0bd4f1 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:05.926213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873bf1-697e-4b59-b53f-3bac1d0bd4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:05.943553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-71873bf1-697e-4b59-b53f-3bac1d0bd4f1 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:56:05.944746 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-71873bf1-697e-4b59-b53f-3bac1d0bd4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:56:06.001612 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 773/1508] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:56:06.012193 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcafd1-f0df-47c2-9d09-5ab723c0864e admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:56:06.013582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-eedcafd1-f0df-47c2-9d09-5ab723c0864e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:56:06.067702 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcafd1-f0df-47c2-9d09-5ab723c0864e admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:56:06.071269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360e728-bf81-412a-84e9-2e64b4f061c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:56:06.071905 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360e728-bf81-412a-84e9-2e64b4f061c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:06.072192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360e728-bf81-412a-84e9-2e64b4f061c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:06.072466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360e728-bf81-412a-84e9-2e64b4f061c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:06.080990 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360e728-bf81-412a-84e9-2e64b4f061c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:56:06.083007 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360e728-bf81-412a-84e9-2e64b4f061c9 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:56:06.092870 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 736/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 13:56:06.455856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71873bf1-697e-4b59-b53f-3bac1d0bd4f1 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:56:06.458932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-71873bf1-697e-4b59-b53f-3bac1d0bd4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:56:06.473201 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71873bf1-697e-4b59-b53f-3bac1d0bd4f1 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:56:06.478419 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ee173-ccc7-47fa-8157-70103ff870eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:56:06.479284 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ee173-ccc7-47fa-8157-70103ff870eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:56:06.479557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ee173-ccc7-47fa-8157-70103ff870eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:56:06.479858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ee173-ccc7-47fa-8157-70103ff870eb admin admin] PATH_INFO: `/v3/projects/c53bfc7a03c54163936bdef7fbcb8505` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:56:06.481014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ee173-ccc7-47fa-8157-70103ff870eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c53bfc7a03c54163936bdef7fbcb8505)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:56:06.482901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: WARNING py.warnings [None req-539ee173-ccc7-47fa-8157-70103ff870eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 13:56:06.482901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: warnings.warn(msg) May 10 13:56:06.482901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: May 10 13:56:06.484094 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ee173-ccc7-47fa-8157-70103ff870eb admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:56:06.545168 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-539ee173-ccc7-47fa-8157-70103ff870eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c53bfc7a03c54163936bdef7fbcb8505', 'request_id': 'req-539ee173-ccc7-47fa-8157-70103ff870eb'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:56:06.554382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-539ee173-ccc7-47fa-8157-70103ff870eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c53bfc7a03c54163936bdef7fbcb8505', 'request_id': 'req-539ee173-ccc7-47fa-8157-70103ff870eb'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:56:06.560454 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-539ee173-ccc7-47fa-8157-70103ff870eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c53bfc7a03c54163936bdef7fbcb8505', 'request_id': 'req-539ee173-ccc7-47fa-8157-70103ff870eb'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:56:06.578568 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-539ee173-ccc7-47fa-8157-70103ff870eb admin admin] The token cache is being invalidate because project c53bfc7a03c54163936bdef7fbcb8505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 13:56:06.578875 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-539ee173-ccc7-47fa-8157-70103ff870eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:56:06.579497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-539ee173-ccc7-47fa-8157-70103ff870eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:56:06.581184 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 774/1510] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 13:56:06 2022] DELETE /identity/v3/projects/c53bfc7a03c54163936bdef7fbcb8505 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:57:49.709953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee3823-2cb3-47ed-b715-ba956960466a None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:49.710549 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee3823-2cb3-47ed-b715-ba956960466a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:49.710549 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee3823-2cb3-47ed-b715-ba956960466a None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:49.711860 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 737/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:57:49.716785 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbf574-014e-46cc-85e4-7f80032813be None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:49.717223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbf574-014e-46cc-85e4-7f80032813be None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:49.717331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbf574-014e-46cc-85e4-7f80032813be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:49.734794 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-a1fbf574-014e-46cc-85e4-7f80032813be None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:57:49.736675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a1fbf574-014e-46cc-85e4-7f80032813be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:57:49.793314 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 775/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:57:49.961148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee3823-2cb3-47ed-b715-ba956960466a None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:57:49.962740 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-70ee3823-2cb3-47ed-b715-ba956960466a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:57:50.035001 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee3823-2cb3-47ed-b715-ba956960466a None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:57:50.040485 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff77768-68ca-4332-8f60-590b70eaa63e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:57:50.041112 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff77768-68ca-4332-8f60-590b70eaa63e service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:50.041395 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff77768-68ca-4332-8f60-590b70eaa63e service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:50.041671 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff77768-68ca-4332-8f60-590b70eaa63e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:50.050094 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff77768-68ca-4332-8f60-590b70eaa63e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:57:50.051672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff77768-68ca-4332-8f60-590b70eaa63e service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:57:50.060787 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 738/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:57:50.441215 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ad0a1-7230-445f-9f02-45d4aad5412c None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:50.442126 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ad0a1-7230-445f-9f02-45d4aad5412c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:50.442408 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ad0a1-7230-445f-9f02-45d4aad5412c None None] PATH_INFO: `/v3` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:50.443762 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 776/1514] 10.222.0.57 () {54 vars in 925 bytes} [Tue May 10 13:57:50 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:57:50.450163 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83ff19-791b-4b52-bc59-2f790b5e2daf None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:50.450456 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83ff19-791b-4b52-bc59-2f790b5e2daf None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:50.450733 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83ff19-791b-4b52-bc59-2f790b5e2daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:50.468535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-8b83ff19-791b-4b52-bc59-2f790b5e2daf None None] MFA Rules not processed for user `d8a29487b009419dbead4684bcd01cae`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:57:50.469735 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8b83ff19-791b-4b52-bc59-2f790b5e2daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:57:50.534096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 739/1515] 10.222.0.57 () {58 vars in 1015 bytes} [Tue May 10 13:57:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:57:51.008435 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07434aca-0592-405c-9b11-edc868e8a730 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:51.009009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07434aca-0592-405c-9b11-edc868e8a730 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:51.009009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07434aca-0592-405c-9b11-edc868e8a730 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:51.010350 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 777/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:57:51.015278 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd81bfe-7973-48e6-9dfb-6d6ffe769702 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:51.015705 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd81bfe-7973-48e6-9dfb-6d6ffe769702 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:51.015811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd81bfe-7973-48e6-9dfb-6d6ffe769702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:51.034348 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-ffd81bfe-7973-48e6-9dfb-6d6ffe769702 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:57:51.035531 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ffd81bfe-7973-48e6-9dfb-6d6ffe769702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:57:51.043631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 740/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:57:51.194325 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07434aca-0592-405c-9b11-edc868e8a730 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:57:51.208892 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07434aca-0592-405c-9b11-edc868e8a730 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:57:51.214234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348de532-c283-4ad1-8229-32d282c71275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:57:51.214855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348de532-c283-4ad1-8229-32d282c71275 service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:51.215136 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348de532-c283-4ad1-8229-32d282c71275 service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:51.215406 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348de532-c283-4ad1-8229-32d282c71275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:51.223758 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348de532-c283-4ad1-8229-32d282c71275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:57:51.225350 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348de532-c283-4ad1-8229-32d282c71275 service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:57:51.234468 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 778/1518] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:57:59.463224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467fd8e-b691-4be5-94ba-323340645dd3 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:59.463738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467fd8e-b691-4be5-94ba-323340645dd3 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:59.463847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467fd8e-b691-4be5-94ba-323340645dd3 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:59.465170 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 741/1519] 10.222.0.49 () {54 vars in 960 bytes} [Tue May 10 13:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:57:59.470793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98de5d-53ae-4f3f-a37b-d90eed5a3544 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:59.471229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98de5d-53ae-4f3f-a37b-d90eed5a3544 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:59.471368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98de5d-53ae-4f3f-a37b-d90eed5a3544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:59.488760 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-1f98de5d-53ae-4f3f-a37b-d90eed5a3544 None None] MFA Rules not processed for user `d8a29487b009419dbead4684bcd01cae`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:57:59.489935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-1f98de5d-53ae-4f3f-a37b-d90eed5a3544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:57:59.498367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 779/1520] 10.222.0.49 () {58 vars in 1057 bytes} [Tue May 10 13:57:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:57:59.505388 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467fd8e-b691-4be5-94ba-323340645dd3 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:57:59.519222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467fd8e-b691-4be5-94ba-323340645dd3 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:57:59.524299 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22544b48-5787-4e84-8e2e-436fd1a239c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8a29487b009419dbead4684bcd01cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:57:59.525170 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22544b48-5787-4e84-8e2e-436fd1a239c7 service placement] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:57:59.525457 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22544b48-5787-4e84-8e2e-436fd1a239c7 service placement] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:57:59.525732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22544b48-5787-4e84-8e2e-436fd1a239c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:57:59.533953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22544b48-5787-4e84-8e2e-436fd1a239c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:57:59.535534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22544b48-5787-4e84-8e2e-436fd1a239c7 service placement] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:57:59.544874 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 742/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:57:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 13:58:02.535373 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b876e92-b6b3-43f7-8051-74873d597bf5 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:02.535903 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b876e92-b6b3-43f7-8051-74873d597bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:02.535903 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b876e92-b6b3-43f7-8051-74873d597bf5 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:02.537240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 780/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:58:02.541934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99218ac-179a-4d1e-ac08-b840efc2f5f4 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:02.542333 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99218ac-179a-4d1e-ac08-b840efc2f5f4 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:02.542493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99218ac-179a-4d1e-ac08-b840efc2f5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:02.560340 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-d99218ac-179a-4d1e-ac08-b840efc2f5f4 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:58:02.561525 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d99218ac-179a-4d1e-ac08-b840efc2f5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:58:02.573831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 743/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:58:02.724880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b876e92-b6b3-43f7-8051-74873d597bf5 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:58:02.739839 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b876e92-b6b3-43f7-8051-74873d597bf5 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:58:02.745347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0d22d-3d39-4c7a-9e48-4fa0e01eeca6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:58:02.745969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0d22d-3d39-4c7a-9e48-4fa0e01eeca6 service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:02.746256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0d22d-3d39-4c7a-9e48-4fa0e01eeca6 service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:02.746529 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0d22d-3d39-4c7a-9e48-4fa0e01eeca6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:02.755026 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0d22d-3d39-4c7a-9e48-4fa0e01eeca6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:58:02.756628 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0d22d-3d39-4c7a-9e48-4fa0e01eeca6 service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:58:02.767144 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 781/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:58:03.671748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f05da0-fa16-426b-b8d3-1ea248876aeb None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:03.672311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f05da0-fa16-426b-b8d3-1ea248876aeb None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:03.672311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f05da0-fa16-426b-b8d3-1ea248876aeb None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:03.674194 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 744/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 13:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:58:03.679328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc67adb-c9b9-4647-925f-e68bf1a253b7 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:03.679762 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc67adb-c9b9-4647-925f-e68bf1a253b7 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:03.679866 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc67adb-c9b9-4647-925f-e68bf1a253b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:03.697422 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-bfc67adb-c9b9-4647-925f-e68bf1a253b7 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:58:03.698578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-bfc67adb-c9b9-4647-925f-e68bf1a253b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:58:03.706238 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 782/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 13:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:58:03.855852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f05da0-fa16-426b-b8d3-1ea248876aeb None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:58:03.870524 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f05da0-fa16-426b-b8d3-1ea248876aeb None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:58:03.875878 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56952be5-0d31-4e0d-a770-bdc9de7dc88b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:58:03.876535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56952be5-0d31-4e0d-a770-bdc9de7dc88b service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:03.876813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56952be5-0d31-4e0d-a770-bdc9de7dc88b service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:03.877086 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56952be5-0d31-4e0d-a770-bdc9de7dc88b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:03.885014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56952be5-0d31-4e0d-a770-bdc9de7dc88b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:58:03.886581 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56952be5-0d31-4e0d-a770-bdc9de7dc88b service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:58:03.896183 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 745/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:58:08.195867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3466fc2-5240-44a5-b53a-a330ded8a0c8 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:08.196445 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3466fc2-5240-44a5-b53a-a330ded8a0c8 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:08.196445 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3466fc2-5240-44a5-b53a-a330ded8a0c8 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:08.197816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 783/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:58:08.203070 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbc27b-dec3-410c-a12c-7d7f6d1d0732 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:08.203477 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbc27b-dec3-410c-a12c-7d7f6d1d0732 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:08.203624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbc27b-dec3-410c-a12c-7d7f6d1d0732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:08.221525 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-cddbc27b-dec3-410c-a12c-7d7f6d1d0732 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:58:08.222689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-cddbc27b-dec3-410c-a12c-7d7f6d1d0732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:58:08.230399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 746/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:58:08.265978 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3466fc2-5240-44a5-b53a-a330ded8a0c8 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:58:08.268275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b3466fc2-5240-44a5-b53a-a330ded8a0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:58:08.328570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3466fc2-5240-44a5-b53a-a330ded8a0c8 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:58:08.332643 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae9473-4ff8-4e3e-8330-5724c1e94b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:58:08.333279 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae9473-4ff8-4e3e-8330-5724c1e94b41 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:08.333555 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae9473-4ff8-4e3e-8330-5724c1e94b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:08.333825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae9473-4ff8-4e3e-8330-5724c1e94b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:08.342326 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae9473-4ff8-4e3e-8330-5724c1e94b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:58:08.343720 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae9473-4ff8-4e3e-8330-5724c1e94b41 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:58:08.352743 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 784/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:58:10.567646 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2758f5-ae05-41b1-810a-dfcd309884f7 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:10.568279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2758f5-ae05-41b1-810a-dfcd309884f7 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:10.568279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2758f5-ae05-41b1-810a-dfcd309884f7 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:10.569567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 747/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:58:10.574844 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26950b59-53cc-497c-8e0e-c0f9c33f5c43 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:10.575248 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26950b59-53cc-497c-8e0e-c0f9c33f5c43 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:10.575432 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26950b59-53cc-497c-8e0e-c0f9c33f5c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:10.593043 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-26950b59-53cc-497c-8e0e-c0f9c33f5c43 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:58:10.594232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-26950b59-53cc-497c-8e0e-c0f9c33f5c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:58:10.602429 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 785/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:58:10.637284 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2758f5-ae05-41b1-810a-dfcd309884f7 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:58:10.648055 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2758f5-ae05-41b1-810a-dfcd309884f7 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:58:10.651762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c38adb-0284-4210-8e0a-9598fe8dd9b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:58:10.652468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c38adb-0284-4210-8e0a-9598fe8dd9b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:10.652744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c38adb-0284-4210-8e0a-9598fe8dd9b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:10.653011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c38adb-0284-4210-8e0a-9598fe8dd9b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:10.662171 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c38adb-0284-4210-8e0a-9598fe8dd9b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:58:10.663573 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c38adb-0284-4210-8e0a-9598fe8dd9b6 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:58:10.672550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 748/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:58:14.441004 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9f6fa-7ff1-4d4d-86e9-f27eee654278 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:14.441552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9f6fa-7ff1-4d4d-86e9-f27eee654278 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:14.441552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9f6fa-7ff1-4d4d-86e9-f27eee654278 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:14.442941 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 786/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:58:14.448082 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d420c85-66d3-4eae-bfd9-301b5e504093 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:14.448537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d420c85-66d3-4eae-bfd9-301b5e504093 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:14.448677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d420c85-66d3-4eae-bfd9-301b5e504093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:14.466182 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-7d420c85-66d3-4eae-bfd9-301b5e504093 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:58:14.467356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-7d420c85-66d3-4eae-bfd9-301b5e504093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:58:14.475483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 749/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:58:14.759070 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9f6fa-7ff1-4d4d-86e9-f27eee654278 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:58:14.761248 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d8b9f6fa-7ff1-4d4d-86e9-f27eee654278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:58:14.818280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9f6fa-7ff1-4d4d-86e9-f27eee654278 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:58:14.821842 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1a840-a289-41d9-924f-acebeee512ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:58:14.822473 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1a840-a289-41d9-924f-acebeee512ae service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:14.822752 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1a840-a289-41d9-924f-acebeee512ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:14.823025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1a840-a289-41d9-924f-acebeee512ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:14.831716 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1a840-a289-41d9-924f-acebeee512ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:58:14.833147 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1a840-a289-41d9-924f-acebeee512ae service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:58:14.842249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 787/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:58:17.139617 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7914e-539a-4efa-97c5-39b5555f0e52 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:17.140055 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7914e-539a-4efa-97c5-39b5555f0e52 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:17.140163 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7914e-539a-4efa-97c5-39b5555f0e52 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:17.141632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 750/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 13:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:58:17.146787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e305a-6a37-4d30-b0ba-bfa75cf4796c None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:17.147210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e305a-6a37-4d30-b0ba-bfa75cf4796c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:17.147346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e305a-6a37-4d30-b0ba-bfa75cf4796c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:17.166565 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-bb2e305a-6a37-4d30-b0ba-bfa75cf4796c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:58:17.167717 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-bb2e305a-6a37-4d30-b0ba-bfa75cf4796c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:58:17.175908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 788/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 13:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:58:17.451183 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7914e-539a-4efa-97c5-39b5555f0e52 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:58:17.452847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-01b7914e-539a-4efa-97c5-39b5555f0e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:58:17.466130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7914e-539a-4efa-97c5-39b5555f0e52 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:58:17.470264 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12776957-dca5-4112-8121-d7c36c8924bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:58:17.470888 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12776957-dca5-4112-8121-d7c36c8924bc service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:58:17.471169 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12776957-dca5-4112-8121-d7c36c8924bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:58:17.471444 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12776957-dca5-4112-8121-d7c36c8924bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:58:17.480097 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12776957-dca5-4112-8121-d7c36c8924bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:58:17.481532 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12776957-dca5-4112-8121-d7c36c8924bc service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:58:17.491284 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 751/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:49.988205 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29647b6-e6e7-459e-8fa6-53d0b53c82d7 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:49.988922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29647b6-e6e7-459e-8fa6-53d0b53c82d7 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:49.988922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29647b6-e6e7-459e-8fa6-53d0b53c82d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.017544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-a29647b6-e6e7-459e-8fa6-53d0b53c82d7 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:50.018770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a29647b6-e6e7-459e-8fa6-53d0b53c82d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:50.031701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 789/1540] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:59:50.042210 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e8dc2-ac9c-494b-87a7-f8d154be9f89 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.043280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e8dc2-ac9c-494b-87a7-f8d154be9f89 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.043787 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e8dc2-ac9c-494b-87a7-f8d154be9f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.072606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-8c8e8dc2-ac9c-494b-87a7-f8d154be9f89 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:50.073840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8c8e8dc2-ac9c-494b-87a7-f8d154be9f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:50.088145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 752/1541] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:59:50.093854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29647b6-e6e7-459e-8fa6-53d0b53c82d7 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:50.109604 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29647b6-e6e7-459e-8fa6-53d0b53c82d7 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:50.118089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed39563-6943-4e7a-8fd7-a4d7ff18c55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:50.118761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed39563-6943-4e7a-8fd7-a4d7ff18c55b admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.119036 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed39563-6943-4e7a-8fd7-a4d7ff18c55b admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.119307 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed39563-6943-4e7a-8fd7-a4d7ff18c55b admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.120031 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed39563-6943-4e7a-8fd7-a4d7ff18c55b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:59:50.120357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed39563-6943-4e7a-8fd7-a4d7ff18c55b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:50.121982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed39563-6943-4e7a-8fd7-a4d7ff18c55b admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:50.141100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 790/1542] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 13:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:59:50.153326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e8dc2-ac9c-494b-87a7-f8d154be9f89 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:50.163343 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e8dc2-ac9c-494b-87a7-f8d154be9f89 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:50.175709 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf431b-7886-4e4e-9ba8-caa9cfb3c7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:50.176408 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf431b-7886-4e4e-9ba8-caa9cfb3c7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.176694 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf431b-7886-4e4e-9ba8-caa9cfb3c7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.176972 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf431b-7886-4e4e-9ba8-caa9cfb3c7e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.177675 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf431b-7886-4e4e-9ba8-caa9cfb3c7e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:50.179742 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf431b-7886-4e4e-9ba8-caa9cfb3c7e3 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:50.234992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529e78f-aba1-4b82-9d26-c30fb6112204 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.235627 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529e78f-aba1-4b82-9d26-c30fb6112204 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.236294 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529e78f-aba1-4b82-9d26-c30fb6112204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.236581 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 753/1543] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:50.241025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf431b-7886-4e4e-9ba8-caa9cfb3c7e3 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:50.268059 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-1529e78f-aba1-4b82-9d26-c30fb6112204 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:50.269682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-1529e78f-aba1-4b82-9d26-c30fb6112204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:50.330442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf431b-7886-4e4e-9ba8-caa9cfb3c7e3 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:50.346645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb803-d639-472d-9105-4598d569d89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:50.347626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb803-d639-472d-9105-4598d569d89e admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.348250 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb803-d639-472d-9105-4598d569d89e admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.348771 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb803-d639-472d-9105-4598d569d89e admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.349985 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bb803-d639-472d-9105-4598d569d89e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:50.351256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: WARNING py.warnings [None req-b90bb803-d639-472d-9105-4598d569d89e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 13:59:50.351256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: warnings.warn(msg) May 10 13:59:50.351256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: May 10 13:59:50.352959 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bb803-d639-472d-9105-4598d569d89e admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:50.375209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 791/1544] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:50.377089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a1ce5-0f88-41f5-b23e-c2e69cc84faf None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.377631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a1ce5-0f88-41f5-b23e-c2e69cc84faf None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.378126 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a1ce5-0f88-41f5-b23e-c2e69cc84faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.396310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 754/1545] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 13:59:50.399372 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbee1eb-b1f0-48dc-8af9-064937e39d29 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.399669 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbee1eb-b1f0-48dc-8af9-064937e39d29 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.399940 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbee1eb-b1f0-48dc-8af9-064937e39d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.416854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-238a1ce5-0f88-41f5-b23e-c2e69cc84faf None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:50.418568 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-238a1ce5-0f88-41f5-b23e-c2e69cc84faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:50.428127 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-2cbee1eb-b1f0-48dc-8af9-064937e39d29 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:50.429351 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-2cbee1eb-b1f0-48dc-8af9-064937e39d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:50.429485 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 792/1546] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:50.431025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4f182-de4a-44a1-8df8-3e89b4228174 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.431547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4f182-de4a-44a1-8df8-3e89b4228174 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.432143 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4f182-de4a-44a1-8df8-3e89b4228174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.443668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 755/1547] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:50.444396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbee1eb-b1f0-48dc-8af9-064937e39d29 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:50.456134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-bac4f182-de4a-44a1-8df8-3e89b4228174 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:50.457744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-bac4f182-de4a-44a1-8df8-3e89b4228174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:50.460681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbee1eb-b1f0-48dc-8af9-064937e39d29 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:50.466204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edbe09-f85a-466b-85e0-7192b3d93f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:50.466873 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edbe09-f85a-466b-85e0-7192b3d93f17 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.467152 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edbe09-f85a-466b-85e0-7192b3d93f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.467459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edbe09-f85a-466b-85e0-7192b3d93f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.467984 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 793/1548] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:50.468206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67edbe09-f85a-466b-85e0-7192b3d93f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:50.469280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e5ab1-df2b-436d-9b62-69dca61a929e None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.469568 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e5ab1-df2b-436d-9b62-69dca61a929e None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.469849 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e5ab1-df2b-436d-9b62-69dca61a929e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.474285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67edbe09-f85a-466b-85e0-7192b3d93f17 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:50.488517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 756/1549] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:50.490266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b5a05-cd0d-4139-84b4-db0470b16b9e None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.490415 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-8e7e5ab1-df2b-436d-9b62-69dca61a929e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:50.490612 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b5a05-cd0d-4139-84b4-db0470b16b9e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.490978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b5a05-cd0d-4139-84b4-db0470b16b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.491681 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-8e7e5ab1-df2b-436d-9b62-69dca61a929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:50.501078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 794/1550] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:50.502358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af90f1-7426-4a4a-8609-23c40a3a1c5b None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.502639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af90f1-7426-4a4a-8609-23c40a3a1c5b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.502916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af90f1-7426-4a4a-8609-23c40a3a1c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.511057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-929b5a05-cd0d-4139-84b4-db0470b16b9e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:50.512331 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-929b5a05-cd0d-4139-84b4-db0470b16b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:50.520275 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 757/1551] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:50.520660 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-b9af90f1-7426-4a4a-8609-23c40a3a1c5b None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:50.521506 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae784ec9-430a-4dfb-a365-a864d92eb40f None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.521793 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae784ec9-430a-4dfb-a365-a864d92eb40f None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.522075 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae784ec9-430a-4dfb-a365-a864d92eb40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.522545 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b9af90f1-7426-4a4a-8609-23c40a3a1c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:50.531456 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 795/1552] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:50.532759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11283da-07a8-480c-9597-263394403919 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.533045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11283da-07a8-480c-9597-263394403919 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.533320 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11283da-07a8-480c-9597-263394403919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.542385 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-ae784ec9-430a-4dfb-a365-a864d92eb40f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:50.543558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ae784ec9-430a-4dfb-a365-a864d92eb40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:50.551973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f11283da-07a8-480c-9597-263394403919 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:50.553045 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 758/1553] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:50.554305 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f11283da-07a8-480c-9597-263394403919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:50.554427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f6b11-98f8-46d9-8b9f-c6108c0987f6 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.554690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f6b11-98f8-46d9-8b9f-c6108c0987f6 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.554967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f6b11-98f8-46d9-8b9f-c6108c0987f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.563031 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 796/1554] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:50.564076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129544c1-5936-4a4a-ba03-35e3be685f42 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.564393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129544c1-5936-4a4a-ba03-35e3be685f42 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.564672 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129544c1-5936-4a4a-ba03-35e3be685f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.578335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-b33f6b11-98f8-46d9-8b9f-c6108c0987f6 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:50.581114 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b33f6b11-98f8-46d9-8b9f-c6108c0987f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:50.583943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-129544c1-5936-4a4a-ba03-35e3be685f42 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:50.585131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-129544c1-5936-4a4a-ba03-35e3be685f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:50.587776 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 759/1555] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:50.588612 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f6b11-98f8-46d9-8b9f-c6108c0987f6 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:50.593337 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 797/1556] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:50.594167 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129544c1-5936-4a4a-ba03-35e3be685f42 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:50.601034 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f6b11-98f8-46d9-8b9f-c6108c0987f6 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:50.605793 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbb79b-347e-4017-9ff7-e73cd3a9f515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:50.606621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbb79b-347e-4017-9ff7-e73cd3a9f515 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.606904 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbb79b-347e-4017-9ff7-e73cd3a9f515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.607172 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbb79b-347e-4017-9ff7-e73cd3a9f515 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.608546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbb79b-347e-4017-9ff7-e73cd3a9f515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:50.609457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129544c1-5936-4a4a-ba03-35e3be685f42 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:50.610285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbb79b-347e-4017-9ff7-e73cd3a9f515 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:50.614072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9819ff-f1d3-4a61-9584-b9b1282e9494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:50.614725 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9819ff-f1d3-4a61-9584-b9b1282e9494 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.615003 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9819ff-f1d3-4a61-9584-b9b1282e9494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.615273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9819ff-f1d3-4a61-9584-b9b1282e9494 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.615984 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9819ff-f1d3-4a61-9584-b9b1282e9494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:59:50.616328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9819ff-f1d3-4a61-9584-b9b1282e9494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:50.617902 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9819ff-f1d3-4a61-9584-b9b1282e9494 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:50.620549 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 760/1557] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:50.621828 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f174fe-37f9-41ae-a425-37ccbd2c588f None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.622125 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f174fe-37f9-41ae-a425-37ccbd2c588f None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.622447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f174fe-37f9-41ae-a425-37ccbd2c588f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.638171 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 798/1558] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 13:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:59:50.638171 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9819ff-f1d3-4a61-9584-b9b1282e9494 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:50.641602 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9819ff-f1d3-4a61-9584-b9b1282e9494 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:50.646188 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-a1f174fe-37f9-41ae-a425-37ccbd2c588f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:50.646317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287fd46-e3a3-45f8-a900-55ae007dcdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:50.646927 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287fd46-e3a3-45f8-a900-55ae007dcdbe admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.647210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287fd46-e3a3-45f8-a900-55ae007dcdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.647486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287fd46-e3a3-45f8-a900-55ae007dcdbe admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.648228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287fd46-e3a3-45f8-a900-55ae007dcdbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:59:50.648536 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287fd46-e3a3-45f8-a900-55ae007dcdbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:50.648631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a1f174fe-37f9-41ae-a425-37ccbd2c588f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:50.653927 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287fd46-e3a3-45f8-a900-55ae007dcdbe admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:50.656889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 761/1559] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:50.657667 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f174fe-37f9-41ae-a425-37ccbd2c588f None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:50.666365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 799/1560] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 13:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:59:50.667687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a705bf-b66b-48d8-8675-2260f43ed213 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.667977 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a705bf-b66b-48d8-8675-2260f43ed213 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.668278 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a705bf-b66b-48d8-8675-2260f43ed213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.671898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f174fe-37f9-41ae-a425-37ccbd2c588f None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:50.676749 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f2c16-caf1-4644-9b0b-c79f5f6fcfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:50.677425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f2c16-caf1-4644-9b0b-c79f5f6fcfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.677706 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f2c16-caf1-4644-9b0b-c79f5f6fcfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.677977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f2c16-caf1-4644-9b0b-c79f5f6fcfd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.678688 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f2c16-caf1-4644-9b0b-c79f5f6fcfd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:59:50.678990 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f2c16-caf1-4644-9b0b-c79f5f6fcfd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:50.680022 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: WARNING py.warnings [None req-725f2c16-caf1-4644-9b0b-c79f5f6fcfd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:59:50.680022 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: warnings.warn(msg) May 10 13:59:50.680022 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: May 10 13:59:50.680948 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f2c16-caf1-4644-9b0b-c79f5f6fcfd6 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:50.685757 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-53a705bf-b66b-48d8-8675-2260f43ed213 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:50.687535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-53a705bf-b66b-48d8-8675-2260f43ed213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:50.693488 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 762/1561] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 13:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:59:50.694375 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f2c16-caf1-4644-9b0b-c79f5f6fcfd6 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:50.702407 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 800/1562] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:50.703648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fd85d-ed6c-417a-bbda-4dfabdc0446f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.704065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fd85d-ed6c-417a-bbda-4dfabdc0446f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.704375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fd85d-ed6c-417a-bbda-4dfabdc0446f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.706724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f2c16-caf1-4644-9b0b-c79f5f6fcfd6 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:50.711292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88930970-d100-4502-833f-8665b1aec30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:50.712002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88930970-d100-4502-833f-8665b1aec30b admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.712314 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88930970-d100-4502-833f-8665b1aec30b admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.712590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88930970-d100-4502-833f-8665b1aec30b admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.713327 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88930970-d100-4502-833f-8665b1aec30b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:59:50.713631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88930970-d100-4502-833f-8665b1aec30b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:50.715214 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88930970-d100-4502-833f-8665b1aec30b admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:50.723469 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-280fd85d-ed6c-417a-bbda-4dfabdc0446f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:50.724711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-280fd85d-ed6c-417a-bbda-4dfabdc0446f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:50.732646 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 763/1563] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 13:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:59:50.733644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 801/1564] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:50.733989 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88930970-d100-4502-833f-8665b1aec30b admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:50.734833 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fd85d-ed6c-417a-bbda-4dfabdc0446f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:50.744952 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fd85d-ed6c-417a-bbda-4dfabdc0446f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:50.746421 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88930970-d100-4502-833f-8665b1aec30b admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:50.750074 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6930d06-7703-43dd-85f2-71690f853d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:50.750732 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6930d06-7703-43dd-85f2-71690f853d15 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.751119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6930d06-7703-43dd-85f2-71690f853d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.751389 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6930d06-7703-43dd-85f2-71690f853d15 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.752199 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6930d06-7703-43dd-85f2-71690f853d15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:50.753313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: WARNING py.warnings [None req-b6930d06-7703-43dd-85f2-71690f853d15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 13:59:50.753313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: warnings.warn(msg) May 10 13:59:50.753313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: May 10 13:59:50.754647 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6930d06-7703-43dd-85f2-71690f853d15 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:50.755541 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368e1bd-81ad-4b0c-9b21-df010f4af505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:50.756460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368e1bd-81ad-4b0c-9b21-df010f4af505 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.756738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368e1bd-81ad-4b0c-9b21-df010f4af505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.757014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368e1bd-81ad-4b0c-9b21-df010f4af505 admin admin] PATH_INFO: `/v3/projects/0f9a7482ebae4ab7a98239a604687af9/users/3bd34a0c3ce246ee855828b8224de95e/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.775647 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368e1bd-81ad-4b0c-9b21-df010f4af505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f9a7482ebae4ab7a98239a604687af9, user_id=3bd34a0c3ce246ee855828b8224de95e, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:50.778602 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368e1bd-81ad-4b0c-9b21-df010f4af505 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:50.786824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 802/1565] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:50.788160 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6930d06-7703-43dd-85f2-71690f853d15 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:50.797012 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 764/1566] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 13:59:50 2022] PUT /identity/v3/projects/0f9a7482ebae4ab7a98239a604687af9/users/3bd34a0c3ce246ee855828b8224de95e/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:50.797810 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368e1bd-81ad-4b0c-9b21-df010f4af505 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:50.864771 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368e1bd-81ad-4b0c-9b21-df010f4af505 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:50.869312 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e4bf9-482b-4aa1-ac76-ee9bb720f29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:50.870067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e4bf9-482b-4aa1-ac76-ee9bb720f29d admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.870332 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e4bf9-482b-4aa1-ac76-ee9bb720f29d admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.870729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e4bf9-482b-4aa1-ac76-ee9bb720f29d admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.870880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6930d06-7703-43dd-85f2-71690f853d15 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:50.871984 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e4bf9-482b-4aa1-ac76-ee9bb720f29d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:50.874174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e4bf9-482b-4aa1-ac76-ee9bb720f29d admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:50.875586 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48279c-87f2-4380-82e8-8b5a5d5c9c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:50.876269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48279c-87f2-4380-82e8-8b5a5d5c9c55 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.876549 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48279c-87f2-4380-82e8-8b5a5d5c9c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.876820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48279c-87f2-4380-82e8-8b5a5d5c9c55 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.881182 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48279c-87f2-4380-82e8-8b5a5d5c9c55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:59:50.881509 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48279c-87f2-4380-82e8-8b5a5d5c9c55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:50.883093 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48279c-87f2-4380-82e8-8b5a5d5c9c55 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:50.895299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 803/1567] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 13:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:59:50.895924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48279c-87f2-4380-82e8-8b5a5d5c9c55 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:50.899975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 765/1568] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:50.904378 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e4bf9-482b-4aa1-ac76-ee9bb720f29d admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:50.910649 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48279c-87f2-4380-82e8-8b5a5d5c9c55 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:50.969043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e4bf9-482b-4aa1-ac76-ee9bb720f29d admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:50.970451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e05fa-1d65-4a54-864c-2120f02b6932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:50.971110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e05fa-1d65-4a54-864c-2120f02b6932 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.971420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e05fa-1d65-4a54-864c-2120f02b6932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.971651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e05fa-1d65-4a54-864c-2120f02b6932 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.972354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e05fa-1d65-4a54-864c-2120f02b6932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:50.974216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e05fa-1d65-4a54-864c-2120f02b6932 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:50.974768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f27ea-c97a-400f-9116-c9ab09a24e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:50.975436 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f27ea-c97a-400f-9116-c9ab09a24e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:50.975713 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f27ea-c97a-400f-9116-c9ab09a24e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:50.975989 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f27ea-c97a-400f-9116-c9ab09a24e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:50.976775 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f27ea-c97a-400f-9116-c9ab09a24e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:59:50.977094 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f27ea-c97a-400f-9116-c9ab09a24e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:50.978801 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f27ea-c97a-400f-9116-c9ab09a24e13 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:50.992814 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 766/1569] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 13:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:59:50.993835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f27ea-c97a-400f-9116-c9ab09a24e13 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.006007 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f27ea-c97a-400f-9116-c9ab09a24e13 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.011738 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 804/1570] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 13:59:50 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:51.011738 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e05fa-1d65-4a54-864c-2120f02b6932 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.070045 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787d562-8b33-48cd-bc76-a59d1ec85582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.070700 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787d562-8b33-48cd-bc76-a59d1ec85582 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.070980 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787d562-8b33-48cd-bc76-a59d1ec85582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.071254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787d562-8b33-48cd-bc76-a59d1ec85582 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.071967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787d562-8b33-48cd-bc76-a59d1ec85582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:59:51.072429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787d562-8b33-48cd-bc76-a59d1ec85582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.075308 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787d562-8b33-48cd-bc76-a59d1ec85582 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.079368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e05fa-1d65-4a54-864c-2120f02b6932 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.084619 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f11154-6b76-4899-8ba2-4aaaae19db6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.085277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f11154-6b76-4899-8ba2-4aaaae19db6e admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.085556 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f11154-6b76-4899-8ba2-4aaaae19db6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.085829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f11154-6b76-4899-8ba2-4aaaae19db6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.086516 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f11154-6b76-4899-8ba2-4aaaae19db6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.086880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 767/1571] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 13:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:59:51.087676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787d562-8b33-48cd-bc76-a59d1ec85582 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.089846 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f11154-6b76-4899-8ba2-4aaaae19db6e admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.097582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787d562-8b33-48cd-bc76-a59d1ec85582 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.102145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce133e96-57f4-4d4a-867d-8dfaab406bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.102785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce133e96-57f4-4d4a-867d-8dfaab406bef admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.103066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce133e96-57f4-4d4a-867d-8dfaab406bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.103340 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce133e96-57f4-4d4a-867d-8dfaab406bef admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.104008 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce133e96-57f4-4d4a-867d-8dfaab406bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.105935 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce133e96-57f4-4d4a-867d-8dfaab406bef admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.119512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 805/1572] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 13:59:51 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:51.119512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6465d9-fe28-41ae-9325-b1473194286f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.119512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6465d9-fe28-41ae-9325-b1473194286f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.119512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6465d9-fe28-41ae-9325-b1473194286f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.129519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 768/1573] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 13:59:51 2022] POST /identity/v3/users => generated 291 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:51.130300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce133e96-57f4-4d4a-867d-8dfaab406bef admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.139540 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce133e96-57f4-4d4a-867d-8dfaab406bef admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.146668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-6f6465d9-fe28-41ae-9325-b1473194286f None None] MFA Rules not processed for user `3bd34a0c3ce246ee855828b8224de95e`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:51.147873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-6f6465d9-fe28-41ae-9325-b1473194286f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:51.194584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd9595-8b65-4999-be60-535d36ebde00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.195251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd9595-8b65-4999-be60-535d36ebde00 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.195531 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd9595-8b65-4999-be60-535d36ebde00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.195800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd9595-8b65-4999-be60-535d36ebde00 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.196508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd9595-8b65-4999-be60-535d36ebde00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.198415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd9595-8b65-4999-be60-535d36ebde00 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.214759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 806/1574] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:51.215382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6465d9-fe28-41ae-9325-b1473194286f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.228341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 769/1575] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 13:59:51 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:51.228341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd9595-8b65-4999-be60-535d36ebde00 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.229223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6465d9-fe28-41ae-9325-b1473194286f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.233899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bffb8-3424-4a1a-8c23-3e980a6ac3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.234588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bffb8-3424-4a1a-8c23-3e980a6ac3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.234867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bffb8-3424-4a1a-8c23-3e980a6ac3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.235140 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bffb8-3424-4a1a-8c23-3e980a6ac3c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.235829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bffb8-3424-4a1a-8c23-3e980a6ac3c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.237783 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bffb8-3424-4a1a-8c23-3e980a6ac3c5 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.238549 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd9595-8b65-4999-be60-535d36ebde00 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.244763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41821989-fef0-4399-8dcb-0e1525acfe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.245491 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41821989-fef0-4399-8dcb-0e1525acfe33 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.246887 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41821989-fef0-4399-8dcb-0e1525acfe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.247201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41821989-fef0-4399-8dcb-0e1525acfe33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.248904 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41821989-fef0-4399-8dcb-0e1525acfe33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.250834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41821989-fef0-4399-8dcb-0e1525acfe33 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.264942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 807/1576] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 13:59:51 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:51.265707 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bffb8-3424-4a1a-8c23-3e980a6ac3c5 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.283751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 770/1577] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 13:59:51 2022] POST /identity/v3/projects => generated 393 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:51.284604 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41821989-fef0-4399-8dcb-0e1525acfe33 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.330973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bffb8-3424-4a1a-8c23-3e980a6ac3c5 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.346960 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41821989-fef0-4399-8dcb-0e1525acfe33 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.351529 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d90c40-583d-4d2f-b4aa-b423d1b227e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.352231 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d90c40-583d-4d2f-b4aa-b423d1b227e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.352513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d90c40-583d-4d2f-b4aa-b423d1b227e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.352786 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d90c40-583d-4d2f-b4aa-b423d1b227e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.353463 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d90c40-583d-4d2f-b4aa-b423d1b227e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.355375 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d90c40-583d-4d2f-b4aa-b423d1b227e0 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.381581 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 771/1578] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 13:59:51 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:51.381581 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d90c40-583d-4d2f-b4aa-b423d1b227e0 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.388784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756901c8-2348-4b60-b7f0-6f7a45eb6713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.390037 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756901c8-2348-4b60-b7f0-6f7a45eb6713 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.390312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756901c8-2348-4b60-b7f0-6f7a45eb6713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.390743 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756901c8-2348-4b60-b7f0-6f7a45eb6713 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.391435 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756901c8-2348-4b60-b7f0-6f7a45eb6713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.393412 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756901c8-2348-4b60-b7f0-6f7a45eb6713 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.413870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 808/1579] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 13:59:51 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:51.414775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756901c8-2348-4b60-b7f0-6f7a45eb6713 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.424987 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756901c8-2348-4b60-b7f0-6f7a45eb6713 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.449042 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d90c40-583d-4d2f-b4aa-b423d1b227e0 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.453705 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c389e5-69bc-4ccd-8e50-06054832dddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.454362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c389e5-69bc-4ccd-8e50-06054832dddc admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.454646 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c389e5-69bc-4ccd-8e50-06054832dddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.454925 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c389e5-69bc-4ccd-8e50-06054832dddc admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.455593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c389e5-69bc-4ccd-8e50-06054832dddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.457585 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c389e5-69bc-4ccd-8e50-06054832dddc admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.476191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 772/1580] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 13:59:51 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:51.477079 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c389e5-69bc-4ccd-8e50-06054832dddc admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.480038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bdc6c-3bd0-485b-a652-fbba7059e0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.480739 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bdc6c-3bd0-485b-a652-fbba7059e0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.481021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bdc6c-3bd0-485b-a652-fbba7059e0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.481292 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bdc6c-3bd0-485b-a652-fbba7059e0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.482014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bdc6c-3bd0-485b-a652-fbba7059e0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.484633 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bdc6c-3bd0-485b-a652-fbba7059e0b8 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.487121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c389e5-69bc-4ccd-8e50-06054832dddc admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.491696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df578bd1-cbe3-42e6-9dc3-076118bec409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.492362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df578bd1-cbe3-42e6-9dc3-076118bec409 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.492647 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df578bd1-cbe3-42e6-9dc3-076118bec409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.492924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df578bd1-cbe3-42e6-9dc3-076118bec409 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.493636 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df578bd1-cbe3-42e6-9dc3-076118bec409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.497200 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 809/1581] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:51.497359 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df578bd1-cbe3-42e6-9dc3-076118bec409 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.497457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0d3b8-c876-4538-9e41-5d5eeb2a4448 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.497457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0d3b8-c876-4538-9e41-5d5eeb2a4448 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.497457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0d3b8-c876-4538-9e41-5d5eeb2a4448 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.497457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 810/1582] 10.222.0.49 () {54 vars in 961 bytes} [Tue May 10 13:59:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:59:51.497928 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0d3b8-c876-4538-9e41-5d5eeb2a4448 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.509041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 773/1583] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:51.509041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df578bd1-cbe3-42e6-9dc3-076118bec409 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.510081 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0d3b8-c876-4538-9e41-5d5eeb2a4448 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.515114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85d634-5dd1-4f50-9be3-d23afe3d9a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.515685 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85d634-5dd1-4f50-9be3-d23afe3d9a91 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.515965 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85d634-5dd1-4f50-9be3-d23afe3d9a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.516272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85d634-5dd1-4f50-9be3-d23afe3d9a91 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.516949 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85d634-5dd1-4f50-9be3-d23afe3d9a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.518617 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df578bd1-cbe3-42e6-9dc3-076118bec409 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.518854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85d634-5dd1-4f50-9be3-d23afe3d9a91 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.523102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883f158-0094-4c67-bea7-139aff1cc0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.523991 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883f158-0094-4c67-bea7-139aff1cc0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.524299 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883f158-0094-4c67-bea7-139aff1cc0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.524589 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883f158-0094-4c67-bea7-139aff1cc0b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.525276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883f158-0094-4c67-bea7-139aff1cc0b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.527154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883f158-0094-4c67-bea7-139aff1cc0b6 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.539302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 811/1584] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 13:59:51 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:51.540124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85d634-5dd1-4f50-9be3-d23afe3d9a91 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.549740 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85d634-5dd1-4f50-9be3-d23afe3d9a91 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.549972 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 774/1585] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 13:59:51 2022] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:51.551687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883f158-0094-4c67-bea7-139aff1cc0b6 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.554894 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65575149-3748-48b7-9b42-29c3f027d968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.555540 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65575149-3748-48b7-9b42-29c3f027d968 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.555819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65575149-3748-48b7-9b42-29c3f027d968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.556137 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65575149-3748-48b7-9b42-29c3f027d968 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.556864 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65575149-3748-48b7-9b42-29c3f027d968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.558755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65575149-3748-48b7-9b42-29c3f027d968 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.561478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883f158-0094-4c67-bea7-139aff1cc0b6 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.566399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef604f13-94d4-4e6e-bde7-0da76affe145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.567096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef604f13-94d4-4e6e-bde7-0da76affe145 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.567420 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef604f13-94d4-4e6e-bde7-0da76affe145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.567653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef604f13-94d4-4e6e-bde7-0da76affe145 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.568426 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef604f13-94d4-4e6e-bde7-0da76affe145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.570332 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef604f13-94d4-4e6e-bde7-0da76affe145 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.584691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 812/1586] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 13:59:51 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:51.585528 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65575149-3748-48b7-9b42-29c3f027d968 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.587664 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 775/1587] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:51.589880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef604f13-94d4-4e6e-bde7-0da76affe145 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.601129 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef604f13-94d4-4e6e-bde7-0da76affe145 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.601439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65575149-3748-48b7-9b42-29c3f027d968 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.606036 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ee376-6467-4eea-93d8-719fc07c0883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.606202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e783e0-a427-4945-9754-3b1e0c22f622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.606783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ee376-6467-4eea-93d8-719fc07c0883 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.606894 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e783e0-a427-4945-9754-3b1e0c22f622 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.607067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ee376-6467-4eea-93d8-719fc07c0883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.607181 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e783e0-a427-4945-9754-3b1e0c22f622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.607346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ee376-6467-4eea-93d8-719fc07c0883 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.607486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e783e0-a427-4945-9754-3b1e0c22f622 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.608072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e783e0-a427-4945-9754-3b1e0c22f622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.608246 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ee376-6467-4eea-93d8-719fc07c0883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.609736 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ee376-6467-4eea-93d8-719fc07c0883 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.609872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e783e0-a427-4945-9754-3b1e0c22f622 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.619683 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 813/1588] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:51.620424 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 776/1589] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:51.621237 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ee376-6467-4eea-93d8-719fc07c0883 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.621943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08902ba1-b10f-4cb2-a4f9-012c69d98f70 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.622862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08902ba1-b10f-4cb2-a4f9-012c69d98f70 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.623346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08902ba1-b10f-4cb2-a4f9-012c69d98f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.631523 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ee376-6467-4eea-93d8-719fc07c0883 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.636457 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71567b-5ba1-4f6b-93b6-f8c60eee636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.637107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71567b-5ba1-4f6b-93b6-f8c60eee636e admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.637387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71567b-5ba1-4f6b-93b6-f8c60eee636e admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.637660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71567b-5ba1-4f6b-93b6-f8c60eee636e admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.638376 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71567b-5ba1-4f6b-93b6-f8c60eee636e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.640575 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71567b-5ba1-4f6b-93b6-f8c60eee636e admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.644192 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-08902ba1-b10f-4cb2-a4f9-012c69d98f70 None None] MFA Rules not processed for user `975f10f781b94bdaa8edee39a2b1bba4`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:51.645401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-08902ba1-b10f-4cb2-a4f9-012c69d98f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:51.650925 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 777/1590] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:51.651554 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71567b-5ba1-4f6b-93b6-f8c60eee636e admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.660950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71567b-5ba1-4f6b-93b6-f8c60eee636e admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.665666 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2edee-7b0e-48d4-bfad-3630dd4c24ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.666311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2edee-7b0e-48d4-bfad-3630dd4c24ff admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.666591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2edee-7b0e-48d4-bfad-3630dd4c24ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.666866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2edee-7b0e-48d4-bfad-3630dd4c24ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.667583 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2edee-7b0e-48d4-bfad-3630dd4c24ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.669222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2edee-7b0e-48d4-bfad-3630dd4c24ff admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.679288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 778/1591] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:51.680148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2edee-7b0e-48d4-bfad-3630dd4c24ff admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.691045 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2edee-7b0e-48d4-bfad-3630dd4c24ff admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.695886 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d41e2-149c-469e-afc6-ea73ccbf0610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.696581 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d41e2-149c-469e-afc6-ea73ccbf0610 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.696851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d41e2-149c-469e-afc6-ea73ccbf0610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.697122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d41e2-149c-469e-afc6-ea73ccbf0610 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.697901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d41e2-149c-469e-afc6-ea73ccbf0610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.699392 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d41e2-149c-469e-afc6-ea73ccbf0610 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.713363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 779/1592] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:51.714342 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d41e2-149c-469e-afc6-ea73ccbf0610 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.718754 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 814/1593] 10.222.0.49 () {58 vars in 1058 bytes} [Tue May 10 13:59:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:51.719581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08902ba1-b10f-4cb2-a4f9-012c69d98f70 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.728287 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d41e2-149c-469e-afc6-ea73ccbf0610 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.729196 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08902ba1-b10f-4cb2-a4f9-012c69d98f70 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.733518 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33792750-6acc-449c-9822-fccc7501aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.734215 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33792750-6acc-449c-9822-fccc7501aacd admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.734479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f73de1-d2fd-4a43-89c4-0b480e5447e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.734609 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33792750-6acc-449c-9822-fccc7501aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.734764 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33792750-6acc-449c-9822-fccc7501aacd admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.735135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f73de1-d2fd-4a43-89c4-0b480e5447e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.735412 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f73de1-d2fd-4a43-89c4-0b480e5447e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.735519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33792750-6acc-449c-9822-fccc7501aacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.735708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f73de1-d2fd-4a43-89c4-0b480e5447e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.736429 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f73de1-d2fd-4a43-89c4-0b480e5447e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.737101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33792750-6acc-449c-9822-fccc7501aacd admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.737991 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f73de1-d2fd-4a43-89c4-0b480e5447e0 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.747402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 780/1594] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:51.750614 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 815/1595] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:51.750745 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33792750-6acc-449c-9822-fccc7501aacd admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.750853 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f73de1-d2fd-4a43-89c4-0b480e5447e0 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.758762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33792750-6acc-449c-9822-fccc7501aacd admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.759721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f73de1-d2fd-4a43-89c4-0b480e5447e0 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.763287 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcab903-5dbe-4a83-8add-7bc5ed7e2e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.764048 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcab903-5dbe-4a83-8add-7bc5ed7e2e8d admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.764407 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcab903-5dbe-4a83-8add-7bc5ed7e2e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.764526 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785ac37-369b-429a-b811-256b0ee7332e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.764679 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcab903-5dbe-4a83-8add-7bc5ed7e2e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.765419 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785ac37-369b-429a-b811-256b0ee7332e admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.765537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcab903-5dbe-4a83-8add-7bc5ed7e2e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.765650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785ac37-369b-429a-b811-256b0ee7332e admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.765923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785ac37-369b-429a-b811-256b0ee7332e admin admin] PATH_INFO: `/v3/projects/924de6c512004326ad32b491e09100ea/users/36d556e6c2f5410690b7d0db3ba761b6/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.766991 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcab903-5dbe-4a83-8add-7bc5ed7e2e8d admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.776907 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 781/1596] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:51.777732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcab903-5dbe-4a83-8add-7bc5ed7e2e8d admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.784423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785ac37-369b-429a-b811-256b0ee7332e admin admin] RBAC: Authorizing `identity:create_grant(project_id=924de6c512004326ad32b491e09100ea, user_id=36d556e6c2f5410690b7d0db3ba761b6, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.785460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: WARNING py.warnings [None req-0785ac37-369b-429a-b811-256b0ee7332e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 13:59:51.785460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: warnings.warn(msg) May 10 13:59:51.785460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: May 10 13:59:51.787409 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785ac37-369b-429a-b811-256b0ee7332e admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.787574 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcab903-5dbe-4a83-8add-7bc5ed7e2e8d admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.792141 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d30fa-5b58-4f00-a5bf-b21175c900d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.793015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d30fa-5b58-4f00-a5bf-b21175c900d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.793290 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d30fa-5b58-4f00-a5bf-b21175c900d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.793564 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d30fa-5b58-4f00-a5bf-b21175c900d1 admin admin] PATH_INFO: `/v3/projects/9a2ad92f31134c51a2834b62a06c173a/users/e58bc02daf614b44bd97f7f123339de4/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.801655 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 816/1597] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 13:59:51 2022] PUT /identity/v3/projects/924de6c512004326ad32b491e09100ea/users/36d556e6c2f5410690b7d0db3ba761b6/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:51.802615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785ac37-369b-429a-b811-256b0ee7332e admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.813452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d30fa-5b58-4f00-a5bf-b21175c900d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2ad92f31134c51a2834b62a06c173a, user_id=e58bc02daf614b44bd97f7f123339de4, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.816140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d30fa-5b58-4f00-a5bf-b21175c900d1 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.829917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 782/1598] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 13:59:51 2022] PUT /identity/v3/projects/9a2ad92f31134c51a2834b62a06c173a/users/e58bc02daf614b44bd97f7f123339de4/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:51.830915 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d30fa-5b58-4f00-a5bf-b21175c900d1 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.864736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785ac37-369b-429a-b811-256b0ee7332e admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.895327 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d30fa-5b58-4f00-a5bf-b21175c900d1 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.902355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fe1e1-4bd2-4669-9cca-2c5530a570ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.903178 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fe1e1-4bd2-4669-9cca-2c5530a570ee admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.903459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fe1e1-4bd2-4669-9cca-2c5530a570ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.903763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fe1e1-4bd2-4669-9cca-2c5530a570ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.904552 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272fe1e1-4bd2-4669-9cca-2c5530a570ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.906663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272fe1e1-4bd2-4669-9cca-2c5530a570ee admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.917307 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 783/1599] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:51.921597 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fe1e1-4bd2-4669-9cca-2c5530a570ee admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.921990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988f77c-e9a1-4cdc-982e-2691c3afbdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.922695 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988f77c-e9a1-4cdc-982e-2691c3afbdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.922990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988f77c-e9a1-4cdc-982e-2691c3afbdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.923297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988f77c-e9a1-4cdc-982e-2691c3afbdf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.923986 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988f77c-e9a1-4cdc-982e-2691c3afbdf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.926313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988f77c-e9a1-4cdc-982e-2691c3afbdf3 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.936384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 817/1600] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:51.937182 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988f77c-e9a1-4cdc-982e-2691c3afbdf3 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.946393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988f77c-e9a1-4cdc-982e-2691c3afbdf3 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.950949 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf464e35-e1d8-4469-a4cc-e85b8cd23e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.952110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf464e35-e1d8-4469-a4cc-e85b8cd23e81 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.952416 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf464e35-e1d8-4469-a4cc-e85b8cd23e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.952686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf464e35-e1d8-4469-a4cc-e85b8cd23e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.953383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf464e35-e1d8-4469-a4cc-e85b8cd23e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:51.955525 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf464e35-e1d8-4469-a4cc-e85b8cd23e81 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:51.965054 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 818/1601] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:51.965801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf464e35-e1d8-4469-a4cc-e85b8cd23e81 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:51.974803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf464e35-e1d8-4469-a4cc-e85b8cd23e81 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.979651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40650db2-5f3a-4510-b1a2-b2fb2b311bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.980540 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40650db2-5f3a-4510-b1a2-b2fb2b311bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.980815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40650db2-5f3a-4510-b1a2-b2fb2b311bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.981089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40650db2-5f3a-4510-b1a2-b2fb2b311bdf admin admin] PATH_INFO: `/v3/projects/854eb7b7a9a44ca283e9c95ce935624d/users/e2218b6609f344dc94f91247e8504e85/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:51.991494 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fe1e1-4bd2-4669-9cca-2c5530a570ee admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:51.997290 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dae7e-31e6-49e5-9e09-d316838efc55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:51.997936 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dae7e-31e6-49e5-9e09-d316838efc55 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:51.998219 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dae7e-31e6-49e5-9e09-d316838efc55 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:51.998536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dae7e-31e6-49e5-9e09-d316838efc55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.000920 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40650db2-5f3a-4510-b1a2-b2fb2b311bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=854eb7b7a9a44ca283e9c95ce935624d, user_id=e2218b6609f344dc94f91247e8504e85, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.003687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40650db2-5f3a-4510-b1a2-b2fb2b311bdf admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.016310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 819/1602] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 13:59:51 2022] PUT /identity/v3/projects/854eb7b7a9a44ca283e9c95ce935624d/users/e2218b6609f344dc94f91247e8504e85/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:52.017870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40650db2-5f3a-4510-b1a2-b2fb2b311bdf admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.056779 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dae7e-31e6-49e5-9e09-d316838efc55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.058351 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dae7e-31e6-49e5-9e09-d316838efc55 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.067618 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 784/1603] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:59:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:52.069533 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4643b-bcdd-4985-b880-964daf5709a0 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.069825 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4643b-bcdd-4985-b880-964daf5709a0 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.070152 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4643b-bcdd-4985-b880-964daf5709a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.078178 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40650db2-5f3a-4510-b1a2-b2fb2b311bdf admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:52.082783 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25b13a-126b-4b6d-9669-d6dc63da6b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:52.083664 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25b13a-126b-4b6d-9669-d6dc63da6b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.083942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25b13a-126b-4b6d-9669-d6dc63da6b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.084240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25b13a-126b-4b6d-9669-d6dc63da6b52 admin admin] PATH_INFO: `/v3/projects/dd39c2a00ace4575896bf3f045bedce1/users/67535c1c99484689999ef478604e51d0/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.096615 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-a5a4643b-bcdd-4985-b880-964daf5709a0 None None] MFA Rules not processed for user `36d556e6c2f5410690b7d0db3ba761b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:52.098404 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a5a4643b-bcdd-4985-b880-964daf5709a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:52.099167 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25b13a-126b-4b6d-9669-d6dc63da6b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd39c2a00ace4575896bf3f045bedce1, user_id=67535c1c99484689999ef478604e51d0, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.101848 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25b13a-126b-4b6d-9669-d6dc63da6b52 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.119460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 820/1604] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 13:59:52 2022] PUT /identity/v3/projects/dd39c2a00ace4575896bf3f045bedce1/users/67535c1c99484689999ef478604e51d0/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:52.119460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fa66b-4eb0-4e64-ac8e-9cec1ec5234a None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.119460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fa66b-4eb0-4e64-ac8e-9cec1ec5234a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.119460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fa66b-4eb0-4e64-ac8e-9cec1ec5234a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.143143 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-573fa66b-4eb0-4e64-ac8e-9cec1ec5234a None None] MFA Rules not processed for user `e58bc02daf614b44bd97f7f123339de4`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:52.144374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-573fa66b-4eb0-4e64-ac8e-9cec1ec5234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:52.168680 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 785/1605] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:52.169497 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4643b-bcdd-4985-b880-964daf5709a0 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.180347 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4643b-bcdd-4985-b880-964daf5709a0 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:52.216480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 821/1606] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:52.216480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fa66b-4eb0-4e64-ac8e-9cec1ec5234a None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.239907 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846464d6-96d4-45c4-a59f-ef9299981c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:52.240822 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846464d6-96d4-45c4-a59f-ef9299981c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.241102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846464d6-96d4-45c4-a59f-ef9299981c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.241378 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846464d6-96d4-45c4-a59f-ef9299981c91 admin admin] PATH_INFO: `/v3/projects/368287ad726146f88559c73a86e4b26d/users/bd14de0fd51c4fd89d9875b9c47100cc/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.256822 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846464d6-96d4-45c4-a59f-ef9299981c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=368287ad726146f88559c73a86e4b26d, user_id=bd14de0fd51c4fd89d9875b9c47100cc, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.259502 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846464d6-96d4-45c4-a59f-ef9299981c91 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.272586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 786/1607] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 13:59:52 2022] PUT /identity/v3/projects/368287ad726146f88559c73a86e4b26d/users/bd14de0fd51c4fd89d9875b9c47100cc/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:52.273143 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846464d6-96d4-45c4-a59f-ef9299981c91 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.277161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fa66b-4eb0-4e64-ac8e-9cec1ec5234a None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:52.334248 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad711b-5753-4192-8b94-dfb8e718e65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:52.335149 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad711b-5753-4192-8b94-dfb8e718e65e admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.335426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad711b-5753-4192-8b94-dfb8e718e65e admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.336189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad711b-5753-4192-8b94-dfb8e718e65e admin admin] PATH_INFO: `/v3/projects/e296ee60cdee4a6b9ca754c83b8c9ffd/users/8c563c6a229b4e619992ccfb0da1a748/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.339386 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846464d6-96d4-45c4-a59f-ef9299981c91 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:52.344643 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713ec01-fe88-430f-9fe2-fcbb1b99cd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:52.345517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713ec01-fe88-430f-9fe2-fcbb1b99cd97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.345792 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713ec01-fe88-430f-9fe2-fcbb1b99cd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.346063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713ec01-fe88-430f-9fe2-fcbb1b99cd97 admin admin] PATH_INFO: `/v3/projects/d19ea52173a04c8e8624b91ac0e3eb48/users/def10f42c8744e1d8526087c874ceedd/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.350736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad711b-5753-4192-8b94-dfb8e718e65e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e296ee60cdee4a6b9ca754c83b8c9ffd, user_id=8c563c6a229b4e619992ccfb0da1a748, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.353832 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad711b-5753-4192-8b94-dfb8e718e65e admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.360617 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713ec01-fe88-430f-9fe2-fcbb1b99cd97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19ea52173a04c8e8624b91ac0e3eb48, user_id=def10f42c8744e1d8526087c874ceedd, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.363291 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713ec01-fe88-430f-9fe2-fcbb1b99cd97 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.367314 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 822/1608] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 13:59:52 2022] PUT /identity/v3/projects/e296ee60cdee4a6b9ca754c83b8c9ffd/users/8c563c6a229b4e619992ccfb0da1a748/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:52.368534 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d73f9-3c41-4ee1-a22a-e6095e41ce06 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.368848 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d73f9-3c41-4ee1-a22a-e6095e41ce06 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.369153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d73f9-3c41-4ee1-a22a-e6095e41ce06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.381674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 787/1609] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 13:59:52 2022] PUT /identity/v3/projects/d19ea52173a04c8e8624b91ac0e3eb48/users/def10f42c8744e1d8526087c874ceedd/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:52.381674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef44860-0dbc-4312-aff9-ff640702ee3c None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.381674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef44860-0dbc-4312-aff9-ff640702ee3c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.381674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef44860-0dbc-4312-aff9-ff640702ee3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.394787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-536d73f9-3c41-4ee1-a22a-e6095e41ce06 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:52.396002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-536d73f9-3c41-4ee1-a22a-e6095e41ce06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:52.398244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-2ef44860-0dbc-4312-aff9-ff640702ee3c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:52.399653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-2ef44860-0dbc-4312-aff9-ff640702ee3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:52.453270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 823/1610] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:52.454094 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d73f9-3c41-4ee1-a22a-e6095e41ce06 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.457699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 788/1611] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:52.460764 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef44860-0dbc-4312-aff9-ff640702ee3c None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.463559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d73f9-3c41-4ee1-a22a-e6095e41ce06 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:52.469354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0f683-c303-403f-b140-f2bdb5349639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:52.470010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0f683-c303-403f-b140-f2bdb5349639 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.470197 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef44860-0dbc-4312-aff9-ff640702ee3c None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:52.470304 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0f683-c303-403f-b140-f2bdb5349639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.470546 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0f683-c303-403f-b140-f2bdb5349639 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.471228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0f683-c303-403f-b140-f2bdb5349639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.473142 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0f683-c303-403f-b140-f2bdb5349639 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.475635 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcdfcd-9f40-4dd0-b0bc-5f48beb0c5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:52.476475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcdfcd-9f40-4dd0-b0bc-5f48beb0c5ab admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.476904 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcdfcd-9f40-4dd0-b0bc-5f48beb0c5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.477553 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcdfcd-9f40-4dd0-b0bc-5f48beb0c5ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.478473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcdfcd-9f40-4dd0-b0bc-5f48beb0c5ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.480628 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcdfcd-9f40-4dd0-b0bc-5f48beb0c5ab admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.499997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 824/1612] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 13:59:52 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:52.501370 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f531e-8f8f-4f19-8fde-ac3f74ab4d70 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.501657 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f531e-8f8f-4f19-8fde-ac3f74ab4d70 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.501931 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f531e-8f8f-4f19-8fde-ac3f74ab4d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.513569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 789/1613] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 13:59:52 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:52.516293 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9ea4a-1e53-4997-b319-28c0b768255d None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.517099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9ea4a-1e53-4997-b319-28c0b768255d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.517592 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9ea4a-1e53-4997-b319-28c0b768255d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.519340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-084f531e-8f8f-4f19-8fde-ac3f74ab4d70 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:52.520559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-084f531e-8f8f-4f19-8fde-ac3f74ab4d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:52.541759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-60f9ea4a-1e53-4997-b319-28c0b768255d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:52.542961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-60f9ea4a-1e53-4997-b319-28c0b768255d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:52.581455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 825/1614] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:52.581455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4b5ed-7dda-48b0-9bb2-7f45b26ac20e None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.581455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4b5ed-7dda-48b0-9bb2-7f45b26ac20e None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.581455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4b5ed-7dda-48b0-9bb2-7f45b26ac20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.597974 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-3df4b5ed-7dda-48b0-9bb2-7f45b26ac20e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:52.599161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-3df4b5ed-7dda-48b0-9bb2-7f45b26ac20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:52.606392 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 790/1615] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:52.609892 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 826/1616] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:52.610106 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9ea4a-1e53-4997-b319-28c0b768255d None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.610198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4b5ed-7dda-48b0-9bb2-7f45b26ac20e None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.611250 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-3df4b5ed-7dda-48b0-9bb2-7f45b26ac20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:52.661472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9ea4a-1e53-4997-b319-28c0b768255d None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:52.665221 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70d686-2f8a-413e-8c40-014f74ffbf47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:52.665858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70d686-2f8a-413e-8c40-014f74ffbf47 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.666145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70d686-2f8a-413e-8c40-014f74ffbf47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.666419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70d686-2f8a-413e-8c40-014f74ffbf47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.669736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4b5ed-7dda-48b0-9bb2-7f45b26ac20e None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:52.673844 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ba748-b9c9-476c-9a9a-baabd7ad7f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:52.674478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ba748-b9c9-476c-9a9a-baabd7ad7f1d service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.674759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ba748-b9c9-476c-9a9a-baabd7ad7f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.675025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ba748-b9c9-476c-9a9a-baabd7ad7f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.676131 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70d686-2f8a-413e-8c40-014f74ffbf47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.677566 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70d686-2f8a-413e-8c40-014f74ffbf47 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.684025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ba748-b9c9-476c-9a9a-baabd7ad7f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.685487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ba748-b9c9-476c-9a9a-baabd7ad7f1d service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.687376 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 791/1617] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:52.688235 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70d686-2f8a-413e-8c40-014f74ffbf47 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.695793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 827/1618] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:52.696597 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ba748-b9c9-476c-9a9a-baabd7ad7f1d service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.697201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70d686-2f8a-413e-8c40-014f74ffbf47 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:52.702373 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2593a0-0909-490b-baa8-173effd0f1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:52.703156 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2593a0-0909-490b-baa8-173effd0f1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.703450 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2593a0-0909-490b-baa8-173effd0f1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.703748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2593a0-0909-490b-baa8-173effd0f1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.704388 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2593a0-0909-490b-baa8-173effd0f1c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.705783 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ba748-b9c9-476c-9a9a-baabd7ad7f1d service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:52.706303 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2593a0-0909-490b-baa8-173effd0f1c5 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.710491 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ba6e2-af2c-40a7-b888-53e3b5a78094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:52.711216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ba6e2-af2c-40a7-b888-53e3b5a78094 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.711416 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ba6e2-af2c-40a7-b888-53e3b5a78094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.711694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ba6e2-af2c-40a7-b888-53e3b5a78094 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.712531 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ba6e2-af2c-40a7-b888-53e3b5a78094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.715034 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ba6e2-af2c-40a7-b888-53e3b5a78094 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.735660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 792/1619] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 13:59:52 2022] POST /identity/v3/users => generated 297 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:52.737178 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2593a0-0909-490b-baa8-173effd0f1c5 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.740216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 828/1620] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 13:59:52 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:52.740216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724db62b-9d0b-49e2-94fc-db5c64f4d35c None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.740216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724db62b-9d0b-49e2-94fc-db5c64f4d35c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.740216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724db62b-9d0b-49e2-94fc-db5c64f4d35c None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.745379 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 829/1621] 10.222.0.49 () {54 vars in 961 bytes} [Tue May 10 13:59:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:59:52.746297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724db62b-9d0b-49e2-94fc-db5c64f4d35c None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.749163 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2593a0-0909-490b-baa8-173effd0f1c5 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:52.753304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4daec0-8d11-4d21-a752-f559dc5dbc80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:52.753960 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4daec0-8d11-4d21-a752-f559dc5dbc80 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.754535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4daec0-8d11-4d21-a752-f559dc5dbc80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.754679 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4daec0-8d11-4d21-a752-f559dc5dbc80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.759426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724db62b-9d0b-49e2-94fc-db5c64f4d35c None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:52.763613 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e70d2-d6bc-4f2b-a1ba-6b4860d2fa49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:52.764872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e70d2-d6bc-4f2b-a1ba-6b4860d2fa49 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.765581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e70d2-d6bc-4f2b-a1ba-6b4860d2fa49 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.766093 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e70d2-d6bc-4f2b-a1ba-6b4860d2fa49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.768034 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4daec0-8d11-4d21-a752-f559dc5dbc80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.769885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4daec0-8d11-4d21-a752-f559dc5dbc80 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.777764 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e70d2-d6bc-4f2b-a1ba-6b4860d2fa49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.780008 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e70d2-d6bc-4f2b-a1ba-6b4860d2fa49 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.783413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 793/1622] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:52.784375 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4daec0-8d11-4d21-a752-f559dc5dbc80 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.794154 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 830/1623] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:52.795913 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e70d2-d6bc-4f2b-a1ba-6b4860d2fa49 service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.796089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4daec0-8d11-4d21-a752-f559dc5dbc80 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:52.801897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23022aa-9f4b-420f-8454-4f06413ae0de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:52.802544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23022aa-9f4b-420f-8454-4f06413ae0de service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.802890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23022aa-9f4b-420f-8454-4f06413ae0de service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.803140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23022aa-9f4b-420f-8454-4f06413ae0de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.806749 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e70d2-d6bc-4f2b-a1ba-6b4860d2fa49 service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:52.813606 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccf3c0-8a8c-4520-94f0-c9d9a86e97da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:52.814675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccf3c0-8a8c-4520-94f0-c9d9a86e97da admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.815161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccf3c0-8a8c-4520-94f0-c9d9a86e97da admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.815623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccf3c0-8a8c-4520-94f0-c9d9a86e97da admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.816910 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccf3c0-8a8c-4520-94f0-c9d9a86e97da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.818162 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23022aa-9f4b-420f-8454-4f06413ae0de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.819024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccf3c0-8a8c-4520-94f0-c9d9a86e97da admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.820406 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23022aa-9f4b-420f-8454-4f06413ae0de service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.830606 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 831/1624] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:52.831911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccf3c0-8a8c-4520-94f0-c9d9a86e97da admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.834167 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 794/1625] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:52.835727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af005b0-8e63-449f-a8e6-310777e93d71 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.836086 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af005b0-8e63-449f-a8e6-310777e93d71 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.836492 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af005b0-8e63-449f-a8e6-310777e93d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.845367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccf3c0-8a8c-4520-94f0-c9d9a86e97da admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:52.851919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b5675-0ce1-4dc9-98fc-5513da61261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:52.852940 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b5675-0ce1-4dc9-98fc-5513da61261e admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.853657 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b5675-0ce1-4dc9-98fc-5513da61261e admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.854123 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b5675-0ce1-4dc9-98fc-5513da61261e admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.855306 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b5675-0ce1-4dc9-98fc-5513da61261e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.857275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b5675-0ce1-4dc9-98fc-5513da61261e admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.861041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-9af005b0-8e63-449f-a8e6-310777e93d71 None None] MFA Rules not processed for user `975f10f781b94bdaa8edee39a2b1bba4`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:52.862565 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-9af005b0-8e63-449f-a8e6-310777e93d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:52.871308 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 832/1626] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:52.872792 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b5675-0ce1-4dc9-98fc-5513da61261e admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.889886 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b5675-0ce1-4dc9-98fc-5513da61261e admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:52.895332 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862feb6f-916c-4c6e-90b3-1091dc6d5d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:52.896527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862feb6f-916c-4c6e-90b3-1091dc6d5d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:52.896999 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862feb6f-916c-4c6e-90b3-1091dc6d5d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:52.897494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862feb6f-916c-4c6e-90b3-1091dc6d5d60 admin admin] PATH_INFO: `/v3/projects/552bb0354e1f4d5fa75594a316c443b5/users/95b9437953504b4b8474d232170ef07b/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:52.917339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862feb6f-916c-4c6e-90b3-1091dc6d5d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=552bb0354e1f4d5fa75594a316c443b5, user_id=95b9437953504b4b8474d232170ef07b, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:52.921600 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862feb6f-916c-4c6e-90b3-1091dc6d5d60 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:52.937879 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 833/1627] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 13:59:52 2022] PUT /identity/v3/projects/552bb0354e1f4d5fa75594a316c443b5/users/95b9437953504b4b8474d232170ef07b/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:52.940744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862feb6f-916c-4c6e-90b3-1091dc6d5d60 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.954311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 795/1628] 10.222.0.49 () {58 vars in 1058 bytes} [Tue May 10 13:59:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:52.955148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af005b0-8e63-449f-a8e6-310777e93d71 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:52.977783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af005b0-8e63-449f-a8e6-310777e93d71 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:53.020423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862feb6f-916c-4c6e-90b3-1091dc6d5d60 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:53.027701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85218321-a432-4629-89c8-4395029d5faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:53.028773 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85218321-a432-4629-89c8-4395029d5faa admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:53.029065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85218321-a432-4629-89c8-4395029d5faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:53.029410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85218321-a432-4629-89c8-4395029d5faa admin admin] PATH_INFO: `/v3/projects/9db3956bcdc3485e9a1c82e4f4e1ad4a/users/6df76f3b317e4ad4a664a0dda3961402/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:53.047917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85218321-a432-4629-89c8-4395029d5faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db3956bcdc3485e9a1c82e4f4e1ad4a, user_id=6df76f3b317e4ad4a664a0dda3961402, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:53.051374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85218321-a432-4629-89c8-4395029d5faa admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:53.051817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276be9f-21d8-4c85-ad32-dfe44f89bf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:53.052596 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276be9f-21d8-4c85-ad32-dfe44f89bf0a admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:53.052879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276be9f-21d8-4c85-ad32-dfe44f89bf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:53.053280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276be9f-21d8-4c85-ad32-dfe44f89bf0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:53.054140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276be9f-21d8-4c85-ad32-dfe44f89bf0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:53.056870 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276be9f-21d8-4c85-ad32-dfe44f89bf0a admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:53.069256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 834/1629] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 13:59:52 2022] PUT /identity/v3/projects/9db3956bcdc3485e9a1c82e4f4e1ad4a/users/6df76f3b317e4ad4a664a0dda3961402/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:53.070164 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 796/1630] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:53.071560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa585fe-a7bc-4139-bac9-1c47be3ca4fc None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:53.072086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa585fe-a7bc-4139-bac9-1c47be3ca4fc None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:53.072232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa585fe-a7bc-4139-bac9-1c47be3ca4fc None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:53.073634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276be9f-21d8-4c85-ad32-dfe44f89bf0a admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:53.078750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 835/1631] 10.222.0.49 () {54 vars in 912 bytes} [Tue May 10 13:59:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:59:53.079660 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa585fe-a7bc-4139-bac9-1c47be3ca4fc None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:53.090544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276be9f-21d8-4c85-ad32-dfe44f89bf0a admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:53.157766 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa585fe-a7bc-4139-bac9-1c47be3ca4fc None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:53.162347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a8736-8770-43d7-9956-5e4df68f739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:53.163724 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a8736-8770-43d7-9956-5e4df68f739b admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:53.164308 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a8736-8770-43d7-9956-5e4df68f739b admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:53.165072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a8736-8770-43d7-9956-5e4df68f739b admin admin] PATH_INFO: `/v3/projects/552bb0354e1f4d5fa75594a316c443b5/users/95b9437953504b4b8474d232170ef07b/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:53.168746 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d31f5-f5be-4993-8e9f-e416091a0a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:53.168957 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a8736-8770-43d7-9956-5e4df68f739b admin admin] RBAC: Authorizing `identity:create_grant(project_id=552bb0354e1f4d5fa75594a316c443b5, user_id=95b9437953504b4b8474d232170ef07b, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:53.171500 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d31f5-f5be-4993-8e9f-e416091a0a45 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:53.171500 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d31f5-f5be-4993-8e9f-e416091a0a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:53.171500 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d31f5-f5be-4993-8e9f-e416091a0a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:53.172368 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d31f5-f5be-4993-8e9f-e416091a0a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:53.172729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a8736-8770-43d7-9956-5e4df68f739b admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:53.174431 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d31f5-f5be-4993-8e9f-e416091a0a45 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:53.184983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 836/1632] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 13:59:53 2022] PUT /identity/v3/projects/552bb0354e1f4d5fa75594a316c443b5/users/95b9437953504b4b8474d232170ef07b/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:53.186508 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2c1aa-78fe-4151-8f5c-de57d638df7f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:53.186890 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2c1aa-78fe-4151-8f5c-de57d638df7f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:53.187280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2c1aa-78fe-4151-8f5c-de57d638df7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:53.191216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 797/1633] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:53.192557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d31f5-f5be-4993-8e9f-e416091a0a45 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:53.207665 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d31f5-f5be-4993-8e9f-e416091a0a45 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:53.208228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-fbc2c1aa-78fe-4151-8f5c-de57d638df7f None None] MFA Rules not processed for user `975f10f781b94bdaa8edee39a2b1bba4`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:53.209457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-fbc2c1aa-78fe-4151-8f5c-de57d638df7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:53.291447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c022e-2803-444b-a766-53a826df5d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:53.292470 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c022e-2803-444b-a766-53a826df5d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:53.292876 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c022e-2803-444b-a766-53a826df5d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:53.293231 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c022e-2803-444b-a766-53a826df5d8f admin admin] PATH_INFO: `/v3/projects/9db3956bcdc3485e9a1c82e4f4e1ad4a/users/6df76f3b317e4ad4a664a0dda3961402/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:53.296661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c022e-2803-444b-a766-53a826df5d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db3956bcdc3485e9a1c82e4f4e1ad4a, user_id=6df76f3b317e4ad4a664a0dda3961402, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:53.300362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c022e-2803-444b-a766-53a826df5d8f admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:53.313612 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 798/1634] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 13:59:53 2022] PUT /identity/v3/projects/9db3956bcdc3485e9a1c82e4f4e1ad4a/users/6df76f3b317e4ad4a664a0dda3961402/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:53.315794 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e594446-7dc4-4e75-8985-dd3a19d4459c None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:53.316147 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e594446-7dc4-4e75-8985-dd3a19d4459c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:53.316518 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e594446-7dc4-4e75-8985-dd3a19d4459c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:53.330522 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 837/1635] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 13:59:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:53.332056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7238795-0493-4204-a27c-12aaf69c49bb None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:53.332437 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7238795-0493-4204-a27c-12aaf69c49bb None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:53.332772 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7238795-0493-4204-a27c-12aaf69c49bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:53.368880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-6e594446-7dc4-4e75-8985-dd3a19d4459c None None] MFA Rules not processed for user `95b9437953504b4b8474d232170ef07b`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:53.370191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-6e594446-7dc4-4e75-8985-dd3a19d4459c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:53.386218 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-d7238795-0493-4204-a27c-12aaf69c49bb None None] MFA Rules not processed for user `6df76f3b317e4ad4a664a0dda3961402`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:53.387935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d7238795-0493-4204-a27c-12aaf69c49bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:53.521827 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 799/1636] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:53.522975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e594446-7dc4-4e75-8985-dd3a19d4459c None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:53.536460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 838/1637] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:53.537326 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7238795-0493-4204-a27c-12aaf69c49bb None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:53.621163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7238795-0493-4204-a27c-12aaf69c49bb None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:53.625935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da502bf9-4b85-437d-be32-9834d1e28f4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:53.626774 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da502bf9-4b85-437d-be32-9834d1e28f4d service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:53.627269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da502bf9-4b85-437d-be32-9834d1e28f4d service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:53.627642 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da502bf9-4b85-437d-be32-9834d1e28f4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:53.640501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da502bf9-4b85-437d-be32-9834d1e28f4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:53.640933 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e594446-7dc4-4e75-8985-dd3a19d4459c None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:53.642527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da502bf9-4b85-437d-be32-9834d1e28f4d service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:53.646244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61297713-b70e-4bca-850d-21dbe589f328 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:53.647603 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61297713-b70e-4bca-850d-21dbe589f328 service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:53.648102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61297713-b70e-4bca-850d-21dbe589f328 service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:53.649571 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61297713-b70e-4bca-850d-21dbe589f328 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:53.656050 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 839/1638] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:59:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:53.723680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da502bf9-4b85-437d-be32-9834d1e28f4d service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:53.735936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da502bf9-4b85-437d-be32-9834d1e28f4d service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:53.745217 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c51b6-d962-4bb9-90b1-47c7037c4066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:53.747275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c51b6-d962-4bb9-90b1-47c7037c4066 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:53.747657 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c51b6-d962-4bb9-90b1-47c7037c4066 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:53.748031 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c51b6-d962-4bb9-90b1-47c7037c4066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:53.759948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c51b6-d962-4bb9-90b1-47c7037c4066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:53.763474 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c51b6-d962-4bb9-90b1-47c7037c4066 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:53.790990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 840/1639] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:59:53 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 13:59:53.811357 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61297713-b70e-4bca-850d-21dbe589f328 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:53.812930 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61297713-b70e-4bca-850d-21dbe589f328 service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:53.846624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 800/1640] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:59:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:53.957897 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c51b6-d962-4bb9-90b1-47c7037c4066 service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:53.969942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c51b6-d962-4bb9-90b1-47c7037c4066 service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:53.971281 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61297713-b70e-4bca-850d-21dbe589f328 service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:53.983151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61297713-b70e-4bca-850d-21dbe589f328 service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:53.999911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af29ea-5b4c-4782-8589-c0ad1654c15f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:54.000601 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9257c5-e2d9-4de0-ace6-d2a6012d9cdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:54.001460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af29ea-5b4c-4782-8589-c0ad1654c15f service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:54.002037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af29ea-5b4c-4782-8589-c0ad1654c15f service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:54.002240 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af29ea-5b4c-4782-8589-c0ad1654c15f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:54.003247 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9257c5-e2d9-4de0-ace6-d2a6012d9cdd service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:54.005256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9257c5-e2d9-4de0-ace6-d2a6012d9cdd service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:54.005709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9257c5-e2d9-4de0-ace6-d2a6012d9cdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:54.070404 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af29ea-5b4c-4782-8589-c0ad1654c15f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:54.071629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9257c5-e2d9-4de0-ace6-d2a6012d9cdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:54.072951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af29ea-5b4c-4782-8589-c0ad1654c15f service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:54.073270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9257c5-e2d9-4de0-ace6-d2a6012d9cdd service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:54.084508 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 841/1641] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:59:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:54.085867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 801/1642] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:59:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:54.092961 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d98f11-6494-4e55-aef0-e18de37202c4 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:54.093301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d98f11-6494-4e55-aef0-e18de37202c4 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:54.093795 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d98f11-6494-4e55-aef0-e18de37202c4 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:54.095915 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 842/1643] 10.222.0.49 () {54 vars in 912 bytes} [Tue May 10 13:59:54 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:59:54.103488 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d68fc-7000-43fd-9b91-5b047020d5c0 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:54.103988 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d68fc-7000-43fd-9b91-5b047020d5c0 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:54.104776 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d68fc-7000-43fd-9b91-5b047020d5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:54.126790 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-4b5d68fc-7000-43fd-9b91-5b047020d5c0 None None] MFA Rules not processed for user `975f10f781b94bdaa8edee39a2b1bba4`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:54.128835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-4b5d68fc-7000-43fd-9b91-5b047020d5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:54.149271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 802/1644] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 13:59:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:54.461121 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d98f11-6494-4e55-aef0-e18de37202c4 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:54.482423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d98f11-6494-4e55-aef0-e18de37202c4 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:54.492379 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45599cd9-860e-4c4d-8a4b-340de408fd7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:54.494533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45599cd9-860e-4c4d-8a4b-340de408fd7b service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:54.497108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45599cd9-860e-4c4d-8a4b-340de408fd7b service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:54.497108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45599cd9-860e-4c4d-8a4b-340de408fd7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:54.531395 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45599cd9-860e-4c4d-8a4b-340de408fd7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:54.533343 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45599cd9-860e-4c4d-8a4b-340de408fd7b service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:54.558819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 843/1645] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:59:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:54.714965 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d68fc-7000-43fd-9b91-5b047020d5c0 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:54.841632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d68fc-7000-43fd-9b91-5b047020d5c0 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:54.848917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560608ff-ef42-4747-8900-ca41360c12ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:54.850115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560608ff-ef42-4747-8900-ca41360c12ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:54.850935 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560608ff-ef42-4747-8900-ca41360c12ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:54.851357 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560608ff-ef42-4747-8900-ca41360c12ae admin admin] PATH_INFO: `/v3/users/3bd34a0c3ce246ee855828b8224de95e` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:54.853547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560608ff-ef42-4747-8900-ca41360c12ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd34a0c3ce246ee855828b8224de95e)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:54.855859 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560608ff-ef42-4747-8900-ca41360c12ae admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:54.971494 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-560608ff-ef42-4747-8900-ca41360c12ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd34a0c3ce246ee855828b8224de95e'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:59:54.972388 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-560608ff-ef42-4747-8900-ca41360c12ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd34a0c3ce246ee855828b8224de95e'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:59:55.008080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fa904-0758-4355-bf1b-7f32a058f911 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:55.008585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fa904-0758-4355-bf1b-7f32a058f911 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:55.009026 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fa904-0758-4355-bf1b-7f32a058f911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:55.022299 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-560608ff-ef42-4747-8900-ca41360c12ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd34a0c3ce246ee855828b8224de95e'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:59:55.052121 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-b87fa904-0758-4355-bf1b-7f32a058f911 None None] MFA Rules not processed for user `e2218b6609f344dc94f91247e8504e85`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:55.053076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-560608ff-ef42-4747-8900-ca41360c12ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd34a0c3ce246ee855828b8224de95e'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:59:55.053722 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-560608ff-ef42-4747-8900-ca41360c12ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd34a0c3ce246ee855828b8224de95e'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:59:55.054076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b87fa904-0758-4355-bf1b-7f32a058f911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:55.075065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 803/1646] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 13:59:54 2022] DELETE /identity/v3/users/3bd34a0c3ce246ee855828b8224de95e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:55.079657 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303321e3-1660-43e6-bec3-78f11c148fd5 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:55.080139 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303321e3-1660-43e6-bec3-78f11c148fd5 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:55.080615 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303321e3-1660-43e6-bec3-78f11c148fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:55.125775 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-303321e3-1660-43e6-bec3-78f11c148fd5 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:55.130274 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-303321e3-1660-43e6-bec3-78f11c148fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:55.154112 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 844/1647] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:55.156062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5919a-2727-4a0c-95b1-0cc2e5a2a17a None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:55.156489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5919a-2727-4a0c-95b1-0cc2e5a2a17a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:55.156912 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5919a-2727-4a0c-95b1-0cc2e5a2a17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:55.192680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-3eb5919a-2727-4a0c-95b1-0cc2e5a2a17a None None] MFA Rules not processed for user `e2218b6609f344dc94f91247e8504e85`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:55.194557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-3eb5919a-2727-4a0c-95b1-0cc2e5a2a17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:55.234380 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 804/1648] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:55.257789 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303321e3-1660-43e6-bec3-78f11c148fd5 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:55.259619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-303321e3-1660-43e6-bec3-78f11c148fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:55.283000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 845/1649] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:55.284162 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5919a-2727-4a0c-95b1-0cc2e5a2a17a None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:55.285852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-3eb5919a-2727-4a0c-95b1-0cc2e5a2a17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:55.374397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303321e3-1660-43e6-bec3-78f11c148fd5 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:55.379362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c239bc7-0664-4acb-bf3b-b5509dfd6f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:55.380341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c239bc7-0664-4acb-bf3b-b5509dfd6f51 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:55.380787 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c239bc7-0664-4acb-bf3b-b5509dfd6f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:55.381334 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c239bc7-0664-4acb-bf3b-b5509dfd6f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:55.392649 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c239bc7-0664-4acb-bf3b-b5509dfd6f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:55.394496 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c239bc7-0664-4acb-bf3b-b5509dfd6f51 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:55.409369 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 805/1650] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:59:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:55.419423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5919a-2727-4a0c-95b1-0cc2e5a2a17a None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:55.426832 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d18021-7602-4c66-987a-63933d7a6dae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:55.427763 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d18021-7602-4c66-987a-63933d7a6dae service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:55.428295 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d18021-7602-4c66-987a-63933d7a6dae service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:55.428747 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d18021-7602-4c66-987a-63933d7a6dae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:55.440558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d18021-7602-4c66-987a-63933d7a6dae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:55.442655 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d18021-7602-4c66-987a-63933d7a6dae service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:55.458360 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 846/1651] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:59:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:56.899542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f90690-6208-4de1-afa1-6ff5e26d5ab3 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:56.900432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f90690-6208-4de1-afa1-6ff5e26d5ab3 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:56.900910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f90690-6208-4de1-afa1-6ff5e26d5ab3 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:56.911627 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 806/1652] 10.222.0.49 () {54 vars in 912 bytes} [Tue May 10 13:59:56 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 13:59:56.928614 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc652ef-c710-43e1-a460-370d205f61ce None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:56.929583 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc652ef-c710-43e1-a460-370d205f61ce None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:56.929879 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc652ef-c710-43e1-a460-370d205f61ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:57.039710 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f90690-6208-4de1-afa1-6ff5e26d5ab3 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:57.041673 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b9f90690-6208-4de1-afa1-6ff5e26d5ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:57.054290 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-cbc652ef-c710-43e1-a460-370d205f61ce None None] MFA Rules not processed for user `930f350dad954c7783f479bbb25c1f46`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:57.055921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cbc652ef-c710-43e1-a460-370d205f61ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:57.066120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 847/1653] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 13:59:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:59:57.074768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f90690-6208-4de1-afa1-6ff5e26d5ab3 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:57.084073 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fb663-9d20-4d70-82b2-3404eff0fd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:57.085416 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fb663-9d20-4d70-82b2-3404eff0fd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:57.085704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fb663-9d20-4d70-82b2-3404eff0fd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:57.085977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fb663-9d20-4d70-82b2-3404eff0fd4a admin admin] PATH_INFO: `/v3/projects/0f9a7482ebae4ab7a98239a604687af9` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:57.094447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fb663-9d20-4d70-82b2-3404eff0fd4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f9a7482ebae4ab7a98239a604687af9)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:57.095697 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: WARNING py.warnings [None req-860fb663-9d20-4d70-82b2-3404eff0fd4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 13:59:57.095697 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: warnings.warn(msg) May 10 13:59:57.095697 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: May 10 13:59:57.097295 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fb663-9d20-4d70-82b2-3404eff0fd4a admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:57.175594 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc652ef-c710-43e1-a460-370d205f61ce None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:57.197599 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc652ef-c710-43e1-a460-370d205f61ce None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:57.215701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-860fb663-9d20-4d70-82b2-3404eff0fd4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f9a7482ebae4ab7a98239a604687af9', 'request_id': 'req-860fb663-9d20-4d70-82b2-3404eff0fd4a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:59:57.237658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-860fb663-9d20-4d70-82b2-3404eff0fd4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f9a7482ebae4ab7a98239a604687af9', 'request_id': 'req-860fb663-9d20-4d70-82b2-3404eff0fd4a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:59:57.257979 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-860fb663-9d20-4d70-82b2-3404eff0fd4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f9a7482ebae4ab7a98239a604687af9', 'request_id': 'req-860fb663-9d20-4d70-82b2-3404eff0fd4a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:59:57.306361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-860fb663-9d20-4d70-82b2-3404eff0fd4a admin admin] The token cache is being invalidate because project 0f9a7482ebae4ab7a98239a604687af9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 13:59:57.307000 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-860fb663-9d20-4d70-82b2-3404eff0fd4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:59:57.307909 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-860fb663-9d20-4d70-82b2-3404eff0fd4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:59:57.309728 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 807/1654] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 13:59:57 2022] DELETE /identity/v3/projects/0f9a7482ebae4ab7a98239a604687af9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:57.315341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bad2f-7c6c-49d3-a8f8-9e668c4da580 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:57.315758 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bad2f-7c6c-49d3-a8f8-9e668c4da580 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:57.316288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bad2f-7c6c-49d3-a8f8-9e668c4da580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:57.341777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661e649-403d-4fcc-8668-84092823e67b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:57.342517 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661e649-403d-4fcc-8668-84092823e67b service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:57.351907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661e649-403d-4fcc-8668-84092823e67b service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:57.352308 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661e649-403d-4fcc-8668-84092823e67b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:57.361438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e661e649-403d-4fcc-8668-84092823e67b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:57.362342 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-150bad2f-7c6c-49d3-a8f8-9e668c4da580 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:57.364011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-150bad2f-7c6c-49d3-a8f8-9e668c4da580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:57.411871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661e649-403d-4fcc-8668-84092823e67b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:57.413580 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661e649-403d-4fcc-8668-84092823e67b service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:57.443486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 848/1655] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:59:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 13:59:57.532680 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 808/1656] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:59:57.541168 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49761e46-5121-4a50-82c6-fe4d5db61341 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:57.541564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49761e46-5121-4a50-82c6-fe4d5db61341 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:57.542031 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49761e46-5121-4a50-82c6-fe4d5db61341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:57.586029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-49761e46-5121-4a50-82c6-fe4d5db61341 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:57.588083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-49761e46-5121-4a50-82c6-fe4d5db61341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:57.615912 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 849/1657] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:57.617446 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bad2f-7c6c-49d3-a8f8-9e668c4da580 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:57.638893 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bad2f-7c6c-49d3-a8f8-9e668c4da580 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:57.668689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a25b5a-7482-42e7-9064-68c81dca0c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:57.669542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a25b5a-7482-42e7-9064-68c81dca0c61 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:57.670078 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a25b5a-7482-42e7-9064-68c81dca0c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:57.670867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a25b5a-7482-42e7-9064-68c81dca0c61 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:57.672634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a25b5a-7482-42e7-9064-68c81dca0c61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 13:59:57.677006 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a25b5a-7482-42e7-9064-68c81dca0c61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:57.679670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a25b5a-7482-42e7-9064-68c81dca0c61 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:57.722608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49761e46-5121-4a50-82c6-fe4d5db61341 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:57.728702 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 809/1658] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 13:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 13:59:57.734357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49761e46-5121-4a50-82c6-fe4d5db61341 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:57.754155 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af75338-7d87-4df9-a47f-848478cdfa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:57.754839 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af75338-7d87-4df9-a47f-848478cdfa8f admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:57.755381 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af75338-7d87-4df9-a47f-848478cdfa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:57.755381 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af75338-7d87-4df9-a47f-848478cdfa8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:57.756065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af75338-7d87-4df9-a47f-848478cdfa8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:57.757994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af75338-7d87-4df9-a47f-848478cdfa8f admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:57.785078 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a25b5a-7482-42e7-9064-68c81dca0c61 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:57.787458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-19a25b5a-7482-42e7-9064-68c81dca0c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:57.816258 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a25b5a-7482-42e7-9064-68c81dca0c61 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:57.833040 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281cd12d-4803-4c6a-be32-43894bdd9471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:57.834106 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cd12d-4803-4c6a-be32-43894bdd9471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:57.834268 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 850/1659] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 13:59:57 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:57.834678 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cd12d-4803-4c6a-be32-43894bdd9471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:57.835057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cd12d-4803-4c6a-be32-43894bdd9471 admin admin] PATH_INFO: `/v3/users/e58bc02daf614b44bd97f7f123339de4` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:57.838354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af75338-7d87-4df9-a47f-848478cdfa8f admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:57.839278 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281cd12d-4803-4c6a-be32-43894bdd9471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e58bc02daf614b44bd97f7f123339de4)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:57.841456 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281cd12d-4803-4c6a-be32-43894bdd9471 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:57.945193 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-281cd12d-4803-4c6a-be32-43894bdd9471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e58bc02daf614b44bd97f7f123339de4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:59:57.951950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-281cd12d-4803-4c6a-be32-43894bdd9471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e58bc02daf614b44bd97f7f123339de4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:59:57.976330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-281cd12d-4803-4c6a-be32-43894bdd9471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e58bc02daf614b44bd97f7f123339de4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:59:57.982718 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af75338-7d87-4df9-a47f-848478cdfa8f admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:57.993794 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-281cd12d-4803-4c6a-be32-43894bdd9471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e58bc02daf614b44bd97f7f123339de4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:59:57.995229 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-281cd12d-4803-4c6a-be32-43894bdd9471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e58bc02daf614b44bd97f7f123339de4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 13:59:58.008446 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb5495-85aa-461f-b6ec-d236fd768d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:58.009720 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb5495-85aa-461f-b6ec-d236fd768d32 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:58.010172 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb5495-85aa-461f-b6ec-d236fd768d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:58.010624 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb5495-85aa-461f-b6ec-d236fd768d32 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:58.011590 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb5495-85aa-461f-b6ec-d236fd768d32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:58.013436 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb5495-85aa-461f-b6ec-d236fd768d32 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:58.040767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 810/1660] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 13:59:57 2022] DELETE /identity/v3/users/e58bc02daf614b44bd97f7f123339de4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 13:59:58.049417 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29b661-0c22-4f8e-87c8-7eb912736cb1 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:58.051230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29b661-0c22-4f8e-87c8-7eb912736cb1 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:58.052298 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29b661-0c22-4f8e-87c8-7eb912736cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:58.056372 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 851/1661] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 13:59:57 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:58.057875 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb5495-85aa-461f-b6ec-d236fd768d32 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:58.059587 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f9bb5495-85aa-461f-b6ec-d236fd768d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:58.088031 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb5495-85aa-461f-b6ec-d236fd768d32 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:58.119004 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-aa29b661-0c22-4f8e-87c8-7eb912736cb1 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:58.120453 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-aa29b661-0c22-4f8e-87c8-7eb912736cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:58.287964 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 811/1662] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:58.302163 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29b661-0c22-4f8e-87c8-7eb912736cb1 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:58.303710 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-aa29b661-0c22-4f8e-87c8-7eb912736cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:58.317332 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326df52-8dad-4b53-b506-46c237b93cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:58.318038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326df52-8dad-4b53-b506-46c237b93cff admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:58.320546 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326df52-8dad-4b53-b506-46c237b93cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:58.320989 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326df52-8dad-4b53-b506-46c237b93cff admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:58.321936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326df52-8dad-4b53-b506-46c237b93cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:58.332922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326df52-8dad-4b53-b506-46c237b93cff admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:58.387273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 852/1663] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 13:59:58.395739 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326df52-8dad-4b53-b506-46c237b93cff admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:58.400019 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29b661-0c22-4f8e-87c8-7eb912736cb1 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:58.405664 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6498da-9a45-467a-a85d-64e12d74e622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:58.406419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6498da-9a45-467a-a85d-64e12d74e622 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:58.406772 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6498da-9a45-467a-a85d-64e12d74e622 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:58.407104 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6498da-9a45-467a-a85d-64e12d74e622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:58.418587 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326df52-8dad-4b53-b506-46c237b93cff admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:58.425487 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6498da-9a45-467a-a85d-64e12d74e622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:58.428471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6498da-9a45-467a-a85d-64e12d74e622 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:58.441558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07020fa5-52a9-4abf-87ca-9ae334e4d558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:58.442521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07020fa5-52a9-4abf-87ca-9ae334e4d558 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:58.443001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07020fa5-52a9-4abf-87ca-9ae334e4d558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:58.443459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07020fa5-52a9-4abf-87ca-9ae334e4d558 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:58.444429 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07020fa5-52a9-4abf-87ca-9ae334e4d558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:58.444815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 812/1664] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:59:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 13:59:58.449864 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07020fa5-52a9-4abf-87ca-9ae334e4d558 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:58.500296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 853/1665] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:58.504163 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6498da-9a45-467a-a85d-64e12d74e622 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:58.531160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6498da-9a45-467a-a85d-64e12d74e622 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:58.538835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f022f-f01b-41ea-801f-f9595f1cb0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:58.541170 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f022f-f01b-41ea-801f-f9595f1cb0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:58.543636 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f022f-f01b-41ea-801f-f9595f1cb0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:58.544568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f022f-f01b-41ea-801f-f9595f1cb0b4 admin admin] PATH_INFO: `/v3/projects/5bd83f5761ed4240920a9920b801f599/users/0b70fc14fe11472c8d93087eff6f5421/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:58.585086 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f022f-f01b-41ea-801f-f9595f1cb0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd83f5761ed4240920a9920b801f599, user_id=0b70fc14fe11472c8d93087eff6f5421, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:58.589298 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f022f-f01b-41ea-801f-f9595f1cb0b4 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:58.616506 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 813/1666] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 13:59:58 2022] PUT /identity/v3/projects/5bd83f5761ed4240920a9920b801f599/users/0b70fc14fe11472c8d93087eff6f5421/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:58.628648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f018-904c-4360-bb91-26d02f89e4fa None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:58.628938 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f018-904c-4360-bb91-26d02f89e4fa None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:58.629219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f018-904c-4360-bb91-26d02f89e4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:58.686860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-a316f018-904c-4360-bb91-26d02f89e4fa None None] MFA Rules not processed for user `0b70fc14fe11472c8d93087eff6f5421`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:58.688631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a316f018-904c-4360-bb91-26d02f89e4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:58.862273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 854/1667] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 13:59:58.869769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f022f-f01b-41ea-801f-f9595f1cb0b4 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:59.050293 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372f8c7-91fa-41e7-b5e7-408cd232c0e1 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:59.050800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372f8c7-91fa-41e7-b5e7-408cd232c0e1 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:59.050800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372f8c7-91fa-41e7-b5e7-408cd232c0e1 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:59.052439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 855/1668] 10.222.0.49 () {54 vars in 960 bytes} [Tue May 10 13:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 13:59:59.059377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb531428-c290-403d-a969-417cd9ad5088 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:59.059665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb531428-c290-403d-a969-417cd9ad5088 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:59.059945 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb531428-c290-403d-a969-417cd9ad5088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:59.064187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f022f-f01b-41ea-801f-f9595f1cb0b4 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:59.073396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64211662-3edd-4956-bca8-08cc46342d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:59.074485 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64211662-3edd-4956-bca8-08cc46342d40 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:59.075031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64211662-3edd-4956-bca8-08cc46342d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:59.075670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64211662-3edd-4956-bca8-08cc46342d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:59.076925 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64211662-3edd-4956-bca8-08cc46342d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:59.080137 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64211662-3edd-4956-bca8-08cc46342d40 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:59.105403 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-eb531428-c290-403d-a969-417cd9ad5088 None None] MFA Rules not processed for user `d8a29487b009419dbead4684bcd01cae`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:59.106680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-eb531428-c290-403d-a969-417cd9ad5088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:59.129100 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 814/1669] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 13:59:58 2022] POST /identity/v3/projects => generated 373 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:59.132226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64211662-3edd-4956-bca8-08cc46342d40 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:59.262758 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 856/1670] 10.222.0.49 () {58 vars in 1057 bytes} [Tue May 10 13:59:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 13:59:59.274344 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb531428-c290-403d-a969-417cd9ad5088 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:59.290128 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb531428-c290-403d-a969-417cd9ad5088 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:59.339422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64211662-3edd-4956-bca8-08cc46342d40 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:59.356009 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa094a-a609-412a-8ce4-9727c417dc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:59.359076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa094a-a609-412a-8ce4-9727c417dc18 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:59.361449 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa094a-a609-412a-8ce4-9727c417dc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:59.363183 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa094a-a609-412a-8ce4-9727c417dc18 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:59.363935 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa094a-a609-412a-8ce4-9727c417dc18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:59.383809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa094a-a609-412a-8ce4-9727c417dc18 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:59.454830 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 815/1671] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 13:59:59 2022] POST /identity/v3/users => generated 293 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 13:59:59.456189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa094a-a609-412a-8ce4-9727c417dc18 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:59.465102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e35b0-d4ce-4bef-926a-1efd5639b7e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8a29487b009419dbead4684bcd01cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:59.465773 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e35b0-d4ce-4bef-926a-1efd5639b7e4 service placement] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:59.466056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e35b0-d4ce-4bef-926a-1efd5639b7e4 service placement] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:59.466327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e35b0-d4ce-4bef-926a-1efd5639b7e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:59.470317 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa094a-a609-412a-8ce4-9727c417dc18 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:59.473106 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f13e35b0-d4ce-4bef-926a-1efd5639b7e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 13:59:59.475835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a2dae-a6ed-4f4f-b651-ca9f86ee8beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:59.477064 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a2dae-a6ed-4f4f-b651-ca9f86ee8beb admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:59.477561 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a2dae-a6ed-4f4f-b651-ca9f86ee8beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:59.478044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a2dae-a6ed-4f4f-b651-ca9f86ee8beb admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:59.479199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a2dae-a6ed-4f4f-b651-ca9f86ee8beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:59.481100 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a2dae-a6ed-4f4f-b651-ca9f86ee8beb admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:59.498103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 816/1672] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:59.499495 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a2dae-a6ed-4f4f-b651-ca9f86ee8beb admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:59.505087 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e35b0-d4ce-4bef-926a-1efd5639b7e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:59.507192 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e35b0-d4ce-4bef-926a-1efd5639b7e4 service placement] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:59.511539 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a2dae-a6ed-4f4f-b651-ca9f86ee8beb admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:59.521707 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae1399-a6ef-4297-9d13-19506c7264f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:59.523150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae1399-a6ef-4297-9d13-19506c7264f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:59.523923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae1399-a6ef-4297-9d13-19506c7264f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:59.524847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae1399-a6ef-4297-9d13-19506c7264f1 admin admin] PATH_INFO: `/v3/projects/b2985173de3a420aa722b138eb6c5d73/users/3bddb6368f364de4b407fdfaf0905088/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:59.527610 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 857/1673] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 13:59:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 13:59:59.558958 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae1399-a6ef-4297-9d13-19506c7264f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2985173de3a420aa722b138eb6c5d73, user_id=3bddb6368f364de4b407fdfaf0905088, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:59.568891 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae1399-a6ef-4297-9d13-19506c7264f1 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:59.594181 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 817/1674] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 13:59:59 2022] PUT /identity/v3/projects/b2985173de3a420aa722b138eb6c5d73/users/3bddb6368f364de4b407fdfaf0905088/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:59.598580 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e35b0-d4ce-4bef-926a-1efd5639b7e4 service placement] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:59.614961 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e35b0-d4ce-4bef-926a-1efd5639b7e4 service placement] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:59.817551 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75ba6a-91fb-4fbb-ab90-21cc3895cba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:59.818586 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75ba6a-91fb-4fbb-ab90-21cc3895cba7 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:59.819008 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75ba6a-91fb-4fbb-ab90-21cc3895cba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:59.819418 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75ba6a-91fb-4fbb-ab90-21cc3895cba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:59.820309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75ba6a-91fb-4fbb-ab90-21cc3895cba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:59.823001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75ba6a-91fb-4fbb-ab90-21cc3895cba7 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:59.846837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 858/1675] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 13:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 13:59:59.848608 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae1399-a6ef-4297-9d13-19506c7264f1 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 13:59:59.864936 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae1399-a6ef-4297-9d13-19506c7264f1 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 13:59:59.874311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb0492-92a6-4aa3-a237-419795d1d385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 13:59:59.875266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0492-92a6-4aa3-a237-419795d1d385 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:59.875720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0492-92a6-4aa3-a237-419795d1d385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:59.876086 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0492-92a6-4aa3-a237-419795d1d385 admin admin] PATH_INFO: `/v3/projects/b2985173de3a420aa722b138eb6c5d73/users/3bddb6368f364de4b407fdfaf0905088/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:59.878676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb0492-92a6-4aa3-a237-419795d1d385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2985173de3a420aa722b138eb6c5d73, user_id=3bddb6368f364de4b407fdfaf0905088, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 13:59:59.882397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb0492-92a6-4aa3-a237-419795d1d385 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 13:59:59.905598 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 818/1676] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 13:59:59 2022] PUT /identity/v3/projects/b2985173de3a420aa722b138eb6c5d73/users/3bddb6368f364de4b407fdfaf0905088/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 13:59:59.907261 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3f7ae-c52b-4041-80b0-62b3abc96c90 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 13:59:59.907571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3f7ae-c52b-4041-80b0-62b3abc96c90 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 13:59:59.907837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3f7ae-c52b-4041-80b0-62b3abc96c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 13:59:59.966971 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-a6a3f7ae-c52b-4041-80b0-62b3abc96c90 None None] MFA Rules not processed for user `3bddb6368f364de4b407fdfaf0905088`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 13:59:59.968780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a6a3f7ae-c52b-4041-80b0-62b3abc96c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:00.094103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 859/1677] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 13:59:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:00:00.108888 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb0492-92a6-4aa3-a237-419795d1d385 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:00.111391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-f6eb0492-92a6-4aa3-a237-419795d1d385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:00.125005 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3f7ae-c52b-4041-80b0-62b3abc96c90 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:00.129057 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a6a3f7ae-c52b-4041-80b0-62b3abc96c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:00.269225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb0492-92a6-4aa3-a237-419795d1d385 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:00.279116 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63893cf6-17af-48fd-b768-518d7f0d680d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:00.279926 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63893cf6-17af-48fd-b768-518d7f0d680d service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:00.280399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63893cf6-17af-48fd-b768-518d7f0d680d service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:00.280780 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63893cf6-17af-48fd-b768-518d7f0d680d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:00.305063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63893cf6-17af-48fd-b768-518d7f0d680d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:00.307632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63893cf6-17af-48fd-b768-518d7f0d680d service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:00.333551 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3f7ae-c52b-4041-80b0-62b3abc96c90 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:00.349243 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef96cef-d030-45a9-8d65-81ae4c2f2957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:00.350399 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef96cef-d030-45a9-8d65-81ae4c2f2957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:00.350823 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef96cef-d030-45a9-8d65-81ae4c2f2957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:00.351979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef96cef-d030-45a9-8d65-81ae4c2f2957 admin admin] PATH_INFO: `/v3/projects/9a2ad92f31134c51a2834b62a06c173a` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:00.354211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef96cef-d030-45a9-8d65-81ae4c2f2957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a2ad92f31134c51a2834b62a06c173a)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:00.359032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef96cef-d030-45a9-8d65-81ae4c2f2957 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:00.372824 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 819/1678] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:00.540303 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2ef96cef-d030-45a9-8d65-81ae4c2f2957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a2ad92f31134c51a2834b62a06c173a', 'request_id': 'req-2ef96cef-d030-45a9-8d65-81ae4c2f2957'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:00.563399 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2ef96cef-d030-45a9-8d65-81ae4c2f2957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a2ad92f31134c51a2834b62a06c173a', 'request_id': 'req-2ef96cef-d030-45a9-8d65-81ae4c2f2957'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:00.563882 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63893cf6-17af-48fd-b768-518d7f0d680d service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:00.565401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-63893cf6-17af-48fd-b768-518d7f0d680d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:00.586485 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2ef96cef-d030-45a9-8d65-81ae4c2f2957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a2ad92f31134c51a2834b62a06c173a', 'request_id': 'req-2ef96cef-d030-45a9-8d65-81ae4c2f2957'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:00.593674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63893cf6-17af-48fd-b768-518d7f0d680d service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:00.612845 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2ef96cef-d030-45a9-8d65-81ae4c2f2957 admin admin] The token cache is being invalidate because project 9a2ad92f31134c51a2834b62a06c173a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:00.612845 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2ef96cef-d030-45a9-8d65-81ae4c2f2957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:00.612845 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2ef96cef-d030-45a9-8d65-81ae4c2f2957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:00.613980 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 860/1679] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:00 2022] DELETE /identity/v3/projects/9a2ad92f31134c51a2834b62a06c173a => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:00.617809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef96cef-d030-45a9-8d65-81ae4c2f2957 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:00.624104 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-2ef96cef-d030-45a9-8d65-81ae4c2f2957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:00.787604 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8f47b-9732-46df-b405-6d04a7da102e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:00.788305 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8f47b-9732-46df-b405-6d04a7da102e service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:00.788594 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8f47b-9732-46df-b405-6d04a7da102e service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:00.788866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8f47b-9732-46df-b405-6d04a7da102e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:00.806344 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a1a8f47b-9732-46df-b405-6d04a7da102e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:00.954096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef96cef-d030-45a9-8d65-81ae4c2f2957 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:00.969752 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636f13-59f6-47f5-b04e-4cfbec60e045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:00.971750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636f13-59f6-47f5-b04e-4cfbec60e045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:00.972219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636f13-59f6-47f5-b04e-4cfbec60e045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:00.972624 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636f13-59f6-47f5-b04e-4cfbec60e045 admin admin] PATH_INFO: `/v3/users/6df76f3b317e4ad4a664a0dda3961402` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:00.974012 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38636f13-59f6-47f5-b04e-4cfbec60e045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df76f3b317e4ad4a664a0dda3961402)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:00.975289 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: WARNING py.warnings [None req-38636f13-59f6-47f5-b04e-4cfbec60e045 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 14:00:00.975289 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: warnings.warn(msg) May 10 14:00:00.975289 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: May 10 14:00:00.978209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38636f13-59f6-47f5-b04e-4cfbec60e045 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:01.080941 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8f47b-9732-46df-b405-6d04a7da102e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:01.085220 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8f47b-9732-46df-b405-6d04a7da102e service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:01.111469 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 820/1680] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:01.203309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-38636f13-59f6-47f5-b04e-4cfbec60e045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df76f3b317e4ad4a664a0dda3961402'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:01.256876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-38636f13-59f6-47f5-b04e-4cfbec60e045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df76f3b317e4ad4a664a0dda3961402'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:01.295997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-38636f13-59f6-47f5-b04e-4cfbec60e045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df76f3b317e4ad4a664a0dda3961402'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:01.306712 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-38636f13-59f6-47f5-b04e-4cfbec60e045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df76f3b317e4ad4a664a0dda3961402'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:01.322394 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-38636f13-59f6-47f5-b04e-4cfbec60e045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df76f3b317e4ad4a664a0dda3961402'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:01.346169 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 861/1681] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:00 2022] DELETE /identity/v3/users/6df76f3b317e4ad4a664a0dda3961402 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:02.861657 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8f47b-9732-46df-b405-6d04a7da102e service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:02.877448 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8f47b-9732-46df-b405-6d04a7da102e service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:03.038094 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348109f-0eb7-4d01-8fc5-3b18a0d7d383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:03.043031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348109f-0eb7-4d01-8fc5-3b18a0d7d383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:03.049295 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348109f-0eb7-4d01-8fc5-3b18a0d7d383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:03.051324 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348109f-0eb7-4d01-8fc5-3b18a0d7d383 admin admin] PATH_INFO: `/v3/projects/9db3956bcdc3485e9a1c82e4f4e1ad4a` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:03.058967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348109f-0eb7-4d01-8fc5-3b18a0d7d383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9db3956bcdc3485e9a1c82e4f4e1ad4a)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:03.063990 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348109f-0eb7-4d01-8fc5-3b18a0d7d383 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:03.227739 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c9268-35b6-46c0-adab-85644c58216d None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:03.228715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c9268-35b6-46c0-adab-85644c58216d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:03.229272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c9268-35b6-46c0-adab-85644c58216d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:03.247195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-6348109f-0eb7-4d01-8fc5-3b18a0d7d383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9db3956bcdc3485e9a1c82e4f4e1ad4a', 'request_id': 'req-6348109f-0eb7-4d01-8fc5-3b18a0d7d383'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:03.263046 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-6348109f-0eb7-4d01-8fc5-3b18a0d7d383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9db3956bcdc3485e9a1c82e4f4e1ad4a', 'request_id': 'req-6348109f-0eb7-4d01-8fc5-3b18a0d7d383'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:03.289336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-6348109f-0eb7-4d01-8fc5-3b18a0d7d383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9db3956bcdc3485e9a1c82e4f4e1ad4a', 'request_id': 'req-6348109f-0eb7-4d01-8fc5-3b18a0d7d383'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:03.289531 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-d89c9268-35b6-46c0-adab-85644c58216d None None] MFA Rules not processed for user `df5dcdfb4eda417ebc0af2432497617d`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:03.296054 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d89c9268-35b6-46c0-adab-85644c58216d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:03.321021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-6348109f-0eb7-4d01-8fc5-3b18a0d7d383 admin admin] The token cache is being invalidate because project 9db3956bcdc3485e9a1c82e4f4e1ad4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:03.321342 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-6348109f-0eb7-4d01-8fc5-3b18a0d7d383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:03.328034 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-6348109f-0eb7-4d01-8fc5-3b18a0d7d383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:03.339292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 821/1682] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:02 2022] DELETE /identity/v3/projects/9db3956bcdc3485e9a1c82e4f4e1ad4a => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:03.340830 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e09adc-adaa-414d-9930-1e951246edcf None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:03.341120 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e09adc-adaa-414d-9930-1e951246edcf None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:03.341406 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e09adc-adaa-414d-9930-1e951246edcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:03.416910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-d4e09adc-adaa-414d-9930-1e951246edcf None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:03.418365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d4e09adc-adaa-414d-9930-1e951246edcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:03.523038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 862/1683] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 14:00:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:03.542510 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 822/1684] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:03.550997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722c76f-a69a-429f-8bd4-83bd05dbfe4f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:03.551280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722c76f-a69a-429f-8bd4-83bd05dbfe4f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:03.551555 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722c76f-a69a-429f-8bd4-83bd05dbfe4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:03.605442 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-a722c76f-a69a-429f-8bd4-83bd05dbfe4f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:03.611245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a722c76f-a69a-429f-8bd4-83bd05dbfe4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:03.657331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 863/1685] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:03.661428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e09adc-adaa-414d-9930-1e951246edcf None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:03.689366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e09adc-adaa-414d-9930-1e951246edcf None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:03.710336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf53d3e-210c-4d25-a856-47795bbfcea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:03.711184 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf53d3e-210c-4d25-a856-47795bbfcea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:03.711459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf53d3e-210c-4d25-a856-47795bbfcea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:03.711754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf53d3e-210c-4d25-a856-47795bbfcea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:03.712500 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf53d3e-210c-4d25-a856-47795bbfcea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:00:03.712805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf53d3e-210c-4d25-a856-47795bbfcea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:03.714442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf53d3e-210c-4d25-a856-47795bbfcea3 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:03.748697 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 823/1686] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:00:03.753043 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722c76f-a69a-429f-8bd4-83bd05dbfe4f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:03.772014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722c76f-a69a-429f-8bd4-83bd05dbfe4f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:03.788755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08513ef0-cac5-450f-a98a-104b21126252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:03.789696 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08513ef0-cac5-450f-a98a-104b21126252 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:03.790070 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08513ef0-cac5-450f-a98a-104b21126252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:03.790403 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08513ef0-cac5-450f-a98a-104b21126252 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:03.791120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08513ef0-cac5-450f-a98a-104b21126252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:03.795359 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08513ef0-cac5-450f-a98a-104b21126252 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:03.850351 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf53d3e-210c-4d25-a856-47795bbfcea3 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:03.852913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-acf53d3e-210c-4d25-a856-47795bbfcea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:03.875458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 864/1687] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:03 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:03.881581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08513ef0-cac5-450f-a98a-104b21126252 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:04.026471 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08513ef0-cac5-450f-a98a-104b21126252 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:04.038995 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5e9e4-c7b2-430b-b0ba-82639a9aaa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:04.041257 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf53d3e-210c-4d25-a856-47795bbfcea3 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:04.042300 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5e9e4-c7b2-430b-b0ba-82639a9aaa7f admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:04.042749 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5e9e4-c7b2-430b-b0ba-82639a9aaa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:04.043165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5e9e4-c7b2-430b-b0ba-82639a9aaa7f admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:04.046262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5e9e4-c7b2-430b-b0ba-82639a9aaa7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:04.068079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5e9e4-c7b2-430b-b0ba-82639a9aaa7f admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:04.131228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 865/1688] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:00:03 2022] POST /identity/v3/users => generated 283 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:04.134768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5e9e4-c7b2-430b-b0ba-82639a9aaa7f admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:04.156748 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5e9e4-c7b2-430b-b0ba-82639a9aaa7f admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:04.177276 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fc56f-1ab6-4e16-975d-7d2e71ee42b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:04.177645 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc56f-1ab6-4e16-975d-7d2e71ee42b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:04.179964 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc56f-1ab6-4e16-975d-7d2e71ee42b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:04.180511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc56f-1ab6-4e16-975d-7d2e71ee42b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:04.182522 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fc56f-1ab6-4e16-975d-7d2e71ee42b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:04.186501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fc56f-1ab6-4e16-975d-7d2e71ee42b6 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:04.208891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 866/1689] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:00:04.211439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1260ef7-26b5-4d16-a90d-836390a8d5b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd102155cd1bd4368ad272668da1651f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:04.211590 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fc56f-1ab6-4e16-975d-7d2e71ee42b6 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:04.211672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1260ef7-26b5-4d16-a90d-836390a8d5b2 service swift] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:04.211904 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1260ef7-26b5-4d16-a90d-836390a8d5b2 service swift] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:04.212263 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1260ef7-26b5-4d16-a90d-836390a8d5b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:04.251817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fc56f-1ab6-4e16-975d-7d2e71ee42b6 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:04.272532 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d5df7-463a-40c2-8616-2c250a3c9f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:04.273748 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d5df7-463a-40c2-8616-2c250a3c9f85 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:04.274236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d5df7-463a-40c2-8616-2c250a3c9f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:04.274987 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d5df7-463a-40c2-8616-2c250a3c9f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:04.279021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d5df7-463a-40c2-8616-2c250a3c9f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:04.279894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1260ef7-26b5-4d16-a90d-836390a8d5b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:04.282420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d5df7-463a-40c2-8616-2c250a3c9f85 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:04.282710 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1260ef7-26b5-4d16-a90d-836390a8d5b2 service swift] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:04.293300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 824/1690] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 14:00:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:00:04.306785 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 867/1691] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:04.309468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1260ef7-26b5-4d16-a90d-836390a8d5b2 service swift] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:04.334597 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1260ef7-26b5-4d16-a90d-836390a8d5b2 service swift] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:04.343936 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1eeb2-912b-41ca-a097-8c0c40d02395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:04.345064 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1eeb2-912b-41ca-a097-8c0c40d02395 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:04.346101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1eeb2-912b-41ca-a097-8c0c40d02395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:04.348625 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1eeb2-912b-41ca-a097-8c0c40d02395 admin admin] PATH_INFO: `/v3/projects/25e81266efde45e691c98a4159567ae4/users/a571d6689f444b41b91d75dd0a8744dd/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:04.393846 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1eeb2-912b-41ca-a097-8c0c40d02395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e81266efde45e691c98a4159567ae4, user_id=a571d6689f444b41b91d75dd0a8744dd, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:04.397035 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1eeb2-912b-41ca-a097-8c0c40d02395 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:04.428139 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 825/1692] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:04 2022] PUT /identity/v3/projects/25e81266efde45e691c98a4159567ae4/users/a571d6689f444b41b91d75dd0a8744dd/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:00:04.438727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f6d4d-9383-4f65-b996-5a5e09856285 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:04.439422 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f6d4d-9383-4f65-b996-5a5e09856285 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:04.440049 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f6d4d-9383-4f65-b996-5a5e09856285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:04.567842 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-851f6d4d-9383-4f65-b996-5a5e09856285 None None] MFA Rules not processed for user `a571d6689f444b41b91d75dd0a8744dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:04.578111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-851f6d4d-9383-4f65-b996-5a5e09856285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:05.395191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1eeb2-912b-41ca-a097-8c0c40d02395 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:05.396121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d8c1eeb2-912b-41ca-a097-8c0c40d02395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:05.553057 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 868/1693] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 1112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:05.554856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f6d4d-9383-4f65-b996-5a5e09856285 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:05.623734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1eeb2-912b-41ca-a097-8c0c40d02395 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:05.649156 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffb2a2-9173-4a18-aca4-5d1369c69dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:05.650201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffb2a2-9173-4a18-aca4-5d1369c69dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:05.650549 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffb2a2-9173-4a18-aca4-5d1369c69dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:05.650913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffb2a2-9173-4a18-aca4-5d1369c69dd8 admin admin] PATH_INFO: `/v3/users/36d556e6c2f5410690b7d0db3ba761b6` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:05.652913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffb2a2-9173-4a18-aca4-5d1369c69dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d556e6c2f5410690b7d0db3ba761b6)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:05.655105 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffb2a2-9173-4a18-aca4-5d1369c69dd8 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:05.808191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-efffb2a2-9173-4a18-aca4-5d1369c69dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d556e6c2f5410690b7d0db3ba761b6'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:05.812313 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-efffb2a2-9173-4a18-aca4-5d1369c69dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d556e6c2f5410690b7d0db3ba761b6'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:05.837884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f6d4d-9383-4f65-b996-5a5e09856285 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:05.854736 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-efffb2a2-9173-4a18-aca4-5d1369c69dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d556e6c2f5410690b7d0db3ba761b6'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:05.858830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8435f5-2888-40aa-8f8b-55508fadc513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:05.861448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8435f5-2888-40aa-8f8b-55508fadc513 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:05.862633 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8435f5-2888-40aa-8f8b-55508fadc513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:05.863183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8435f5-2888-40aa-8f8b-55508fadc513 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:05.864597 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8435f5-2888-40aa-8f8b-55508fadc513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:05.869269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8435f5-2888-40aa-8f8b-55508fadc513 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:05.891007 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-efffb2a2-9173-4a18-aca4-5d1369c69dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d556e6c2f5410690b7d0db3ba761b6'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:05.893147 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-efffb2a2-9173-4a18-aca4-5d1369c69dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d556e6c2f5410690b7d0db3ba761b6'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:05.939309 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 826/1694] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:05 2022] DELETE /identity/v3/users/36d556e6c2f5410690b7d0db3ba761b6 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:05.940782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64423d2-8a40-438f-a607-dea524cc816a None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:05.941074 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64423d2-8a40-438f-a607-dea524cc816a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:05.941349 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64423d2-8a40-438f-a607-dea524cc816a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:05.986983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 869/1695] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:05 2022] POST /identity/v3/projects => generated 367 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:05.988494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b4c9a-ad21-4ef8-a1a1-68fc37341dd7 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:05.988819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b4c9a-ad21-4ef8-a1a1-68fc37341dd7 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:05.989137 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b4c9a-ad21-4ef8-a1a1-68fc37341dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:06.077837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-ed8b4c9a-ad21-4ef8-a1a1-68fc37341dd7 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:06.079235 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ed8b4c9a-ad21-4ef8-a1a1-68fc37341dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:06.090429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-c64423d2-8a40-438f-a607-dea524cc816a None None] MFA Rules not processed for user `def10f42c8744e1d8526087c874ceedd`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:06.094573 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-c64423d2-8a40-438f-a607-dea524cc816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:06.214810 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 827/1696] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:06.215807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64423d2-8a40-438f-a607-dea524cc816a None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:06.218070 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-c64423d2-8a40-438f-a607-dea524cc816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:06.343510 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 870/1697] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:06.345541 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b4c9a-ad21-4ef8-a1a1-68fc37341dd7 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:06.349043 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ed8b4c9a-ad21-4ef8-a1a1-68fc37341dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:06.410801 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64423d2-8a40-438f-a607-dea524cc816a None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:06.424924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc41d0-39b7-4ee4-8821-66598ca1a845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:06.425620 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc41d0-39b7-4ee4-8821-66598ca1a845 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:06.425902 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc41d0-39b7-4ee4-8821-66598ca1a845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:06.426180 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc41d0-39b7-4ee4-8821-66598ca1a845 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:06.426886 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc41d0-39b7-4ee4-8821-66598ca1a845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:06.439374 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc41d0-39b7-4ee4-8821-66598ca1a845 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:06.498911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 828/1698] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:00:06 2022] POST /identity/v3/users => generated 290 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:06.501827 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc41d0-39b7-4ee4-8821-66598ca1a845 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:06.505318 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-fccc41d0-39b7-4ee4-8821-66598ca1a845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:06.579084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b4c9a-ad21-4ef8-a1a1-68fc37341dd7 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:06.595820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b62c4-7e84-43f5-a2a0-b4618195cf92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:06.599369 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b62c4-7e84-43f5-a2a0-b4618195cf92 service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:06.599975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b62c4-7e84-43f5-a2a0-b4618195cf92 service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:06.600695 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b62c4-7e84-43f5-a2a0-b4618195cf92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:06.633397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b62c4-7e84-43f5-a2a0-b4618195cf92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:06.638670 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b62c4-7e84-43f5-a2a0-b4618195cf92 service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:06.677366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 871/1699] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:06.678779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b62c4-7e84-43f5-a2a0-b4618195cf92 service nova] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:06.718331 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc41d0-39b7-4ee4-8821-66598ca1a845 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:06.726387 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b62c4-7e84-43f5-a2a0-b4618195cf92 service nova] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:06.733018 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66ea70-0ff9-45b6-a9df-e4404069d1eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:06.734827 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66ea70-0ff9-45b6-a9df-e4404069d1eb service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:06.736632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66ea70-0ff9-45b6-a9df-e4404069d1eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:06.737885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66ea70-0ff9-45b6-a9df-e4404069d1eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:06.746680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a8b89-8397-47dd-814d-2317082dd907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:06.751150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a8b89-8397-47dd-814d-2317082dd907 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:06.761768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a8b89-8397-47dd-814d-2317082dd907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:06.761768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a8b89-8397-47dd-814d-2317082dd907 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:06.761768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a8b89-8397-47dd-814d-2317082dd907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:06.764994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a8b89-8397-47dd-814d-2317082dd907 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:06.821914 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 872/1700] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:06.824025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a8b89-8397-47dd-814d-2317082dd907 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:06.832680 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66ea70-0ff9-45b6-a9df-e4404069d1eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:06.834116 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66ea70-0ff9-45b6-a9df-e4404069d1eb service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:06.849521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a8b89-8397-47dd-814d-2317082dd907 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:06.865323 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bccc313-daa8-4b29-bb65-53d119c73111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:06.866425 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccc313-daa8-4b29-bb65-53d119c73111 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:06.870233 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccc313-daa8-4b29-bb65-53d119c73111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:06.871530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccc313-daa8-4b29-bb65-53d119c73111 admin admin] PATH_INFO: `/v3/projects/01e101894d0a470ab7dc7dca73207871/users/cdf79c2fb5c44436adaae38cd4e12530/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:06.881295 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 829/1701] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:06.912413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bccc313-daa8-4b29-bb65-53d119c73111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e101894d0a470ab7dc7dca73207871, user_id=cdf79c2fb5c44436adaae38cd4e12530, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:06.920465 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bccc313-daa8-4b29-bb65-53d119c73111 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:06.949106 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 873/1702] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:06 2022] PUT /identity/v3/projects/01e101894d0a470ab7dc7dca73207871/users/cdf79c2fb5c44436adaae38cd4e12530/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:06.953247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66ea70-0ff9-45b6-a9df-e4404069d1eb service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:06.984355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66ea70-0ff9-45b6-a9df-e4404069d1eb service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:07.146314 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b2939-3f19-402e-a1b9-8838fb869326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:07.147204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b2939-3f19-402e-a1b9-8838fb869326 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:07.147631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b2939-3f19-402e-a1b9-8838fb869326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:07.148049 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b2939-3f19-402e-a1b9-8838fb869326 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:07.149226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b2939-3f19-402e-a1b9-8838fb869326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:07.151015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b2939-3f19-402e-a1b9-8838fb869326 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:07.177429 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bccc313-daa8-4b29-bb65-53d119c73111 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:07.180814 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 830/1703] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:07.195947 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bccc313-daa8-4b29-bb65-53d119c73111 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:07.217585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b4718-3e30-47c7-9dc0-d5d01be73301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:07.219729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b4718-3e30-47c7-9dc0-d5d01be73301 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:07.222147 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b4718-3e30-47c7-9dc0-d5d01be73301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:07.222431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b4718-3e30-47c7-9dc0-d5d01be73301 admin admin] PATH_INFO: `/v3/projects/01e101894d0a470ab7dc7dca73207871/users/cdf79c2fb5c44436adaae38cd4e12530/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:07.227373 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b4718-3e30-47c7-9dc0-d5d01be73301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e101894d0a470ab7dc7dca73207871, user_id=cdf79c2fb5c44436adaae38cd4e12530, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:07.232740 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b4718-3e30-47c7-9dc0-d5d01be73301 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:07.272734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 874/1704] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:07 2022] PUT /identity/v3/projects/01e101894d0a470ab7dc7dca73207871/users/cdf79c2fb5c44436adaae38cd4e12530/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:07.274248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70316cc1-5f1e-440f-8dbb-95a851e28688 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:07.274545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70316cc1-5f1e-440f-8dbb-95a851e28688 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:07.274822 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70316cc1-5f1e-440f-8dbb-95a851e28688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:07.374751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-70316cc1-5f1e-440f-8dbb-95a851e28688 None None] MFA Rules not processed for user `cdf79c2fb5c44436adaae38cd4e12530`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:07.376205 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-70316cc1-5f1e-440f-8dbb-95a851e28688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:07.548123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 831/1705] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:07.567268 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b4718-3e30-47c7-9dc0-d5d01be73301 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:07.568881 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c74b4718-3e30-47c7-9dc0-d5d01be73301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:07.758346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b4718-3e30-47c7-9dc0-d5d01be73301 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:07.771315 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b309800-b400-4205-bfb1-873277ec63c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:07.771995 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b309800-b400-4205-bfb1-873277ec63c6 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:07.772398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b309800-b400-4205-bfb1-873277ec63c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:07.772706 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b309800-b400-4205-bfb1-873277ec63c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:07.784339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b309800-b400-4205-bfb1-873277ec63c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:07.785779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b309800-b400-4205-bfb1-873277ec63c6 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:07.801579 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 875/1706] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:07 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:07.941359 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70316cc1-5f1e-440f-8dbb-95a851e28688 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:07.952577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70316cc1-5f1e-440f-8dbb-95a851e28688 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:07.967816 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b7063-2d3f-443f-8214-dd8f593e9143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:07.969029 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b7063-2d3f-443f-8214-dd8f593e9143 service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:07.969029 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b7063-2d3f-443f-8214-dd8f593e9143 service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:07.969029 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b7063-2d3f-443f-8214-dd8f593e9143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:07.973584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-6a7b7063-2d3f-443f-8214-dd8f593e9143 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:08.079300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b7063-2d3f-443f-8214-dd8f593e9143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:08.081516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b7063-2d3f-443f-8214-dd8f593e9143 service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:08.094661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 832/1707] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:08.286937 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b309800-b400-4205-bfb1-873277ec63c6 service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:08.288882 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-1b309800-b400-4205-bfb1-873277ec63c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:08.460047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b309800-b400-4205-bfb1-873277ec63c6 service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:08.470998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597aba5-dc5a-45ec-b68e-c76361c5b978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:08.471884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597aba5-dc5a-45ec-b68e-c76361c5b978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:08.472185 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597aba5-dc5a-45ec-b68e-c76361c5b978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:08.472463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597aba5-dc5a-45ec-b68e-c76361c5b978 admin admin] PATH_INFO: `/v3/projects/924de6c512004326ad32b491e09100ea` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:08.473709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597aba5-dc5a-45ec-b68e-c76361c5b978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=924de6c512004326ad32b491e09100ea)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:08.475605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597aba5-dc5a-45ec-b68e-c76361c5b978 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:08.589702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6597aba5-dc5a-45ec-b68e-c76361c5b978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924de6c512004326ad32b491e09100ea', 'request_id': 'req-6597aba5-dc5a-45ec-b68e-c76361c5b978'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:08.610098 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6597aba5-dc5a-45ec-b68e-c76361c5b978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924de6c512004326ad32b491e09100ea', 'request_id': 'req-6597aba5-dc5a-45ec-b68e-c76361c5b978'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:08.616399 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6597aba5-dc5a-45ec-b68e-c76361c5b978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924de6c512004326ad32b491e09100ea', 'request_id': 'req-6597aba5-dc5a-45ec-b68e-c76361c5b978'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:08.641521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6597aba5-dc5a-45ec-b68e-c76361c5b978 admin admin] The token cache is being invalidate because project 924de6c512004326ad32b491e09100ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:08.641924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6597aba5-dc5a-45ec-b68e-c76361c5b978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:08.646241 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6597aba5-dc5a-45ec-b68e-c76361c5b978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:08.652436 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b7063-2d3f-443f-8214-dd8f593e9143 service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:08.653961 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 876/1708] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:08 2022] DELETE /identity/v3/projects/924de6c512004326ad32b491e09100ea => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:08.678238 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b7063-2d3f-443f-8214-dd8f593e9143 service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:08.842675 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719d689-f2fe-45a8-89d5-1c89971bb7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:08.843572 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719d689-f2fe-45a8-89d5-1c89971bb7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:08.843849 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719d689-f2fe-45a8-89d5-1c89971bb7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:08.844119 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719d689-f2fe-45a8-89d5-1c89971bb7a9 admin admin] PATH_INFO: `/v3/users/95b9437953504b4b8474d232170ef07b` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:08.858561 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719d689-f2fe-45a8-89d5-1c89971bb7a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95b9437953504b4b8474d232170ef07b)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:08.858561 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719d689-f2fe-45a8-89d5-1c89971bb7a9 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:09.033187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-5719d689-f2fe-45a8-89d5-1c89971bb7a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95b9437953504b4b8474d232170ef07b'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:09.034316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-5719d689-f2fe-45a8-89d5-1c89971bb7a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95b9437953504b4b8474d232170ef07b'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:09.074238 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-5719d689-f2fe-45a8-89d5-1c89971bb7a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95b9437953504b4b8474d232170ef07b'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:09.094277 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-5719d689-f2fe-45a8-89d5-1c89971bb7a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95b9437953504b4b8474d232170ef07b'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:09.095642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-5719d689-f2fe-45a8-89d5-1c89971bb7a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95b9437953504b4b8474d232170ef07b'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:09.127933 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 833/1709] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:08 2022] DELETE /identity/v3/users/95b9437953504b4b8474d232170ef07b => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:11.219640 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188b3be-2d4d-478b-965d-26729901195c None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:11.220991 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188b3be-2d4d-478b-965d-26729901195c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:11.222182 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188b3be-2d4d-478b-965d-26729901195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:11.268372 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-d188b3be-2d4d-478b-965d-26729901195c None None] MFA Rules not processed for user `930f350dad954c7783f479bbb25c1f46`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:11.269989 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d188b3be-2d4d-478b-965d-26729901195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:11.431933 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 877/1710] 10.222.0.57 () {58 vars in 1015 bytes} [Tue May 10 14:00:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:11.497217 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719d689-f2fe-45a8-89d5-1c89971bb7a9 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:11.501419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-5719d689-f2fe-45a8-89d5-1c89971bb7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:11.541957 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719d689-f2fe-45a8-89d5-1c89971bb7a9 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:11.563003 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43563a-44b9-4c29-ba34-4246b28e05ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:11.576362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43563a-44b9-4c29-ba34-4246b28e05ba service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:11.576362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43563a-44b9-4c29-ba34-4246b28e05ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:11.576362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43563a-44b9-4c29-ba34-4246b28e05ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:11.610571 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43563a-44b9-4c29-ba34-4246b28e05ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:11.613452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43563a-44b9-4c29-ba34-4246b28e05ba service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:11.639686 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 834/1711] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:12.280225 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188b3be-2d4d-478b-965d-26729901195c None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:12.283026 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d188b3be-2d4d-478b-965d-26729901195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:12.441072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188b3be-2d4d-478b-965d-26729901195c None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:12.447386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02731388-4a4a-452b-899d-40c6f350268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:12.448415 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02731388-4a4a-452b-899d-40c6f350268e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:12.448699 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02731388-4a4a-452b-899d-40c6f350268e admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:12.449213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02731388-4a4a-452b-899d-40c6f350268e admin admin] PATH_INFO: `/v3/projects/552bb0354e1f4d5fa75594a316c443b5` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:12.450576 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02731388-4a4a-452b-899d-40c6f350268e admin admin] RBAC: Authorizing `identity:delete_project(project_id=552bb0354e1f4d5fa75594a316c443b5)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:12.458295 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02731388-4a4a-452b-899d-40c6f350268e admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:12.523330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dbd4e-50c9-4ec5-b353-eeba6d70e1a4 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:12.524573 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dbd4e-50c9-4ec5-b353-eeba6d70e1a4 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:12.525043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dbd4e-50c9-4ec5-b353-eeba6d70e1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:12.599571 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-866dbd4e-50c9-4ec5-b353-eeba6d70e1a4 None None] MFA Rules not processed for user `67535c1c99484689999ef478604e51d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:12.604432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-866dbd4e-50c9-4ec5-b353-eeba6d70e1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:12.631880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-02731388-4a4a-452b-899d-40c6f350268e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552bb0354e1f4d5fa75594a316c443b5', 'request_id': 'req-02731388-4a4a-452b-899d-40c6f350268e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:12.658758 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-02731388-4a4a-452b-899d-40c6f350268e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552bb0354e1f4d5fa75594a316c443b5', 'request_id': 'req-02731388-4a4a-452b-899d-40c6f350268e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:12.668025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-02731388-4a4a-452b-899d-40c6f350268e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552bb0354e1f4d5fa75594a316c443b5', 'request_id': 'req-02731388-4a4a-452b-899d-40c6f350268e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:12.684072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-02731388-4a4a-452b-899d-40c6f350268e admin admin] The token cache is being invalidate because project 552bb0354e1f4d5fa75594a316c443b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:12.684755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-02731388-4a4a-452b-899d-40c6f350268e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:12.685560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-02731388-4a4a-452b-899d-40c6f350268e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:12.687747 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 878/1712] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:12 2022] DELETE /identity/v3/projects/552bb0354e1f4d5fa75594a316c443b5 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:12.700389 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c687454-4e80-4ec4-94e0-c5bb8de06dc4 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:12.701565 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c687454-4e80-4ec4-94e0-c5bb8de06dc4 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:12.702825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c687454-4e80-4ec4-94e0-c5bb8de06dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:12.801181 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-9c687454-4e80-4ec4-94e0-c5bb8de06dc4 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:12.809870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-9c687454-4e80-4ec4-94e0-c5bb8de06dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:12.874974 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 835/1713] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:12.895569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866dbd4e-50c9-4ec5-b353-eeba6d70e1a4 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:12.897597 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-866dbd4e-50c9-4ec5-b353-eeba6d70e1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:13.146600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866dbd4e-50c9-4ec5-b353-eeba6d70e1a4 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:13.162824 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb38977-bf54-4f76-9412-d7c1e31ed692 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:13.166411 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb38977-bf54-4f76-9412-d7c1e31ed692 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:13.170362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb38977-bf54-4f76-9412-d7c1e31ed692 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:13.179849 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 879/1714] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:13.182917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb38977-bf54-4f76-9412-d7c1e31ed692 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:13.194854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb068e-b078-4dac-9a1f-5138006eab97 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:13.195339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb068e-b078-4dac-9a1f-5138006eab97 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:13.195835 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb068e-b078-4dac-9a1f-5138006eab97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:13.224678 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb38977-bf54-4f76-9412-d7c1e31ed692 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:13.235337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb38977-bf54-4f76-9412-d7c1e31ed692 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:13.235862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-9edb068e-b078-4dac-9a1f-5138006eab97 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:13.237188 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-9edb068e-b078-4dac-9a1f-5138006eab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:13.280681 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 880/1715] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:13.292216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 836/1716] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:13.299789 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb068e-b078-4dac-9a1f-5138006eab97 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:13.353847 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb068e-b078-4dac-9a1f-5138006eab97 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:13.383624 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cec44-9210-490b-b631-b0301d25c8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:13.384408 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cec44-9210-490b-b631-b0301d25c8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:13.384698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cec44-9210-490b-b631-b0301d25c8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:13.384989 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cec44-9210-490b-b631-b0301d25c8e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:13.394232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cec44-9210-490b-b631-b0301d25c8e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:00:13.396451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cec44-9210-490b-b631-b0301d25c8e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:13.402903 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cec44-9210-490b-b631-b0301d25c8e7 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:13.469231 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 881/1717] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:00:13.478231 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb38977-bf54-4f76-9412-d7c1e31ed692 service nova] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:13.507119 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb38977-bf54-4f76-9412-d7c1e31ed692 service nova] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:13.526224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6cf42-61dc-4809-88e0-9a21ec405dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:13.527047 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6cf42-61dc-4809-88e0-9a21ec405dbe admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:13.527310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6cf42-61dc-4809-88e0-9a21ec405dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:13.527588 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6cf42-61dc-4809-88e0-9a21ec405dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:13.528601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6cf42-61dc-4809-88e0-9a21ec405dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:13.531020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6cf42-61dc-4809-88e0-9a21ec405dbe admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:13.593726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 837/1718] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:13 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:00:13.598075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cec44-9210-490b-b631-b0301d25c8e7 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:13.616002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cec44-9210-490b-b631-b0301d25c8e7 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:13.843737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd8957-065c-42c0-98cd-0e8fab51b52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:13.844511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd8957-065c-42c0-98cd-0e8fab51b52f admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:13.844899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd8957-065c-42c0-98cd-0e8fab51b52f admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:13.845284 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd8957-065c-42c0-98cd-0e8fab51b52f admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:13.846714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd8957-065c-42c0-98cd-0e8fab51b52f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:13.848787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd8957-065c-42c0-98cd-0e8fab51b52f admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:13.929901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 882/1719] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:00:13 2022] POST /identity/v3/users => generated 287 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:13.931284 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6cf42-61dc-4809-88e0-9a21ec405dbe admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:13.946254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6cf42-61dc-4809-88e0-9a21ec405dbe admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:13.959128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0d568-ccec-40dd-a7e7-253a9ebb3fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:13.960211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0d568-ccec-40dd-a7e7-253a9ebb3fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:13.960730 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0d568-ccec-40dd-a7e7-253a9ebb3fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:13.961229 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0d568-ccec-40dd-a7e7-253a9ebb3fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:13.962180 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0d568-ccec-40dd-a7e7-253a9ebb3fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:13.964038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0d568-ccec-40dd-a7e7-253a9ebb3fb3 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:13.996500 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd8957-065c-42c0-98cd-0e8fab51b52f admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:14.007589 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd8957-065c-42c0-98cd-0e8fab51b52f admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:14.007891 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 838/1720] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:14.024907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3939-a90a-47c7-b0e6-4d9e27335e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:14.026014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3939-a90a-47c7-b0e6-4d9e27335e95 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:14.026507 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3939-a90a-47c7-b0e6-4d9e27335e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:14.026984 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3939-a90a-47c7-b0e6-4d9e27335e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:14.027897 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e3939-a90a-47c7-b0e6-4d9e27335e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:14.030411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e3939-a90a-47c7-b0e6-4d9e27335e95 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:14.056930 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 883/1721] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:14.058758 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0d568-ccec-40dd-a7e7-253a9ebb3fb3 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:14.076970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0d568-ccec-40dd-a7e7-253a9ebb3fb3 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:14.118417 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4538e78-d173-40e5-a204-c751fd70ae85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:14.119609 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4538e78-d173-40e5-a204-c751fd70ae85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:14.121179 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4538e78-d173-40e5-a204-c751fd70ae85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:14.123582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4538e78-d173-40e5-a204-c751fd70ae85 admin admin] PATH_INFO: `/v3/projects/30e49aad18554d3a8a4b7fb461193daf/users/5b9ecd374fdc4e5884837511600c6416/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:14.206183 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4538e78-d173-40e5-a204-c751fd70ae85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e49aad18554d3a8a4b7fb461193daf, user_id=5b9ecd374fdc4e5884837511600c6416, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:14.210389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4538e78-d173-40e5-a204-c751fd70ae85 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:14.265253 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 839/1722] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:14 2022] PUT /identity/v3/projects/30e49aad18554d3a8a4b7fb461193daf/users/5b9ecd374fdc4e5884837511600c6416/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:14.280108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098197c-be5b-4e10-897a-f230be597d11 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:14.280893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098197c-be5b-4e10-897a-f230be597d11 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:14.282327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098197c-be5b-4e10-897a-f230be597d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:14.315918 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33af3e8-647b-4c45-9c56-4b2095610579 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:14.316486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33af3e8-647b-4c45-9c56-4b2095610579 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:14.316970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33af3e8-647b-4c45-9c56-4b2095610579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:14.363880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-e33af3e8-647b-4c45-9c56-4b2095610579 None None] MFA Rules not processed for user `def10f42c8744e1d8526087c874ceedd`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:14.368519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-e33af3e8-647b-4c45-9c56-4b2095610579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:14.380984 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-c098197c-be5b-4e10-897a-f230be597d11 None None] MFA Rules not processed for user `5b9ecd374fdc4e5884837511600c6416`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:14.382561 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c098197c-be5b-4e10-897a-f230be597d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:14.611139 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 840/1723] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:14.671285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 884/1724] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:14.676041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33af3e8-647b-4c45-9c56-4b2095610579 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:14.876699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33af3e8-647b-4c45-9c56-4b2095610579 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:14.916355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a86a83-4397-4de3-954d-b7fafb4501fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:14.917589 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a86a83-4397-4de3-954d-b7fafb4501fa admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:14.918098 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a86a83-4397-4de3-954d-b7fafb4501fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:14.918587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a86a83-4397-4de3-954d-b7fafb4501fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:14.920128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a86a83-4397-4de3-954d-b7fafb4501fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:14.922404 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a86a83-4397-4de3-954d-b7fafb4501fa admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:15.065950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 841/1725] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:14 2022] POST /identity/v3/projects => generated 373 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:15.067186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098197c-be5b-4e10-897a-f230be597d11 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:15.086412 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098197c-be5b-4e10-897a-f230be597d11 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:15.285985 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b583547-0230-498d-91cc-ef9cd57c25fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:15.286852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b583547-0230-498d-91cc-ef9cd57c25fe admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:15.287244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b583547-0230-498d-91cc-ef9cd57c25fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:15.288627 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b583547-0230-498d-91cc-ef9cd57c25fe admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:15.301053 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b583547-0230-498d-91cc-ef9cd57c25fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:15.303410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b583547-0230-498d-91cc-ef9cd57c25fe admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:15.342112 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 885/1726] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:00:15 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:15.346231 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a86a83-4397-4de3-954d-b7fafb4501fa admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:15.362992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a86a83-4397-4de3-954d-b7fafb4501fa admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:15.370770 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5f27d-d208-415a-b01e-c4993c297770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:15.373538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5f27d-d208-415a-b01e-c4993c297770 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:15.374248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5f27d-d208-415a-b01e-c4993c297770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:15.383261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5f27d-d208-415a-b01e-c4993c297770 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:15.392588 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5f27d-d208-415a-b01e-c4993c297770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:15.399713 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5f27d-d208-415a-b01e-c4993c297770 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:15.434230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 842/1727] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:15.438289 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b583547-0230-498d-91cc-ef9cd57c25fe admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:15.485882 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b583547-0230-498d-91cc-ef9cd57c25fe admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:15.499870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b080363-974a-4cfb-9b20-ccb4357c1edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:15.505646 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b080363-974a-4cfb-9b20-ccb4357c1edc admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:15.506169 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b080363-974a-4cfb-9b20-ccb4357c1edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:15.507100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b080363-974a-4cfb-9b20-ccb4357c1edc admin admin] PATH_INFO: `/v3/projects/4ce7b78ca57247f2862234e70687a30d/users/835a190b9c1242638e5d4684bb5c9788/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:15.627734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b080363-974a-4cfb-9b20-ccb4357c1edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce7b78ca57247f2862234e70687a30d, user_id=835a190b9c1242638e5d4684bb5c9788, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:15.643874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b080363-974a-4cfb-9b20-ccb4357c1edc admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:15.701643 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 886/1728] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:15 2022] PUT /identity/v3/projects/4ce7b78ca57247f2862234e70687a30d/users/835a190b9c1242638e5d4684bb5c9788/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:15.705665 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5f27d-d208-415a-b01e-c4993c297770 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:15.720904 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5f27d-d208-415a-b01e-c4993c297770 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:15.801734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b080363-974a-4cfb-9b20-ccb4357c1edc admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:15.804405 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-0b080363-974a-4cfb-9b20-ccb4357c1edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:15.925885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851532b9-b49c-4242-b938-ddd30448df56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:15.926603 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851532b9-b49c-4242-b938-ddd30448df56 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:15.926908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851532b9-b49c-4242-b938-ddd30448df56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:15.927250 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851532b9-b49c-4242-b938-ddd30448df56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:15.928229 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851532b9-b49c-4242-b938-ddd30448df56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:15.930192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851532b9-b49c-4242-b938-ddd30448df56 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:15.983208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 843/1729] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:15.991335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851532b9-b49c-4242-b938-ddd30448df56 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:16.010785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851532b9-b49c-4242-b938-ddd30448df56 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:16.025948 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2930a4-fae1-424a-8b77-093f6db5bc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:16.027164 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2930a4-fae1-424a-8b77-093f6db5bc69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:16.027620 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2930a4-fae1-424a-8b77-093f6db5bc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:16.028259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2930a4-fae1-424a-8b77-093f6db5bc69 admin admin] PATH_INFO: `/v3/projects/4ce7b78ca57247f2862234e70687a30d/users/835a190b9c1242638e5d4684bb5c9788/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:16.037815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2930a4-fae1-424a-8b77-093f6db5bc69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce7b78ca57247f2862234e70687a30d, user_id=835a190b9c1242638e5d4684bb5c9788, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:16.041326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2930a4-fae1-424a-8b77-093f6db5bc69 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:16.060870 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 844/1730] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:15 2022] PUT /identity/v3/projects/4ce7b78ca57247f2862234e70687a30d/users/835a190b9c1242638e5d4684bb5c9788/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:16.072239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01785c25-be3a-4963-ba41-9f142b31c5e7 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:16.072674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01785c25-be3a-4963-ba41-9f142b31c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:16.073129 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01785c25-be3a-4963-ba41-9f142b31c5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:16.078181 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b080363-974a-4cfb-9b20-ccb4357c1edc admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:16.133827 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-01785c25-be3a-4963-ba41-9f142b31c5e7 None None] MFA Rules not processed for user `835a190b9c1242638e5d4684bb5c9788`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:16.135387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-01785c25-be3a-4963-ba41-9f142b31c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:16.274454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 845/1731] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:16.287717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01785c25-be3a-4963-ba41-9f142b31c5e7 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:16.290871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-01785c25-be3a-4963-ba41-9f142b31c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:16.293476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d2179-c489-4a58-bf58-967c4f73699c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:16.295211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d2179-c489-4a58-bf58-967c4f73699c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:16.296607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d2179-c489-4a58-bf58-967c4f73699c admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:16.297668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d2179-c489-4a58-bf58-967c4f73699c admin admin] PATH_INFO: `/v3/users/a571d6689f444b41b91d75dd0a8744dd` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:16.299655 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d2179-c489-4a58-bf58-967c4f73699c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a571d6689f444b41b91d75dd0a8744dd)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:16.302792 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d2179-c489-4a58-bf58-967c4f73699c admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:16.417855 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01785c25-be3a-4963-ba41-9f142b31c5e7 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:16.438673 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb45ba2-077b-4773-b091-ec236aa078f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:16.439543 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb45ba2-077b-4773-b091-ec236aa078f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:16.439974 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb45ba2-077b-4773-b091-ec236aa078f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:16.440418 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb45ba2-077b-4773-b091-ec236aa078f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:16.471432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb45ba2-077b-4773-b091-ec236aa078f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:16.473206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb45ba2-077b-4773-b091-ec236aa078f6 service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:16.496722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-840d2179-c489-4a58-bf58-967c4f73699c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a571d6689f444b41b91d75dd0a8744dd'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:16.517771 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 846/1732] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:00:16.576203 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-840d2179-c489-4a58-bf58-967c4f73699c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a571d6689f444b41b91d75dd0a8744dd'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:16.611153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-840d2179-c489-4a58-bf58-967c4f73699c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a571d6689f444b41b91d75dd0a8744dd'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:16.612707 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-840d2179-c489-4a58-bf58-967c4f73699c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a571d6689f444b41b91d75dd0a8744dd'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:16.644199 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-840d2179-c489-4a58-bf58-967c4f73699c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a571d6689f444b41b91d75dd0a8744dd'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:16.669002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 887/1733] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:15 2022] DELETE /identity/v3/users/a571d6689f444b41b91d75dd0a8744dd => generated 0 bytes in 868 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:16.678062 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa90ec0-9037-41d5-b46a-06fa7dc74554 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:16.678449 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa90ec0-9037-41d5-b46a-06fa7dc74554 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:16.679108 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa90ec0-9037-41d5-b46a-06fa7dc74554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:16.748396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-5aa90ec0-9037-41d5-b46a-06fa7dc74554 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:16.751289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-5aa90ec0-9037-41d5-b46a-06fa7dc74554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:16.958038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 847/1734] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:00:17.089820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b3b96-7f2d-419c-811d-d867a0f3337c None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:17.090221 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b3b96-7f2d-419c-811d-d867a0f3337c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:17.090609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b3b96-7f2d-419c-811d-d867a0f3337c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:17.169649 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa90ec0-9037-41d5-b46a-06fa7dc74554 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:17.171884 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-5aa90ec0-9037-41d5-b46a-06fa7dc74554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:17.233432 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-260b3b96-7f2d-419c-811d-d867a0f3337c None None] MFA Rules not processed for user `8c563c6a229b4e619992ccfb0da1a748`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:17.239154 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-260b3b96-7f2d-419c-811d-d867a0f3337c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:17.345010 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa90ec0-9037-41d5-b46a-06fa7dc74554 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:17.352236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b13d3-32cb-4140-876b-3b9429292c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:17.356016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b13d3-32cb-4140-876b-3b9429292c64 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:17.356558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b13d3-32cb-4140-876b-3b9429292c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:17.357078 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b13d3-32cb-4140-876b-3b9429292c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:17.378690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b13d3-32cb-4140-876b-3b9429292c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:17.380426 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b13d3-32cb-4140-876b-3b9429292c64 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:17.400149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 848/1735] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:00:17.407048 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45258f2-b821-4c60-9572-0cb7daf090d0 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:17.411518 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45258f2-b821-4c60-9572-0cb7daf090d0 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:17.411518 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45258f2-b821-4c60-9572-0cb7daf090d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:17.469984 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-a45258f2-b821-4c60-9572-0cb7daf090d0 None None] MFA Rules not processed for user `bd14de0fd51c4fd89d9875b9c47100cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:17.473560 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a45258f2-b821-4c60-9572-0cb7daf090d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:17.519676 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 888/1736] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:17.519676 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b3b96-7f2d-419c-811d-d867a0f3337c None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:17.519676 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-260b3b96-7f2d-419c-811d-d867a0f3337c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:17.605717 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b3b96-7f2d-419c-811d-d867a0f3337c None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:17.628281 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1847b6f-76b7-4113-a690-f048df6c8ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:17.633909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1847b6f-76b7-4113-a690-f048df6c8ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:17.634689 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1847b6f-76b7-4113-a690-f048df6c8ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:17.639135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1847b6f-76b7-4113-a690-f048df6c8ea7 admin admin] PATH_INFO: `/v3/users/5b9ecd374fdc4e5884837511600c6416` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:17.646880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1847b6f-76b7-4113-a690-f048df6c8ea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b9ecd374fdc4e5884837511600c6416)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:17.653747 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1847b6f-76b7-4113-a690-f048df6c8ea7 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:17.736651 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 849/1737] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:17.736651 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45258f2-b821-4c60-9572-0cb7daf090d0 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:17.736651 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a45258f2-b821-4c60-9572-0cb7daf090d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:17.815797 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c1847b6f-76b7-4113-a690-f048df6c8ea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b9ecd374fdc4e5884837511600c6416'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:17.840951 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c1847b6f-76b7-4113-a690-f048df6c8ea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b9ecd374fdc4e5884837511600c6416'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:17.855921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c1847b6f-76b7-4113-a690-f048df6c8ea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b9ecd374fdc4e5884837511600c6416'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:17.857608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c1847b6f-76b7-4113-a690-f048df6c8ea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b9ecd374fdc4e5884837511600c6416'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:17.881360 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c1847b6f-76b7-4113-a690-f048df6c8ea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b9ecd374fdc4e5884837511600c6416'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:17.890573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 889/1738] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:17 2022] DELETE /identity/v3/users/5b9ecd374fdc4e5884837511600c6416 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:17.892340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e447d-90c1-4c80-b96e-041e84f8c4cc None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:17.892751 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e447d-90c1-4c80-b96e-041e84f8c4cc None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:17.893197 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e447d-90c1-4c80-b96e-041e84f8c4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:17.945357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-317e447d-90c1-4c80-b96e-041e84f8c4cc None None] MFA Rules not processed for user `bd14de0fd51c4fd89d9875b9c47100cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:17.948096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-317e447d-90c1-4c80-b96e-041e84f8c4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:18.041420 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45258f2-b821-4c60-9572-0cb7daf090d0 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:18.137454 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 890/1739] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:18.137454 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3524-1e17-433e-b77c-e9c2ebb9b32f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:18.137454 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3524-1e17-433e-b77c-e9c2ebb9b32f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:18.137454 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3524-1e17-433e-b77c-e9c2ebb9b32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:18.171196 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f49c3524-1e17-433e-b77c-e9c2ebb9b32f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:18.172668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f49c3524-1e17-433e-b77c-e9c2ebb9b32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:18.218413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8aac6-b1aa-4134-9b4c-e1bc795ccb78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:18.220766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8aac6-b1aa-4134-9b4c-e1bc795ccb78 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:18.221510 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8aac6-b1aa-4134-9b4c-e1bc795ccb78 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:18.222081 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8aac6-b1aa-4134-9b4c-e1bc795ccb78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:18.227026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d3e8aac6-b1aa-4134-9b4c-e1bc795ccb78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:18.322339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 891/1740] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:18.324071 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e9ddd-ab1d-491a-abc1-79db245c71c2 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:18.325151 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e9ddd-ab1d-491a-abc1-79db245c71c2 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:18.327626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e9ddd-ab1d-491a-abc1-79db245c71c2 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:18.329784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 892/1741] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 14:00:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:00:18.337797 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e9ddd-ab1d-491a-abc1-79db245c71c2 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:18.345402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-5a1e9ddd-ab1d-491a-abc1-79db245c71c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:18.376284 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8aac6-b1aa-4134-9b4c-e1bc795ccb78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:18.396048 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8aac6-b1aa-4134-9b4c-e1bc795ccb78 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:18.422096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 850/1742] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:18.456996 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e9ddd-ab1d-491a-abc1-79db245c71c2 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:18.460799 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb40574-3b52-4221-8f2e-e59e9c344e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:18.461646 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb40574-3b52-4221-8f2e-e59e9c344e06 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:18.462063 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb40574-3b52-4221-8f2e-e59e9c344e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:18.462581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb40574-3b52-4221-8f2e-e59e9c344e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:18.473637 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb40574-3b52-4221-8f2e-e59e9c344e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:18.478832 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb40574-3b52-4221-8f2e-e59e9c344e06 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:18.504537 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 893/1743] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:18.563729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345ab39-9f07-4523-9fa6-1f0287980672 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:18.565583 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345ab39-9f07-4523-9fa6-1f0287980672 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:18.566048 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345ab39-9f07-4523-9fa6-1f0287980672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:18.609697 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-d345ab39-9f07-4523-9fa6-1f0287980672 None None] MFA Rules not processed for user `975f10f781b94bdaa8edee39a2b1bba4`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:18.614557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d345ab39-9f07-4523-9fa6-1f0287980672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:18.645064 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 851/1744] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 14:00:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:18.732414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb40574-3b52-4221-8f2e-e59e9c344e06 service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:18.734141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-6fb40574-3b52-4221-8f2e-e59e9c344e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:18.772412 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb40574-3b52-4221-8f2e-e59e9c344e06 service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:18.785975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583eb2c-d1c5-4a82-97fc-c78c1c694d26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:18.788833 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583eb2c-d1c5-4a82-97fc-c78c1c694d26 service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:18.789266 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583eb2c-d1c5-4a82-97fc-c78c1c694d26 service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:18.790218 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583eb2c-d1c5-4a82-97fc-c78c1c694d26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:18.794942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-2583eb2c-d1c5-4a82-97fc-c78c1c694d26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:18.840684 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583eb2c-d1c5-4a82-97fc-c78c1c694d26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:18.848098 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583eb2c-d1c5-4a82-97fc-c78c1c694d26 service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:18.894906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 894/1745] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:20.646588 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954abec7-dc25-4b46-a5eb-2e2e144a2e4e None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:20.647600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954abec7-dc25-4b46-a5eb-2e2e144a2e4e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:20.647600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954abec7-dc25-4b46-a5eb-2e2e144a2e4e None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:20.650200 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 852/1746] 10.222.0.49 () {54 vars in 912 bytes} [Tue May 10 14:00:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 14:00:20.670353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fcd81-8971-416b-a8d7-d3b2f9a64021 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:20.670880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fcd81-8971-416b-a8d7-d3b2f9a64021 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:20.670880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fcd81-8971-416b-a8d7-d3b2f9a64021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:20.744298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-c24fcd81-8971-416b-a8d7-d3b2f9a64021 None None] MFA Rules not processed for user `930f350dad954c7783f479bbb25c1f46`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:20.750369 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c24fcd81-8971-416b-a8d7-d3b2f9a64021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:20.781583 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 895/1747] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 14:00:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:00:20.905524 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954abec7-dc25-4b46-a5eb-2e2e144a2e4e None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:20.937712 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954abec7-dc25-4b46-a5eb-2e2e144a2e4e None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:20.952906 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14519999-4840-4248-b09a-c354ff10c082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:20.953639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14519999-4840-4248-b09a-c354ff10c082 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:20.953837 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14519999-4840-4248-b09a-c354ff10c082 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:20.954581 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14519999-4840-4248-b09a-c354ff10c082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:20.980718 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14519999-4840-4248-b09a-c354ff10c082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:20.982827 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14519999-4840-4248-b09a-c354ff10c082 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:21.006226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 853/1748] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:21.270548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fcd81-8971-416b-a8d7-d3b2f9a64021 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:21.272239 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c24fcd81-8971-416b-a8d7-d3b2f9a64021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:21.301510 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14519999-4840-4248-b09a-c354ff10c082 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:21.303036 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-14519999-4840-4248-b09a-c354ff10c082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:21.329501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fcd81-8971-416b-a8d7-d3b2f9a64021 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:21.354307 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14519999-4840-4248-b09a-c354ff10c082 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:21.373128 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcca4f2-4989-4847-9980-8635cf4fa71c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:21.373878 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcca4f2-4989-4847-9980-8635cf4fa71c service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:21.374156 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcca4f2-4989-4847-9980-8635cf4fa71c service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:21.374426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcca4f2-4989-4847-9980-8635cf4fa71c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:21.383200 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af4683-c055-4799-9f6d-479693758306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:21.384371 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af4683-c055-4799-9f6d-479693758306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:21.384799 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af4683-c055-4799-9f6d-479693758306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:21.385768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af4683-c055-4799-9f6d-479693758306 admin admin] PATH_INFO: `/v3/projects/30e49aad18554d3a8a4b7fb461193daf` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:21.392161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af4683-c055-4799-9f6d-479693758306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e49aad18554d3a8a4b7fb461193daf)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:21.394327 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af4683-c055-4799-9f6d-479693758306 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:21.429003 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcca4f2-4989-4847-9980-8635cf4fa71c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:21.430607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcca4f2-4989-4847-9980-8635cf4fa71c service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:21.476103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 896/1749] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:21.589499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-11af4683-c055-4799-9f6d-479693758306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e49aad18554d3a8a4b7fb461193daf', 'request_id': 'req-11af4683-c055-4799-9f6d-479693758306'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:21.603242 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-11af4683-c055-4799-9f6d-479693758306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e49aad18554d3a8a4b7fb461193daf', 'request_id': 'req-11af4683-c055-4799-9f6d-479693758306'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:21.618236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-11af4683-c055-4799-9f6d-479693758306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e49aad18554d3a8a4b7fb461193daf', 'request_id': 'req-11af4683-c055-4799-9f6d-479693758306'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:21.650708 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-11af4683-c055-4799-9f6d-479693758306 admin admin] The token cache is being invalidate because project 30e49aad18554d3a8a4b7fb461193daf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:21.654440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-11af4683-c055-4799-9f6d-479693758306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:21.665648 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-11af4683-c055-4799-9f6d-479693758306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:21.668747 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 854/1750] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:21 2022] DELETE /identity/v3/projects/30e49aad18554d3a8a4b7fb461193daf => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:00:21.673258 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcca4f2-4989-4847-9980-8635cf4fa71c service nova] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:21.689370 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcca4f2-4989-4847-9980-8635cf4fa71c service nova] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:21.784675 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af4683-c055-4799-9f6d-479693758306 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:21.786291 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-11af4683-c055-4799-9f6d-479693758306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:21.957816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71a56e-598d-4148-9d71-cee4553c1880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:21.958731 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71a56e-598d-4148-9d71-cee4553c1880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:21.958998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71a56e-598d-4148-9d71-cee4553c1880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:21.959273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71a56e-598d-4148-9d71-cee4553c1880 admin admin] PATH_INFO: `/v3/users/835a190b9c1242638e5d4684bb5c9788` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:21.960798 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71a56e-598d-4148-9d71-cee4553c1880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=835a190b9c1242638e5d4684bb5c9788)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:21.962768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71a56e-598d-4148-9d71-cee4553c1880 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:22.016142 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af4683-c055-4799-9f6d-479693758306 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:22.062611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6b71a56e-598d-4148-9d71-cee4553c1880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835a190b9c1242638e5d4684bb5c9788'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:22.083211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c82601-96eb-4d3b-8a7a-83a5143d7712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:22.084336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c82601-96eb-4d3b-8a7a-83a5143d7712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:22.084681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c82601-96eb-4d3b-8a7a-83a5143d7712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:22.084965 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c82601-96eb-4d3b-8a7a-83a5143d7712 admin admin] PATH_INFO: `/v3/projects/25e81266efde45e691c98a4159567ae4` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:22.086320 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c82601-96eb-4d3b-8a7a-83a5143d7712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25e81266efde45e691c98a4159567ae4)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:22.088828 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c82601-96eb-4d3b-8a7a-83a5143d7712 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:22.095721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6b71a56e-598d-4148-9d71-cee4553c1880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835a190b9c1242638e5d4684bb5c9788'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:22.128417 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6b71a56e-598d-4148-9d71-cee4553c1880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835a190b9c1242638e5d4684bb5c9788'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:22.136762 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6b71a56e-598d-4148-9d71-cee4553c1880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835a190b9c1242638e5d4684bb5c9788'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:22.163664 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6b71a56e-598d-4148-9d71-cee4553c1880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835a190b9c1242638e5d4684bb5c9788'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:22.187113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 897/1751] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:21 2022] DELETE /identity/v3/users/835a190b9c1242638e5d4684bb5c9788 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:22.238952 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-81c82601-96eb-4d3b-8a7a-83a5143d7712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25e81266efde45e691c98a4159567ae4', 'request_id': 'req-81c82601-96eb-4d3b-8a7a-83a5143d7712'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:22.249212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-81c82601-96eb-4d3b-8a7a-83a5143d7712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25e81266efde45e691c98a4159567ae4', 'request_id': 'req-81c82601-96eb-4d3b-8a7a-83a5143d7712'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:22.275052 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-81c82601-96eb-4d3b-8a7a-83a5143d7712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25e81266efde45e691c98a4159567ae4', 'request_id': 'req-81c82601-96eb-4d3b-8a7a-83a5143d7712'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:22.293308 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-81c82601-96eb-4d3b-8a7a-83a5143d7712 admin admin] The token cache is being invalidate because project 25e81266efde45e691c98a4159567ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:22.293612 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-81c82601-96eb-4d3b-8a7a-83a5143d7712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:22.294981 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-81c82601-96eb-4d3b-8a7a-83a5143d7712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:22.297521 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 855/1752] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:21 2022] DELETE /identity/v3/projects/25e81266efde45e691c98a4159567ae4 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:22.301196 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71a56e-598d-4148-9d71-cee4553c1880 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:22.302761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-6b71a56e-598d-4148-9d71-cee4553c1880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:22.496410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71a56e-598d-4148-9d71-cee4553c1880 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:22.719427 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89af76-c684-45ff-94d6-e9a164bf89f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:22.725262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89af76-c684-45ff-94d6-e9a164bf89f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:22.727757 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89af76-c684-45ff-94d6-e9a164bf89f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:22.728887 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89af76-c684-45ff-94d6-e9a164bf89f9 admin admin] PATH_INFO: `/v3/users/cdf79c2fb5c44436adaae38cd4e12530` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:22.736309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89af76-c684-45ff-94d6-e9a164bf89f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf79c2fb5c44436adaae38cd4e12530)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:22.740860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89af76-c684-45ff-94d6-e9a164bf89f9 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:22.850905 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-3e89af76-c684-45ff-94d6-e9a164bf89f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf79c2fb5c44436adaae38cd4e12530'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:22.875022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-3e89af76-c684-45ff-94d6-e9a164bf89f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf79c2fb5c44436adaae38cd4e12530'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:22.885323 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-3e89af76-c684-45ff-94d6-e9a164bf89f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf79c2fb5c44436adaae38cd4e12530'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:22.886255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-3e89af76-c684-45ff-94d6-e9a164bf89f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf79c2fb5c44436adaae38cd4e12530'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:22.897784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-3e89af76-c684-45ff-94d6-e9a164bf89f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf79c2fb5c44436adaae38cd4e12530'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:22.911742 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 898/1753] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:22 2022] DELETE /identity/v3/users/cdf79c2fb5c44436adaae38cd4e12530 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:23.078818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a338e8-6ca8-4c4c-8394-86ee7cfc7166 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:23.079385 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a338e8-6ca8-4c4c-8394-86ee7cfc7166 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:23.079548 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a338e8-6ca8-4c4c-8394-86ee7cfc7166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:23.130383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-e7a338e8-6ca8-4c4c-8394-86ee7cfc7166 None None] MFA Rules not processed for user `bd14de0fd51c4fd89d9875b9c47100cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:23.134043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-e7a338e8-6ca8-4c4c-8394-86ee7cfc7166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:23.243760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 856/1754] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:24.192786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec1925-7cbb-429b-8c51-7b8c153b517c None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:24.194695 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec1925-7cbb-429b-8c51-7b8c153b517c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:24.195238 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec1925-7cbb-429b-8c51-7b8c153b517c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:24.236921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-74ec1925-7cbb-429b-8c51-7b8c153b517c None None] MFA Rules not processed for user `67535c1c99484689999ef478604e51d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:24.240920 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-74ec1925-7cbb-429b-8c51-7b8c153b517c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:24.306546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27412277-4ba1-443c-b0b2-56c22b61bcaa None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:24.306994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27412277-4ba1-443c-b0b2-56c22b61bcaa None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:24.307140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27412277-4ba1-443c-b0b2-56c22b61bcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:24.374496 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-27412277-4ba1-443c-b0b2-56c22b61bcaa None None] MFA Rules not processed for user `8c563c6a229b4e619992ccfb0da1a748`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:24.376888 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 899/1755] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:24.378292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-27412277-4ba1-443c-b0b2-56c22b61bcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:24.664402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 857/1756] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:00:24.874322 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec1925-7cbb-429b-8c51-7b8c153b517c None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:24.875789 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-74ec1925-7cbb-429b-8c51-7b8c153b517c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:25.074556 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec1925-7cbb-429b-8c51-7b8c153b517c None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:25.082617 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4df62-f65e-4b86-bc34-0f458d2a0735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:25.084904 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4df62-f65e-4b86-bc34-0f458d2a0735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:25.085479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4df62-f65e-4b86-bc34-0f458d2a0735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:25.086354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4df62-f65e-4b86-bc34-0f458d2a0735 admin admin] PATH_INFO: `/v3/projects/4ce7b78ca57247f2862234e70687a30d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:25.088163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4df62-f65e-4b86-bc34-0f458d2a0735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce7b78ca57247f2862234e70687a30d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:25.090640 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4df62-f65e-4b86-bc34-0f458d2a0735 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:25.188279 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-54a4df62-f65e-4b86-bc34-0f458d2a0735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce7b78ca57247f2862234e70687a30d', 'request_id': 'req-54a4df62-f65e-4b86-bc34-0f458d2a0735'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:25.199541 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-54a4df62-f65e-4b86-bc34-0f458d2a0735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce7b78ca57247f2862234e70687a30d', 'request_id': 'req-54a4df62-f65e-4b86-bc34-0f458d2a0735'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:25.225954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-54a4df62-f65e-4b86-bc34-0f458d2a0735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce7b78ca57247f2862234e70687a30d', 'request_id': 'req-54a4df62-f65e-4b86-bc34-0f458d2a0735'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:25.244134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-54a4df62-f65e-4b86-bc34-0f458d2a0735 admin admin] The token cache is being invalidate because project 4ce7b78ca57247f2862234e70687a30d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:25.245079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-54a4df62-f65e-4b86-bc34-0f458d2a0735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:25.246197 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-54a4df62-f65e-4b86-bc34-0f458d2a0735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:25.249776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 900/1757] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:24 2022] DELETE /identity/v3/projects/4ce7b78ca57247f2862234e70687a30d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:25.258743 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a665d09-9c7c-4c24-9176-ad6164c3c15a None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:25.263370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a665d09-9c7c-4c24-9176-ad6164c3c15a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:25.264157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a665d09-9c7c-4c24-9176-ad6164c3c15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:25.304610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-8a665d09-9c7c-4c24-9176-ad6164c3c15a None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:25.306319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8a665d09-9c7c-4c24-9176-ad6164c3c15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:25.396089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 858/1758] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:25.398026 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582b420-e457-4c37-8d03-9b900aadab39 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:25.398582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582b420-e457-4c37-8d03-9b900aadab39 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:25.398854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582b420-e457-4c37-8d03-9b900aadab39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:25.419527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-8582b420-e457-4c37-8d03-9b900aadab39 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:25.420871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-8582b420-e457-4c37-8d03-9b900aadab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:25.430267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 901/1759] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:00:25.434239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a665d09-9c7c-4c24-9176-ad6164c3c15a None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:25.450104 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a665d09-9c7c-4c24-9176-ad6164c3c15a None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:25.466100 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99be33-c5c0-4758-aed8-79889b0aedb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:25.467636 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99be33-c5c0-4758-aed8-79889b0aedb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:25.467928 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99be33-c5c0-4758-aed8-79889b0aedb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:25.468359 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99be33-c5c0-4758-aed8-79889b0aedb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:25.469432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99be33-c5c0-4758-aed8-79889b0aedb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:00:25.469830 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99be33-c5c0-4758-aed8-79889b0aedb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:25.472786 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99be33-c5c0-4758-aed8-79889b0aedb6 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:25.503137 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582b420-e457-4c37-8d03-9b900aadab39 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:25.503358 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 859/1760] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:00:25.515409 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582b420-e457-4c37-8d03-9b900aadab39 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:25.530039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f6808-c822-4346-939c-473733582387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:25.530721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f6808-c822-4346-939c-473733582387 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:25.531001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f6808-c822-4346-939c-473733582387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:25.531274 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f6808-c822-4346-939c-473733582387 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:25.531964 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f6808-c822-4346-939c-473733582387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:25.534837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f6808-c822-4346-939c-473733582387 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:25.619078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 902/1761] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:25 2022] POST /identity/v3/projects => generated 355 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:00:25.623290 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99be33-c5c0-4758-aed8-79889b0aedb6 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:25.636876 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99be33-c5c0-4758-aed8-79889b0aedb6 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:25.789717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a389d-70b8-481f-901c-03782fd57115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:25.790419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a389d-70b8-481f-901c-03782fd57115 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:25.790703 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a389d-70b8-481f-901c-03782fd57115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:25.790981 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a389d-70b8-481f-901c-03782fd57115 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:25.791765 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a389d-70b8-481f-901c-03782fd57115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:25.793928 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a389d-70b8-481f-901c-03782fd57115 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:25.821311 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f6808-c822-4346-939c-473733582387 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:25.823562 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-3a5f6808-c822-4346-939c-473733582387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:25.840345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 860/1762] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:00:25 2022] POST /identity/v3/users => generated 278 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:25.845876 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a389d-70b8-481f-901c-03782fd57115 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:25.861410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f6808-c822-4346-939c-473733582387 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:25.867974 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a389d-70b8-481f-901c-03782fd57115 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:25.874561 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879363f-a8ff-4ebf-aa0b-17ba5d681543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:25.875779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879363f-a8ff-4ebf-aa0b-17ba5d681543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:25.876153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879363f-a8ff-4ebf-aa0b-17ba5d681543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:25.876555 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879363f-a8ff-4ebf-aa0b-17ba5d681543 admin admin] PATH_INFO: `/v3/projects/01e101894d0a470ab7dc7dca73207871` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:25.878061 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879363f-a8ff-4ebf-aa0b-17ba5d681543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e101894d0a470ab7dc7dca73207871)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:25.883219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879363f-a8ff-4ebf-aa0b-17ba5d681543 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:25.886495 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b18b3a-a346-41b0-b68b-ed9944f0cff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:25.887312 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b18b3a-a346-41b0-b68b-ed9944f0cff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:25.887645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b18b3a-a346-41b0-b68b-ed9944f0cff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:25.888733 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b18b3a-a346-41b0-b68b-ed9944f0cff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:25.890961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b18b3a-a346-41b0-b68b-ed9944f0cff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:25.893274 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b18b3a-a346-41b0-b68b-ed9944f0cff9 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:25.909961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 861/1763] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:25.911433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b18b3a-a346-41b0-b68b-ed9944f0cff9 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:25.926294 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b18b3a-a346-41b0-b68b-ed9944f0cff9 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:25.932974 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c6b15-1578-4102-8cc9-e1c423f807d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:25.933660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c6b15-1578-4102-8cc9-e1c423f807d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:25.933938 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c6b15-1578-4102-8cc9-e1c423f807d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:25.935111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c6b15-1578-4102-8cc9-e1c423f807d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:25.937559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c6b15-1578-4102-8cc9-e1c423f807d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:25.939906 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c6b15-1578-4102-8cc9-e1c423f807d1 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:25.957849 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 862/1764] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:25.963516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c6b15-1578-4102-8cc9-e1c423f807d1 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:25.985385 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c6b15-1578-4102-8cc9-e1c423f807d1 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:26.000905 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedaff0-7a26-49e0-95fa-950d44cac64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:26.001809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedaff0-7a26-49e0-95fa-950d44cac64f admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:26.002148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedaff0-7a26-49e0-95fa-950d44cac64f admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:26.002522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedaff0-7a26-49e0-95fa-950d44cac64f admin admin] PATH_INFO: `/v3/projects/12c13ecc4dde47dfb92b2877c6bb04e4/users/54ad86b044b7451cb99bcb8462de93e8/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:26.020447 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a879363f-a8ff-4ebf-aa0b-17ba5d681543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e101894d0a470ab7dc7dca73207871', 'request_id': 'req-a879363f-a8ff-4ebf-aa0b-17ba5d681543'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:26.041189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a879363f-a8ff-4ebf-aa0b-17ba5d681543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e101894d0a470ab7dc7dca73207871', 'request_id': 'req-a879363f-a8ff-4ebf-aa0b-17ba5d681543'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:26.041726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeedaff0-7a26-49e0-95fa-950d44cac64f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c13ecc4dde47dfb92b2877c6bb04e4, user_id=54ad86b044b7451cb99bcb8462de93e8, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:26.050051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeedaff0-7a26-49e0-95fa-950d44cac64f admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:26.050207 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a879363f-a8ff-4ebf-aa0b-17ba5d681543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e101894d0a470ab7dc7dca73207871', 'request_id': 'req-a879363f-a8ff-4ebf-aa0b-17ba5d681543'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:26.076127 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a879363f-a8ff-4ebf-aa0b-17ba5d681543 admin admin] The token cache is being invalidate because project 01e101894d0a470ab7dc7dca73207871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:26.076695 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a879363f-a8ff-4ebf-aa0b-17ba5d681543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:26.078015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 863/1765] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:25 2022] PUT /identity/v3/projects/12c13ecc4dde47dfb92b2877c6bb04e4/users/54ad86b044b7451cb99bcb8462de93e8/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:26.090350 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393c01a-ac75-4b93-a203-faef97928b90 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:26.090967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393c01a-ac75-4b93-a203-faef97928b90 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:26.091514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393c01a-ac75-4b93-a203-faef97928b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:26.099723 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a879363f-a8ff-4ebf-aa0b-17ba5d681543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:26.107499 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 903/1766] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:25 2022] DELETE /identity/v3/projects/01e101894d0a470ab7dc7dca73207871 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:26.111618 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f7993-3d17-4629-93f4-2c9bc4f5cd29 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:26.113241 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f7993-3d17-4629-93f4-2c9bc4f5cd29 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:26.113780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f7993-3d17-4629-93f4-2c9bc4f5cd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:26.160455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-0b2f7993-3d17-4629-93f4-2c9bc4f5cd29 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:26.162123 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-0b2f7993-3d17-4629-93f4-2c9bc4f5cd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:26.182879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-3393c01a-ac75-4b93-a203-faef97928b90 None None] MFA Rules not processed for user `54ad86b044b7451cb99bcb8462de93e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:26.184267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-3393c01a-ac75-4b93-a203-faef97928b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:26.321968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 904/1767] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:26.328113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df621-0f1f-4359-9b6f-d5bac1e97c24 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:26.329006 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df621-0f1f-4359-9b6f-d5bac1e97c24 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:26.329564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df621-0f1f-4359-9b6f-d5bac1e97c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:26.336287 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 864/1768] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:26 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:26.342228 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393c01a-ac75-4b93-a203-faef97928b90 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:26.347873 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-3393c01a-ac75-4b93-a203-faef97928b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:26.410485 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393c01a-ac75-4b93-a203-faef97928b90 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:26.420253 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-b76df621-0f1f-4359-9b6f-d5bac1e97c24 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:26.420996 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb8850-1f38-4a02-9af7-cbc848f70c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:26.422252 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b76df621-0f1f-4359-9b6f-d5bac1e97c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:26.423909 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb8850-1f38-4a02-9af7-cbc848f70c34 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:26.424765 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb8850-1f38-4a02-9af7-cbc848f70c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:26.425129 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb8850-1f38-4a02-9af7-cbc848f70c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:26.428450 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb8850-1f38-4a02-9af7-cbc848f70c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:26.437606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb8850-1f38-4a02-9af7-cbc848f70c34 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:26.465245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 905/1769] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:26.467761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76df621-0f1f-4359-9b6f-d5bac1e97c24 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:26.491105 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76df621-0f1f-4359-9b6f-d5bac1e97c24 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:26.501262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afa070-fe3f-4f64-8b59-6248f1021c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:26.502245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afa070-fe3f-4f64-8b59-6248f1021c54 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:26.502736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afa070-fe3f-4f64-8b59-6248f1021c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:26.503406 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afa070-fe3f-4f64-8b59-6248f1021c54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:26.504465 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afa070-fe3f-4f64-8b59-6248f1021c54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:00:26.504987 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afa070-fe3f-4f64-8b59-6248f1021c54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:26.511380 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 865/1770] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:26 2022] POST /identity/v3/projects => generated 355 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:26.517667 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb8850-1f38-4a02-9af7-cbc848f70c34 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:26.518127 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afa070-fe3f-4f64-8b59-6248f1021c54 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:26.534278 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 906/1771] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:00:26.539203 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afa070-fe3f-4f64-8b59-6248f1021c54 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:26.555141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afa070-fe3f-4f64-8b59-6248f1021c54 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:26.658131 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb8850-1f38-4a02-9af7-cbc848f70c34 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:26.673704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8d259-8f18-4a1c-9bb6-d199ad986c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:26.676196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8d259-8f18-4a1c-9bb6-d199ad986c0c admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:26.676544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8d259-8f18-4a1c-9bb6-d199ad986c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:26.676831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8d259-8f18-4a1c-9bb6-d199ad986c0c admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:26.678669 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8d259-8f18-4a1c-9bb6-d199ad986c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:26.683556 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8d259-8f18-4a1c-9bb6-d199ad986c0c admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:26.686480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263acc7-034c-49e2-9c83-e288e2bddeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:26.688369 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263acc7-034c-49e2-9c83-e288e2bddeb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:26.688658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263acc7-034c-49e2-9c83-e288e2bddeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:26.688938 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263acc7-034c-49e2-9c83-e288e2bddeb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:26.689643 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263acc7-034c-49e2-9c83-e288e2bddeb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:26.698550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263acc7-034c-49e2-9c83-e288e2bddeb0 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:26.731087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 866/1772] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:00:26 2022] POST /identity/v3/users => generated 284 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:26.732639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8d259-8f18-4a1c-9bb6-d199ad986c0c admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:26.757501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 907/1773] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:26 2022] POST /identity/v3/projects => generated 369 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:26.757953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8d259-8f18-4a1c-9bb6-d199ad986c0c admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:26.761430 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263acc7-034c-49e2-9c83-e288e2bddeb0 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:26.877344 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a66ac4-03fa-4f91-aaf0-8b67df1230b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:26.878687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a66ac4-03fa-4f91-aaf0-8b67df1230b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:26.879307 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a66ac4-03fa-4f91-aaf0-8b67df1230b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:26.879952 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a66ac4-03fa-4f91-aaf0-8b67df1230b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:26.881538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a66ac4-03fa-4f91-aaf0-8b67df1230b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:26.883543 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a66ac4-03fa-4f91-aaf0-8b67df1230b4 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:26.901836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 867/1774] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:26.903010 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a66ac4-03fa-4f91-aaf0-8b67df1230b4 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:26.916559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a66ac4-03fa-4f91-aaf0-8b67df1230b4 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:26.927874 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966696f-70d8-40dd-878a-5c728adc487c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:26.928983 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966696f-70d8-40dd-878a-5c728adc487c admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:26.929411 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966696f-70d8-40dd-878a-5c728adc487c admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:26.929822 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966696f-70d8-40dd-878a-5c728adc487c admin admin] PATH_INFO: `/v3/projects/0b19d245195d4399b87fb1ad86a59a76/users/db2816a0dd844f238df075a850b12bee/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:26.942871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263acc7-034c-49e2-9c83-e288e2bddeb0 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:26.959508 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918f027-8875-4bae-b9c1-3a69894c72cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:26.960660 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f027-8875-4bae-b9c1-3a69894c72cd admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:26.961136 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f027-8875-4bae-b9c1-3a69894c72cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:26.961897 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f027-8875-4bae-b9c1-3a69894c72cd admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:26.966244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918f027-8875-4bae-b9c1-3a69894c72cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:26.969997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918f027-8875-4bae-b9c1-3a69894c72cd admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:26.980189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966696f-70d8-40dd-878a-5c728adc487c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b19d245195d4399b87fb1ad86a59a76, user_id=db2816a0dd844f238df075a850b12bee, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:26.994226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966696f-70d8-40dd-878a-5c728adc487c admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:27.027768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 908/1775] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:00:26 2022] POST /identity/v3/users => generated 285 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:27.032231 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918f027-8875-4bae-b9c1-3a69894c72cd admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:27.033335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 868/1776] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:26 2022] PUT /identity/v3/projects/0b19d245195d4399b87fb1ad86a59a76/users/db2816a0dd844f238df075a850b12bee/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:27.036877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966696f-70d8-40dd-878a-5c728adc487c admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:27.064086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918f027-8875-4bae-b9c1-3a69894c72cd admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:27.171185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966696f-70d8-40dd-878a-5c728adc487c admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:27.180016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba5914-4595-4bd6-9bd7-6c873d82f4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:27.180748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba5914-4595-4bd6-9bd7-6c873d82f4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:27.181031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba5914-4595-4bd6-9bd7-6c873d82f4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:27.181303 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba5914-4595-4bd6-9bd7-6c873d82f4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:27.182622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba5914-4595-4bd6-9bd7-6c873d82f4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:27.193260 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba5914-4595-4bd6-9bd7-6c873d82f4c4 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:27.213534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 869/1777] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:00:27.215021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba5914-4595-4bd6-9bd7-6c873d82f4c4 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:27.237740 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba5914-4595-4bd6-9bd7-6c873d82f4c4 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:27.260867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ce6a2-f2d7-4608-9a56-ce0491c7d1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:27.261770 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ce6a2-f2d7-4608-9a56-ce0491c7d1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:27.262050 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ce6a2-f2d7-4608-9a56-ce0491c7d1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:27.262321 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ce6a2-f2d7-4608-9a56-ce0491c7d1aa admin admin] PATH_INFO: `/v3/projects/0b19d245195d4399b87fb1ad86a59a76/users/db2816a0dd844f238df075a850b12bee/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:27.272934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ce6a2-f2d7-4608-9a56-ce0491c7d1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b19d245195d4399b87fb1ad86a59a76, user_id=db2816a0dd844f238df075a850b12bee, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:27.275867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ce6a2-f2d7-4608-9a56-ce0491c7d1aa admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:27.287840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a687f7-5942-4c2d-bb43-112069ab282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:27.289107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a687f7-5942-4c2d-bb43-112069ab282f admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:27.289566 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a687f7-5942-4c2d-bb43-112069ab282f admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:27.290073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a687f7-5942-4c2d-bb43-112069ab282f admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:27.291205 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a687f7-5942-4c2d-bb43-112069ab282f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:27.296019 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a687f7-5942-4c2d-bb43-112069ab282f admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:27.305411 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 870/1778] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:27 2022] PUT /identity/v3/projects/0b19d245195d4399b87fb1ad86a59a76/users/db2816a0dd844f238df075a850b12bee/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:00:27.317006 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afd189-d5cc-48bd-9397-fa8e8c13776a None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:27.317568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afd189-d5cc-48bd-9397-fa8e8c13776a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:27.318041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afd189-d5cc-48bd-9397-fa8e8c13776a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:27.321729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 909/1779] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:00:27.323277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a687f7-5942-4c2d-bb43-112069ab282f admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:27.343442 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a687f7-5942-4c2d-bb43-112069ab282f admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:27.377125 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-18afd189-d5cc-48bd-9397-fa8e8c13776a None None] MFA Rules not processed for user `db2816a0dd844f238df075a850b12bee`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:27.386288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-18afd189-d5cc-48bd-9397-fa8e8c13776a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:27.469985 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 871/1780] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:27 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:27.482798 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afd189-d5cc-48bd-9397-fa8e8c13776a None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:27.484220 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-18afd189-d5cc-48bd-9397-fa8e8c13776a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:27.561889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645e80c-3216-439d-81ac-bd6582cbfbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:27.562593 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645e80c-3216-439d-81ac-bd6582cbfbaf admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:27.562877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645e80c-3216-439d-81ac-bd6582cbfbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:27.572852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645e80c-3216-439d-81ac-bd6582cbfbaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:27.573908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645e80c-3216-439d-81ac-bd6582cbfbaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:27.575949 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645e80c-3216-439d-81ac-bd6582cbfbaf admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:27.588595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 910/1781] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:27.593393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645e80c-3216-439d-81ac-bd6582cbfbaf admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:27.608040 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645e80c-3216-439d-81ac-bd6582cbfbaf admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:27.612549 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afd189-d5cc-48bd-9397-fa8e8c13776a None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:27.614214 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43e307-e7ac-4fb8-a667-805152150083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:27.615249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43e307-e7ac-4fb8-a667-805152150083 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:27.615636 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43e307-e7ac-4fb8-a667-805152150083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:27.616419 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43e307-e7ac-4fb8-a667-805152150083 admin admin] PATH_INFO: `/v3/projects/fdbbcb9dc6c1429c99b48eb9eea1b53f/users/0f18569abde2433690362a49b32f8cf0/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:27.624269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af390752-24d7-44d1-9783-4e5937ff4987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:27.625762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af390752-24d7-44d1-9783-4e5937ff4987 service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:27.626230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af390752-24d7-44d1-9783-4e5937ff4987 service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:27.626645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af390752-24d7-44d1-9783-4e5937ff4987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:27.649317 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af390752-24d7-44d1-9783-4e5937ff4987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:27.651294 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af390752-24d7-44d1-9783-4e5937ff4987 service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:27.660293 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43e307-e7ac-4fb8-a667-805152150083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdbbcb9dc6c1429c99b48eb9eea1b53f, user_id=0f18569abde2433690362a49b32f8cf0, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:27.664034 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43e307-e7ac-4fb8-a667-805152150083 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:27.676396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 872/1782] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:27 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:27.704409 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 911/1783] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:27 2022] PUT /identity/v3/projects/fdbbcb9dc6c1429c99b48eb9eea1b53f/users/0f18569abde2433690362a49b32f8cf0/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:27.717533 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8d814-42a0-4d8e-a14e-07f04a5ae870 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:27.717820 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8d814-42a0-4d8e-a14e-07f04a5ae870 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:27.718096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8d814-42a0-4d8e-a14e-07f04a5ae870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:27.774607 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-c1c8d814-42a0-4d8e-a14e-07f04a5ae870 None None] MFA Rules not processed for user `0f18569abde2433690362a49b32f8cf0`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:27.775844 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-c1c8d814-42a0-4d8e-a14e-07f04a5ae870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:27.817625 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43e307-e7ac-4fb8-a667-805152150083 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:27.819983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-8f43e307-e7ac-4fb8-a667-805152150083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:27.930898 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43e307-e7ac-4fb8-a667-805152150083 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:27.944000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae4f8a-8f0f-4f40-8bac-759eb8edd0ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:27.947043 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae4f8a-8f0f-4f40-8bac-759eb8edd0ff service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:27.947511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae4f8a-8f0f-4f40-8bac-759eb8edd0ff service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:27.948748 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae4f8a-8f0f-4f40-8bac-759eb8edd0ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:27.958281 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 873/1784] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:27.966296 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8d814-42a0-4d8e-a14e-07f04a5ae870 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:27.986605 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8d814-42a0-4d8e-a14e-07f04a5ae870 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:27.999013 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bea25-0b85-4e9b-9218-b3641d6a080a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:27.999783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bea25-0b85-4e9b-9218-b3641d6a080a service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:27.999783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bea25-0b85-4e9b-9218-b3641d6a080a service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:27.999998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bea25-0b85-4e9b-9218-b3641d6a080a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:28.027183 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bea25-0b85-4e9b-9218-b3641d6a080a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:28.029087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bea25-0b85-4e9b-9218-b3641d6a080a service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:28.041128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 874/1785] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:00:28.061412 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bea25-0b85-4e9b-9218-b3641d6a080a service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:28.072237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae4f8a-8f0f-4f40-8bac-759eb8edd0ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:28.074295 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae4f8a-8f0f-4f40-8bac-759eb8edd0ff service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:28.089024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 912/1786] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:27 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:00:28.193951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bea25-0b85-4e9b-9218-b3641d6a080a service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:28.233838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4a8d4-342f-4e08-9358-885db187b37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:28.236339 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4a8d4-342f-4e08-9358-885db187b37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:28.237065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4a8d4-342f-4e08-9358-885db187b37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:28.237913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4a8d4-342f-4e08-9358-885db187b37e admin admin] PATH_INFO: `/v3/users/0f18569abde2433690362a49b32f8cf0` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:28.241087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4a8d4-342f-4e08-9358-885db187b37e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f18569abde2433690362a49b32f8cf0)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:28.243248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4a8d4-342f-4e08-9358-885db187b37e admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:28.361625 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-31d4a8d4-342f-4e08-9358-885db187b37e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f18569abde2433690362a49b32f8cf0'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:28.364969 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-31d4a8d4-342f-4e08-9358-885db187b37e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f18569abde2433690362a49b32f8cf0'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:28.407932 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-31d4a8d4-342f-4e08-9358-885db187b37e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f18569abde2433690362a49b32f8cf0'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:28.429852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-31d4a8d4-342f-4e08-9358-885db187b37e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f18569abde2433690362a49b32f8cf0'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:28.430601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-31d4a8d4-342f-4e08-9358-885db187b37e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f18569abde2433690362a49b32f8cf0'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:28.458267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 875/1787] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:28 2022] DELETE /identity/v3/users/0f18569abde2433690362a49b32f8cf0 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:00:28.463217 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef434e8-e245-42d7-b87a-deeb47b94ebf None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:28.463729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef434e8-e245-42d7-b87a-deeb47b94ebf None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:28.463803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef434e8-e245-42d7-b87a-deeb47b94ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:28.498730 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-fef434e8-e245-42d7-b87a-deeb47b94ebf None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:28.501321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-fef434e8-e245-42d7-b87a-deeb47b94ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:28.632376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 913/1788] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:28.642154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4a8d4-342f-4e08-9358-885db187b37e admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:28.645132 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-31d4a8d4-342f-4e08-9358-885db187b37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:28.817969 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4a8d4-342f-4e08-9358-885db187b37e admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:28.821363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d139977-44cf-4f06-b04d-99a1711a5aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:28.822109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d139977-44cf-4f06-b04d-99a1711a5aaa service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:28.822499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d139977-44cf-4f06-b04d-99a1711a5aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:28.822881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d139977-44cf-4f06-b04d-99a1711a5aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:28.835339 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d139977-44cf-4f06-b04d-99a1711a5aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:28.836925 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d139977-44cf-4f06-b04d-99a1711a5aaa service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:28.853133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 876/1789] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:29.354902 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef434e8-e245-42d7-b87a-deeb47b94ebf None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:29.357169 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-fef434e8-e245-42d7-b87a-deeb47b94ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:29.369749 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef434e8-e245-42d7-b87a-deeb47b94ebf None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:29.395158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bfa22-795f-4108-b96e-71f259946515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:29.396157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bfa22-795f-4108-b96e-71f259946515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:29.416894 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bfa22-795f-4108-b96e-71f259946515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:29.417579 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bfa22-795f-4108-b96e-71f259946515 admin admin] PATH_INFO: `/v3/projects/fdbbcb9dc6c1429c99b48eb9eea1b53f` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:29.421333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bfa22-795f-4108-b96e-71f259946515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdbbcb9dc6c1429c99b48eb9eea1b53f)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:29.424272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bfa22-795f-4108-b96e-71f259946515 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:29.497117 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-301bfa22-795f-4108-b96e-71f259946515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdbbcb9dc6c1429c99b48eb9eea1b53f', 'request_id': 'req-301bfa22-795f-4108-b96e-71f259946515'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:29.507177 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-301bfa22-795f-4108-b96e-71f259946515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdbbcb9dc6c1429c99b48eb9eea1b53f', 'request_id': 'req-301bfa22-795f-4108-b96e-71f259946515'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:29.513284 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-301bfa22-795f-4108-b96e-71f259946515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdbbcb9dc6c1429c99b48eb9eea1b53f', 'request_id': 'req-301bfa22-795f-4108-b96e-71f259946515'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:29.526301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-301bfa22-795f-4108-b96e-71f259946515 admin admin] The token cache is being invalidate because project fdbbcb9dc6c1429c99b48eb9eea1b53f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:29.526674 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-301bfa22-795f-4108-b96e-71f259946515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:29.527453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-301bfa22-795f-4108-b96e-71f259946515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:29.529855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 914/1790] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:29 2022] DELETE /identity/v3/projects/fdbbcb9dc6c1429c99b48eb9eea1b53f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:29.535060 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace201d9-c77e-4c1e-aa92-e68ae30cd3e2 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:29.535353 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace201d9-c77e-4c1e-aa92-e68ae30cd3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:29.535627 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace201d9-c77e-4c1e-aa92-e68ae30cd3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:29.554828 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-ace201d9-c77e-4c1e-aa92-e68ae30cd3e2 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:29.556145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ace201d9-c77e-4c1e-aa92-e68ae30cd3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:29.634967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 877/1791] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:29.644084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1987dd-4c35-4e78-8c23-ed810c5a3a5d None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:29.644717 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1987dd-4c35-4e78-8c23-ed810c5a3a5d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:29.645191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1987dd-4c35-4e78-8c23-ed810c5a3a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:29.665283 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-0a1987dd-4c35-4e78-8c23-ed810c5a3a5d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:29.666630 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-0a1987dd-4c35-4e78-8c23-ed810c5a3a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:29.675059 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 915/1792] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:29.679290 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace201d9-c77e-4c1e-aa92-e68ae30cd3e2 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:29.689406 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace201d9-c77e-4c1e-aa92-e68ae30cd3e2 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:29.694701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724ad36-7603-43b4-9b0e-26ca03eb0e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:29.695366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724ad36-7603-43b4-9b0e-26ca03eb0e62 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:29.695644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724ad36-7603-43b4-9b0e-26ca03eb0e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:29.695916 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724ad36-7603-43b4-9b0e-26ca03eb0e62 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:29.696666 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724ad36-7603-43b4-9b0e-26ca03eb0e62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:00:29.696971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724ad36-7603-43b4-9b0e-26ca03eb0e62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:29.698559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724ad36-7603-43b4-9b0e-26ca03eb0e62 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:29.711708 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 878/1793] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:00:29.716346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1987dd-4c35-4e78-8c23-ed810c5a3a5d None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:29.733509 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1987dd-4c35-4e78-8c23-ed810c5a3a5d None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:29.738307 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd91d2-a482-46dd-b8d6-13e02c4c3576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:29.738968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd91d2-a482-46dd-b8d6-13e02c4c3576 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:29.739243 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd91d2-a482-46dd-b8d6-13e02c4c3576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:29.739511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd91d2-a482-46dd-b8d6-13e02c4c3576 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:29.740211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd91d2-a482-46dd-b8d6-13e02c4c3576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:29.742269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd91d2-a482-46dd-b8d6-13e02c4c3576 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:29.780005 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 916/1794] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:29 2022] POST /identity/v3/projects => generated 359 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:00:29.783946 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724ad36-7603-43b4-9b0e-26ca03eb0e62 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:29.795378 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724ad36-7603-43b4-9b0e-26ca03eb0e62 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:29.869877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d5795-6d0f-4d7a-95da-0c680d7de11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:29.870557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d5795-6d0f-4d7a-95da-0c680d7de11b admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:29.870837 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d5795-6d0f-4d7a-95da-0c680d7de11b admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:29.871110 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d5795-6d0f-4d7a-95da-0c680d7de11b admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:29.872027 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d5795-6d0f-4d7a-95da-0c680d7de11b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:29.873794 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d5795-6d0f-4d7a-95da-0c680d7de11b admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:29.895606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 879/1795] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:00:29 2022] POST /identity/v3/users => generated 280 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:00:29.900076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd91d2-a482-46dd-b8d6-13e02c4c3576 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:29.914861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd91d2-a482-46dd-b8d6-13e02c4c3576 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:29.919780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37ff63-6fc5-4d97-a2d9-5ca96b9a0f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:29.920493 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37ff63-6fc5-4d97-a2d9-5ca96b9a0f9c admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:29.920781 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37ff63-6fc5-4d97-a2d9-5ca96b9a0f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:29.921059 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37ff63-6fc5-4d97-a2d9-5ca96b9a0f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:29.921795 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37ff63-6fc5-4d97-a2d9-5ca96b9a0f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:29.923377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37ff63-6fc5-4d97-a2d9-5ca96b9a0f9c admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:29.936294 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 917/1796] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:29.940341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d5795-6d0f-4d7a-95da-0c680d7de11b admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:29.951029 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d5795-6d0f-4d7a-95da-0c680d7de11b admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:29.956308 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ba4bf-fff3-4ce6-b988-18b6719b8826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:29.956981 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ba4bf-fff3-4ce6-b988-18b6719b8826 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:29.957265 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ba4bf-fff3-4ce6-b988-18b6719b8826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:29.957540 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ba4bf-fff3-4ce6-b988-18b6719b8826 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:29.958277 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ba4bf-fff3-4ce6-b988-18b6719b8826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:29.959866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ba4bf-fff3-4ce6-b988-18b6719b8826 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:29.972474 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 880/1797] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:29.976538 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37ff63-6fc5-4d97-a2d9-5ca96b9a0f9c admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:29.986804 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37ff63-6fc5-4d97-a2d9-5ca96b9a0f9c admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:30.001998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd98670-344f-4df4-8f80-a866c8d26afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:30.002924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd98670-344f-4df4-8f80-a866c8d26afb admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:30.003204 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd98670-344f-4df4-8f80-a866c8d26afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:30.003482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd98670-344f-4df4-8f80-a866c8d26afb admin admin] PATH_INFO: `/v3/projects/6f99cf9b94c34939b4706e63e517b1b3/users/395421ede63749669a135373ce4064d2/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:30.025628 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd98670-344f-4df4-8f80-a866c8d26afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f99cf9b94c34939b4706e63e517b1b3, user_id=395421ede63749669a135373ce4064d2, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:30.028954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd98670-344f-4df4-8f80-a866c8d26afb admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:30.048384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 918/1798] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:29 2022] PUT /identity/v3/projects/6f99cf9b94c34939b4706e63e517b1b3/users/395421ede63749669a135373ce4064d2/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:30.053629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffbf13-2eb3-4147-b72c-f5b4f1d403a3 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:30.053931 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffbf13-2eb3-4147-b72c-f5b4f1d403a3 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:30.054233 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffbf13-2eb3-4147-b72c-f5b4f1d403a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:30.097279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-72ffbf13-2eb3-4147-b72c-f5b4f1d403a3 None None] MFA Rules not processed for user `395421ede63749669a135373ce4064d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:30.098489 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-72ffbf13-2eb3-4147-b72c-f5b4f1d403a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:30.172033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 881/1799] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:30 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:30.208667 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd98670-344f-4df4-8f80-a866c8d26afb admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:30.210535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cbd98670-344f-4df4-8f80-a866c8d26afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:30.281116 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd98670-344f-4df4-8f80-a866c8d26afb admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:30.284912 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdda48-7270-4c95-9031-d6084e76689b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:30.285564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdda48-7270-4c95-9031-d6084e76689b service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:30.285845 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdda48-7270-4c95-9031-d6084e76689b service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:30.286121 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdda48-7270-4c95-9031-d6084e76689b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:30.296036 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdda48-7270-4c95-9031-d6084e76689b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:30.297490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdda48-7270-4c95-9031-d6084e76689b service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:30.315774 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 919/1800] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:30 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:30.330014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffbf13-2eb3-4147-b72c-f5b4f1d403a3 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:30.461593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffbf13-2eb3-4147-b72c-f5b4f1d403a3 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:30.469582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc41c9b-b35a-44f1-bbd5-6a72214e3506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:30.470520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc41c9b-b35a-44f1-bbd5-6a72214e3506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:30.470808 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc41c9b-b35a-44f1-bbd5-6a72214e3506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:30.471083 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc41c9b-b35a-44f1-bbd5-6a72214e3506 admin admin] PATH_INFO: `/v3/users/395421ede63749669a135373ce4064d2` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:30.472792 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc41c9b-b35a-44f1-bbd5-6a72214e3506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=395421ede63749669a135373ce4064d2)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:30.475767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc41c9b-b35a-44f1-bbd5-6a72214e3506 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:30.588026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-5bc41c9b-b35a-44f1-bbd5-6a72214e3506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '395421ede63749669a135373ce4064d2'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:30.590734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-5bc41c9b-b35a-44f1-bbd5-6a72214e3506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '395421ede63749669a135373ce4064d2'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:30.619124 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-5bc41c9b-b35a-44f1-bbd5-6a72214e3506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '395421ede63749669a135373ce4064d2'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:30.644555 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-5bc41c9b-b35a-44f1-bbd5-6a72214e3506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '395421ede63749669a135373ce4064d2'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:30.645312 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-5bc41c9b-b35a-44f1-bbd5-6a72214e3506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '395421ede63749669a135373ce4064d2'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:30.681381 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 882/1801] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:30 2022] DELETE /identity/v3/users/395421ede63749669a135373ce4064d2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:30.685585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73940bce-825a-43b9-af51-ecc0ef13500a None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:30.686030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73940bce-825a-43b9-af51-ecc0ef13500a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:30.686201 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73940bce-825a-43b9-af51-ecc0ef13500a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:30.719981 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-73940bce-825a-43b9-af51-ecc0ef13500a None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:30.721232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-73940bce-825a-43b9-af51-ecc0ef13500a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:30.843845 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 920/1802] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:30.895337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8de627-6e1a-4f34-9354-dd2f4a45e2dd None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:30.895530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8de627-6e1a-4f34-9354-dd2f4a45e2dd None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:30.895809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8de627-6e1a-4f34-9354-dd2f4a45e2dd None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:30.900079 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 883/1803] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 14:00:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:00:30.915201 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777f53c-d29e-4c83-80a5-f4af4b3a4944 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:30.915676 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777f53c-d29e-4c83-80a5-f4af4b3a4944 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:30.916097 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777f53c-d29e-4c83-80a5-f4af4b3a4944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:30.940094 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8de627-6e1a-4f34-9354-dd2f4a45e2dd None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:30.942140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-eb8de627-6e1a-4f34-9354-dd2f4a45e2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:30.944770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-7777f53c-d29e-4c83-80a5-f4af4b3a4944 None None] MFA Rules not processed for user `975f10f781b94bdaa8edee39a2b1bba4`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:30.946036 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-7777f53c-d29e-4c83-80a5-f4af4b3a4944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:31.042816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 921/1804] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 14:00:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:31.068456 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8de627-6e1a-4f34-9354-dd2f4a45e2dd None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:31.073685 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f62c6a-68f6-490a-afea-da2aa7bd29d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:31.074648 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62c6a-68f6-490a-afea-da2aa7bd29d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:31.075057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62c6a-68f6-490a-afea-da2aa7bd29d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:31.075428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62c6a-68f6-490a-afea-da2aa7bd29d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:31.085753 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777f53c-d29e-4c83-80a5-f4af4b3a4944 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:31.087391 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-7777f53c-d29e-4c83-80a5-f4af4b3a4944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:31.107419 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f62c6a-68f6-490a-afea-da2aa7bd29d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:31.111067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f62c6a-68f6-490a-afea-da2aa7bd29d2 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:31.116827 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777f53c-d29e-4c83-80a5-f4af4b3a4944 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:31.146577 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547b528-11ca-43de-b914-943953ac84c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:31.147338 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b528-11ca-43de-b914-943953ac84c3 service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:31.147547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b528-11ca-43de-b914-943953ac84c3 service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:31.147827 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b528-11ca-43de-b914-943953ac84c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:31.151845 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 884/1805] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:31.158572 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547b528-11ca-43de-b914-943953ac84c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:31.160152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547b528-11ca-43de-b914-943953ac84c3 service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:31.172778 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 922/1806] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:00:31.783428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345b7b0-c70d-4b02-9d70-da240435c5bc None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:31.784354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345b7b0-c70d-4b02-9d70-da240435c5bc None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:31.784819 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345b7b0-c70d-4b02-9d70-da240435c5bc None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:31.786846 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 885/1807] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 14:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:00:31.811488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f789f-8908-42e0-940f-de38b246712d None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:31.811957 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f789f-8908-42e0-940f-de38b246712d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:31.812724 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f789f-8908-42e0-940f-de38b246712d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:31.836102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-485f789f-8908-42e0-940f-de38b246712d None None] MFA Rules not processed for user `975f10f781b94bdaa8edee39a2b1bba4`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:31.838711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-485f789f-8908-42e0-940f-de38b246712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:31.850859 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 923/1808] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 14:00:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:31.966822 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345b7b0-c70d-4b02-9d70-da240435c5bc None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:31.968901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-5345b7b0-c70d-4b02-9d70-da240435c5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:32.004084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345b7b0-c70d-4b02-9d70-da240435c5bc None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:32.011704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff490f9b-c0a0-461a-8772-7056c67122fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:32.012611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff490f9b-c0a0-461a-8772-7056c67122fc service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:32.013224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff490f9b-c0a0-461a-8772-7056c67122fc service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:32.013720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff490f9b-c0a0-461a-8772-7056c67122fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:32.026938 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff490f9b-c0a0-461a-8772-7056c67122fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:32.029038 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff490f9b-c0a0-461a-8772-7056c67122fc service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:32.055810 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 886/1809] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:32.158233 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f789f-8908-42e0-940f-de38b246712d None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:32.160421 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-485f789f-8908-42e0-940f-de38b246712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:32.178188 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f789f-8908-42e0-940f-de38b246712d None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:32.186403 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcadf88-8f69-4e38-aea4-35392cb9869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:32.187716 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcadf88-8f69-4e38-aea4-35392cb9869e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:32.188361 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcadf88-8f69-4e38-aea4-35392cb9869e admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:32.188858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcadf88-8f69-4e38-aea4-35392cb9869e admin admin] PATH_INFO: `/v3/projects/6f99cf9b94c34939b4706e63e517b1b3` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:32.192230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcadf88-8f69-4e38-aea4-35392cb9869e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f99cf9b94c34939b4706e63e517b1b3)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:32.194390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcadf88-8f69-4e38-aea4-35392cb9869e admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:32.284496 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6bcadf88-8f69-4e38-aea4-35392cb9869e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f99cf9b94c34939b4706e63e517b1b3', 'request_id': 'req-6bcadf88-8f69-4e38-aea4-35392cb9869e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:32.294133 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6bcadf88-8f69-4e38-aea4-35392cb9869e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f99cf9b94c34939b4706e63e517b1b3', 'request_id': 'req-6bcadf88-8f69-4e38-aea4-35392cb9869e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:32.300789 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6bcadf88-8f69-4e38-aea4-35392cb9869e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f99cf9b94c34939b4706e63e517b1b3', 'request_id': 'req-6bcadf88-8f69-4e38-aea4-35392cb9869e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:32.316676 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6bcadf88-8f69-4e38-aea4-35392cb9869e admin admin] The token cache is being invalidate because project 6f99cf9b94c34939b4706e63e517b1b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:32.316969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6bcadf88-8f69-4e38-aea4-35392cb9869e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:32.317991 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6bcadf88-8f69-4e38-aea4-35392cb9869e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:32.320325 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 924/1810] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:32 2022] DELETE /identity/v3/projects/6f99cf9b94c34939b4706e63e517b1b3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:32.325860 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c5309-0b79-4560-997f-2406cb47e2ad None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:32.326147 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c5309-0b79-4560-997f-2406cb47e2ad None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:32.326422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c5309-0b79-4560-997f-2406cb47e2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:32.345940 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-f38c5309-0b79-4560-997f-2406cb47e2ad None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:32.347461 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-f38c5309-0b79-4560-997f-2406cb47e2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:32.485144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 887/1811] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:00:32.492747 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b61e2-7065-4c01-8374-94dd2b4f8525 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:32.493095 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b61e2-7065-4c01-8374-94dd2b4f8525 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:32.493378 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b61e2-7065-4c01-8374-94dd2b4f8525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:32.520213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-e98b61e2-7065-4c01-8374-94dd2b4f8525 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:32.521943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e98b61e2-7065-4c01-8374-94dd2b4f8525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:32.534413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 925/1812] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:00:32.535682 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c5309-0b79-4560-997f-2406cb47e2ad None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:32.551237 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c5309-0b79-4560-997f-2406cb47e2ad None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:32.558471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca02517-1420-47f1-bc78-bf760db5f264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:32.559223 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca02517-1420-47f1-bc78-bf760db5f264 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:32.559542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca02517-1420-47f1-bc78-bf760db5f264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:32.559891 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca02517-1420-47f1-bc78-bf760db5f264 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:32.561159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca02517-1420-47f1-bc78-bf760db5f264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:00:32.561637 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca02517-1420-47f1-bc78-bf760db5f264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:32.563914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca02517-1420-47f1-bc78-bf760db5f264 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:32.580512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 888/1813] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:00:32.581699 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b61e2-7065-4c01-8374-94dd2b4f8525 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:32.591924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b61e2-7065-4c01-8374-94dd2b4f8525 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:32.597008 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1c84c-48b2-409b-9f81-317fe4dee338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:32.597691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1c84c-48b2-409b-9f81-317fe4dee338 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:32.597960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1c84c-48b2-409b-9f81-317fe4dee338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:32.598231 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1c84c-48b2-409b-9f81-317fe4dee338 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:32.598923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1c84c-48b2-409b-9f81-317fe4dee338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:32.601163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1c84c-48b2-409b-9f81-317fe4dee338 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:32.636566 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 926/1814] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:32 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:00:32.637480 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca02517-1420-47f1-bc78-bf760db5f264 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:32.647670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca02517-1420-47f1-bc78-bf760db5f264 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:32.733259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ca2ab-f3d7-47da-b3b4-6d3a09c4150b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:32.734072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ca2ab-f3d7-47da-b3b4-6d3a09c4150b admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:32.734666 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ca2ab-f3d7-47da-b3b4-6d3a09c4150b admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:32.734909 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ca2ab-f3d7-47da-b3b4-6d3a09c4150b admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:32.735875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ca2ab-f3d7-47da-b3b4-6d3a09c4150b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:32.737869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ca2ab-f3d7-47da-b3b4-6d3a09c4150b admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:32.767042 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 889/1815] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:00:32 2022] POST /identity/v3/users => generated 285 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:00:32.772149 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1c84c-48b2-409b-9f81-317fe4dee338 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:32.783781 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1c84c-48b2-409b-9f81-317fe4dee338 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:32.788495 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3aed4a-03c5-4a36-9f7b-37613bfb9194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:32.789287 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3aed4a-03c5-4a36-9f7b-37613bfb9194 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:32.789629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3aed4a-03c5-4a36-9f7b-37613bfb9194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:32.789968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3aed4a-03c5-4a36-9f7b-37613bfb9194 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:32.790762 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3aed4a-03c5-4a36-9f7b-37613bfb9194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:32.792377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3aed4a-03c5-4a36-9f7b-37613bfb9194 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:32.806874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 927/1816] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:32.807961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ca2ab-f3d7-47da-b3b4-6d3a09c4150b admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:32.818143 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ca2ab-f3d7-47da-b3b4-6d3a09c4150b admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:32.823137 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe00c0-2072-4519-9cdf-94933bc0a317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:32.823796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe00c0-2072-4519-9cdf-94933bc0a317 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:32.824074 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe00c0-2072-4519-9cdf-94933bc0a317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:32.824430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe00c0-2072-4519-9cdf-94933bc0a317 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:32.825228 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe00c0-2072-4519-9cdf-94933bc0a317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:32.826738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe00c0-2072-4519-9cdf-94933bc0a317 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:32.838813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 890/1817] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:00:32.843655 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3aed4a-03c5-4a36-9f7b-37613bfb9194 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:32.854143 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3aed4a-03c5-4a36-9f7b-37613bfb9194 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:32.868331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a73f7-cc9c-49c3-9118-b0467a89cb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:32.869237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a73f7-cc9c-49c3-9118-b0467a89cb34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:32.869521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a73f7-cc9c-49c3-9118-b0467a89cb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:32.869795 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a73f7-cc9c-49c3-9118-b0467a89cb34 admin admin] PATH_INFO: `/v3/projects/8dd585bf26b2480ca4ed8c0c0f8b0293/users/628a41b3df594a6eb1c63dc71d5aa9aa/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:32.884867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a73f7-cc9c-49c3-9118-b0467a89cb34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd585bf26b2480ca4ed8c0c0f8b0293, user_id=628a41b3df594a6eb1c63dc71d5aa9aa, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:32.888151 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a73f7-cc9c-49c3-9118-b0467a89cb34 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:32.901438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 928/1818] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:32 2022] PUT /identity/v3/projects/8dd585bf26b2480ca4ed8c0c0f8b0293/users/628a41b3df594a6eb1c63dc71d5aa9aa/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:32.913244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98b2f8-a865-4ec7-99ad-a072aaa39f72 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:32.913460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98b2f8-a865-4ec7-99ad-a072aaa39f72 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:32.913739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98b2f8-a865-4ec7-99ad-a072aaa39f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:32.939579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-1a98b2f8-a865-4ec7-99ad-a072aaa39f72 None None] MFA Rules not processed for user `628a41b3df594a6eb1c63dc71d5aa9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:32.940954 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-1a98b2f8-a865-4ec7-99ad-a072aaa39f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:33.017956 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 891/1819] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:33.031637 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a73f7-cc9c-49c3-9118-b0467a89cb34 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:33.034252 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-529a73f7-cc9c-49c3-9118-b0467a89cb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:33.149799 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a73f7-cc9c-49c3-9118-b0467a89cb34 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:33.158920 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a468e-927e-402d-97a0-88d0945ad4d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d674fd1d6ab43ab982b66bb2349b625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:33.159583 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a468e-927e-402d-97a0-88d0945ad4d9 service glance] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:33.159855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a468e-927e-402d-97a0-88d0945ad4d9 service glance] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:33.160125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a468e-927e-402d-97a0-88d0945ad4d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:33.180660 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a468e-927e-402d-97a0-88d0945ad4d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:33.182453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a468e-927e-402d-97a0-88d0945ad4d9 service glance] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:33.204132 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 929/1820] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:46.176436 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98b2f8-a865-4ec7-99ad-a072aaa39f72 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:46.178061 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-1a98b2f8-a865-4ec7-99ad-a072aaa39f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:46.255396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98b2f8-a865-4ec7-99ad-a072aaa39f72 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:46.260796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d292d4-8fc8-4341-809a-d0be234c1a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:46.262786 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d292d4-8fc8-4341-809a-d0be234c1a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:46.263334 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d292d4-8fc8-4341-809a-d0be234c1a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:46.263682 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d292d4-8fc8-4341-809a-d0be234c1a15 admin admin] PATH_INFO: `/v3/users/54ad86b044b7451cb99bcb8462de93e8` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:46.265099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d292d4-8fc8-4341-809a-d0be234c1a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ad86b044b7451cb99bcb8462de93e8)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:46.267337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d292d4-8fc8-4341-809a-d0be234c1a15 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:46.314682 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-81d292d4-8fc8-4341-809a-d0be234c1a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ad86b044b7451cb99bcb8462de93e8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:46.315336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-81d292d4-8fc8-4341-809a-d0be234c1a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ad86b044b7451cb99bcb8462de93e8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:46.327305 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-81d292d4-8fc8-4341-809a-d0be234c1a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ad86b044b7451cb99bcb8462de93e8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:46.334957 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-81d292d4-8fc8-4341-809a-d0be234c1a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ad86b044b7451cb99bcb8462de93e8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:46.335724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-81d292d4-8fc8-4341-809a-d0be234c1a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ad86b044b7451cb99bcb8462de93e8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:46.351105 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 892/1821] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:46 2022] DELETE /identity/v3/users/54ad86b044b7451cb99bcb8462de93e8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:46.356114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e670b-4a1e-4e8e-8956-44453e71aa8d None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:46.356639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e670b-4a1e-4e8e-8956-44453e71aa8d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:46.356748 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e670b-4a1e-4e8e-8956-44453e71aa8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:46.374548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-0e4e670b-4a1e-4e8e-8956-44453e71aa8d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:46.375750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-0e4e670b-4a1e-4e8e-8956-44453e71aa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:46.436589 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 930/1822] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:46.446202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d292d4-8fc8-4341-809a-d0be234c1a15 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:46.447591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-81d292d4-8fc8-4341-809a-d0be234c1a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:46.506025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d292d4-8fc8-4341-809a-d0be234c1a15 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:46.509709 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117fc80-63de-4166-9dbd-da22de7b2150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:46.510357 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117fc80-63de-4166-9dbd-da22de7b2150 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:46.510645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117fc80-63de-4166-9dbd-da22de7b2150 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:46.510923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117fc80-63de-4166-9dbd-da22de7b2150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:46.521113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117fc80-63de-4166-9dbd-da22de7b2150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:46.522629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117fc80-63de-4166-9dbd-da22de7b2150 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:46.533489 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 893/1823] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:46.869750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e670b-4a1e-4e8e-8956-44453e71aa8d None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:46.872059 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-0e4e670b-4a1e-4e8e-8956-44453e71aa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:46.885917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e670b-4a1e-4e8e-8956-44453e71aa8d None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:46.900042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aba7a-c55c-438f-9e48-f0ba5e70b978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:46.901059 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aba7a-c55c-438f-9e48-f0ba5e70b978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:46.901439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aba7a-c55c-438f-9e48-f0ba5e70b978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:46.901969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aba7a-c55c-438f-9e48-f0ba5e70b978 admin admin] PATH_INFO: `/v3/projects/12c13ecc4dde47dfb92b2877c6bb04e4` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:46.903794 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aba7a-c55c-438f-9e48-f0ba5e70b978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c13ecc4dde47dfb92b2877c6bb04e4)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:46.905555 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aba7a-c55c-438f-9e48-f0ba5e70b978 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:46.976912 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-778aba7a-c55c-438f-9e48-f0ba5e70b978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c13ecc4dde47dfb92b2877c6bb04e4', 'request_id': 'req-778aba7a-c55c-438f-9e48-f0ba5e70b978'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:46.996935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-778aba7a-c55c-438f-9e48-f0ba5e70b978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c13ecc4dde47dfb92b2877c6bb04e4', 'request_id': 'req-778aba7a-c55c-438f-9e48-f0ba5e70b978'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:47.003203 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-778aba7a-c55c-438f-9e48-f0ba5e70b978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c13ecc4dde47dfb92b2877c6bb04e4', 'request_id': 'req-778aba7a-c55c-438f-9e48-f0ba5e70b978'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:47.023894 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-778aba7a-c55c-438f-9e48-f0ba5e70b978 admin admin] The token cache is being invalidate because project 12c13ecc4dde47dfb92b2877c6bb04e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:47.024741 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-778aba7a-c55c-438f-9e48-f0ba5e70b978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:47.026378 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-778aba7a-c55c-438f-9e48-f0ba5e70b978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:47.028708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 931/1824] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:46 2022] DELETE /identity/v3/projects/12c13ecc4dde47dfb92b2877c6bb04e4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:47.032938 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117fc80-63de-4166-9dbd-da22de7b2150 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:47.052905 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117fc80-63de-4166-9dbd-da22de7b2150 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:47.150528 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ffffe-bbbc-452c-9336-f387eb87125e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:47.156544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ffffe-bbbc-452c-9336-f387eb87125e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:47.157104 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ffffe-bbbc-452c-9336-f387eb87125e admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:47.157586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ffffe-bbbc-452c-9336-f387eb87125e admin admin] PATH_INFO: `/v3/users/db2816a0dd844f238df075a850b12bee` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:47.160325 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ffffe-bbbc-452c-9336-f387eb87125e admin admin] RBAC: Authorizing `identity:delete_user(user_id=db2816a0dd844f238df075a850b12bee)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:47.163813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ffffe-bbbc-452c-9336-f387eb87125e admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:47.259696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b25ffffe-bbbc-452c-9336-f387eb87125e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db2816a0dd844f238df075a850b12bee'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:47.261354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b25ffffe-bbbc-452c-9336-f387eb87125e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db2816a0dd844f238df075a850b12bee'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:47.303035 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b25ffffe-bbbc-452c-9336-f387eb87125e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db2816a0dd844f238df075a850b12bee'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:47.317421 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b25ffffe-bbbc-452c-9336-f387eb87125e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db2816a0dd844f238df075a850b12bee'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:47.318478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b25ffffe-bbbc-452c-9336-f387eb87125e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db2816a0dd844f238df075a850b12bee'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:47.348288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 894/1825] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:47 2022] DELETE /identity/v3/users/db2816a0dd844f238df075a850b12bee => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:47.807575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aba7a-c55c-438f-9e48-f0ba5e70b978 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:47.810797 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-778aba7a-c55c-438f-9e48-f0ba5e70b978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:47.842180 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aba7a-c55c-438f-9e48-f0ba5e70b978 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:47.922767 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb47ee-ad02-4234-b581-9dab5cab381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:47.924039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb47ee-ad02-4234-b581-9dab5cab381e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:47.924398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb47ee-ad02-4234-b581-9dab5cab381e admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:47.924834 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb47ee-ad02-4234-b581-9dab5cab381e admin admin] PATH_INFO: `/v3/projects/0b19d245195d4399b87fb1ad86a59a76` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:47.926120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb47ee-ad02-4234-b581-9dab5cab381e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b19d245195d4399b87fb1ad86a59a76)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:47.928029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb47ee-ad02-4234-b581-9dab5cab381e admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:47.975742 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-13fb47ee-ad02-4234-b581-9dab5cab381e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b19d245195d4399b87fb1ad86a59a76', 'request_id': 'req-13fb47ee-ad02-4234-b581-9dab5cab381e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:47.985189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-13fb47ee-ad02-4234-b581-9dab5cab381e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b19d245195d4399b87fb1ad86a59a76', 'request_id': 'req-13fb47ee-ad02-4234-b581-9dab5cab381e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:47.993560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-13fb47ee-ad02-4234-b581-9dab5cab381e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b19d245195d4399b87fb1ad86a59a76', 'request_id': 'req-13fb47ee-ad02-4234-b581-9dab5cab381e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:48.006350 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-13fb47ee-ad02-4234-b581-9dab5cab381e admin admin] The token cache is being invalidate because project 0b19d245195d4399b87fb1ad86a59a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:48.006709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-13fb47ee-ad02-4234-b581-9dab5cab381e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:48.007343 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-13fb47ee-ad02-4234-b581-9dab5cab381e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:48.009170 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 932/1826] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:47 2022] DELETE /identity/v3/projects/0b19d245195d4399b87fb1ad86a59a76 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:48.017745 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6a660-5550-4f70-8817-ed1dfdacb950 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:48.018269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6a660-5550-4f70-8817-ed1dfdacb950 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:48.018583 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6a660-5550-4f70-8817-ed1dfdacb950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:48.041763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-bca6a660-5550-4f70-8817-ed1dfdacb950 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:48.043082 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-bca6a660-5550-4f70-8817-ed1dfdacb950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:48.103801 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 895/1827] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:48.111753 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed5e57-8e75-44c1-bbaa-c367f7cffeb1 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:48.112039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed5e57-8e75-44c1-bbaa-c367f7cffeb1 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:48.112377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed5e57-8e75-44c1-bbaa-c367f7cffeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:48.131218 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-4aed5e57-8e75-44c1-bbaa-c367f7cffeb1 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:48.132636 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-4aed5e57-8e75-44c1-bbaa-c367f7cffeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:48.141636 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 933/1828] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:48.145902 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6a660-5550-4f70-8817-ed1dfdacb950 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:48.156618 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6a660-5550-4f70-8817-ed1dfdacb950 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:48.161203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc3aee-b188-4232-aceb-ee2304685a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:48.161853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc3aee-b188-4232-aceb-ee2304685a82 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:48.162133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc3aee-b188-4232-aceb-ee2304685a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:48.162408 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc3aee-b188-4232-aceb-ee2304685a82 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:48.163127 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc3aee-b188-4232-aceb-ee2304685a82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:00:48.163434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc3aee-b188-4232-aceb-ee2304685a82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:48.165079 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc3aee-b188-4232-aceb-ee2304685a82 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:48.180067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 896/1829] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:00:48.181496 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed5e57-8e75-44c1-bbaa-c367f7cffeb1 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:48.190711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed5e57-8e75-44c1-bbaa-c367f7cffeb1 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:48.195405 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f19af7-800f-40bc-b859-5ae6b26013ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:48.196111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f19af7-800f-40bc-b859-5ae6b26013ae admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:48.198082 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f19af7-800f-40bc-b859-5ae6b26013ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:48.198366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f19af7-800f-40bc-b859-5ae6b26013ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:48.204319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f19af7-800f-40bc-b859-5ae6b26013ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:48.206516 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f19af7-800f-40bc-b859-5ae6b26013ae admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:48.237489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 934/1830] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:48 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:00:48.238587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc3aee-b188-4232-aceb-ee2304685a82 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:48.249715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc3aee-b188-4232-aceb-ee2304685a82 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:48.312007 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab0689-33ee-4fa7-9c32-fdff7ea95c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:48.312737 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab0689-33ee-4fa7-9c32-fdff7ea95c6e admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:48.312987 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab0689-33ee-4fa7-9c32-fdff7ea95c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:48.313261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab0689-33ee-4fa7-9c32-fdff7ea95c6e admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:48.314001 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab0689-33ee-4fa7-9c32-fdff7ea95c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:48.315956 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab0689-33ee-4fa7-9c32-fdff7ea95c6e admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:48.340483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 897/1831] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:00:48 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:48.341795 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f19af7-800f-40bc-b859-5ae6b26013ae admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:48.352295 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f19af7-800f-40bc-b859-5ae6b26013ae admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:48.357254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b8775-e3b5-43a5-a85c-04dbcd19b18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:48.357868 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b8775-e3b5-43a5-a85c-04dbcd19b18d admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:48.358127 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b8775-e3b5-43a5-a85c-04dbcd19b18d admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:48.358402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b8775-e3b5-43a5-a85c-04dbcd19b18d admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:48.359201 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b8775-e3b5-43a5-a85c-04dbcd19b18d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:48.360932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b8775-e3b5-43a5-a85c-04dbcd19b18d admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:48.375561 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 935/1832] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:48.377065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab0689-33ee-4fa7-9c32-fdff7ea95c6e admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:48.387686 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab0689-33ee-4fa7-9c32-fdff7ea95c6e admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:48.396300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359bf7d-17dd-403b-8a10-1d97a6905165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:48.396905 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359bf7d-17dd-403b-8a10-1d97a6905165 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:48.397191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359bf7d-17dd-403b-8a10-1d97a6905165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:48.397466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359bf7d-17dd-403b-8a10-1d97a6905165 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:48.398622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359bf7d-17dd-403b-8a10-1d97a6905165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:48.400271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359bf7d-17dd-403b-8a10-1d97a6905165 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:48.412825 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 898/1833] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:48.416818 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b8775-e3b5-43a5-a85c-04dbcd19b18d admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:48.426808 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b8775-e3b5-43a5-a85c-04dbcd19b18d admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:48.441045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a187a3-811e-44d8-865e-d6c40a7ea731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:48.443099 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a187a3-811e-44d8-865e-d6c40a7ea731 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:48.443563 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a187a3-811e-44d8-865e-d6c40a7ea731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:48.452354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a187a3-811e-44d8-865e-d6c40a7ea731 admin admin] PATH_INFO: `/v3/projects/2a5ee79f24684691bedc6b6a3924c7ec/users/83f69515f35d4f5f86e76b2c9834988a/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:48.464217 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a187a3-811e-44d8-865e-d6c40a7ea731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5ee79f24684691bedc6b6a3924c7ec, user_id=83f69515f35d4f5f86e76b2c9834988a, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:48.467314 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a187a3-811e-44d8-865e-d6c40a7ea731 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:48.487158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 936/1834] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:48 2022] PUT /identity/v3/projects/2a5ee79f24684691bedc6b6a3924c7ec/users/83f69515f35d4f5f86e76b2c9834988a/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:00:48.500055 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d1a98-99eb-4c81-9277-6e3a934d15e3 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:48.500370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d1a98-99eb-4c81-9277-6e3a934d15e3 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:48.500849 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d1a98-99eb-4c81-9277-6e3a934d15e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:48.685508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-738d1a98-99eb-4c81-9277-6e3a934d15e3 None None] MFA Rules not processed for user `83f69515f35d4f5f86e76b2c9834988a`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:48.686947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-738d1a98-99eb-4c81-9277-6e3a934d15e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:48.856025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 899/1835] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:48.858226 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a187a3-811e-44d8-865e-d6c40a7ea731 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:48.949695 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a187a3-811e-44d8-865e-d6c40a7ea731 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:48.955315 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6325afb-e613-486e-8f26-b5d272c0e479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:48.956550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6325afb-e613-486e-8f26-b5d272c0e479 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:48.956990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6325afb-e613-486e-8f26-b5d272c0e479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:48.957450 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6325afb-e613-486e-8f26-b5d272c0e479 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:48.958306 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6325afb-e613-486e-8f26-b5d272c0e479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:48.963380 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6325afb-e613-486e-8f26-b5d272c0e479 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:49.014586 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 937/1836] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:48 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:00:49.018645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d1a98-99eb-4c81-9277-6e3a934d15e3 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:49.031541 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d1a98-99eb-4c81-9277-6e3a934d15e3 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:49.109490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143947c-1a99-484c-a212-361e65e9f44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:49.110164 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143947c-1a99-484c-a212-361e65e9f44f admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:49.110442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143947c-1a99-484c-a212-361e65e9f44f admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:49.110773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143947c-1a99-484c-a212-361e65e9f44f admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:49.111471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143947c-1a99-484c-a212-361e65e9f44f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:49.113418 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143947c-1a99-484c-a212-361e65e9f44f admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:49.135847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 900/1837] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:00:49 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:49.139801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6325afb-e613-486e-8f26-b5d272c0e479 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:49.154027 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143947c-1a99-484c-a212-361e65e9f44f admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:49.154379 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6325afb-e613-486e-8f26-b5d272c0e479 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:49.155895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-f143947c-1a99-484c-a212-361e65e9f44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:49.160109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29860d-bad5-4bbb-bf6f-e0b9a5806f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:49.160816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29860d-bad5-4bbb-bf6f-e0b9a5806f5e admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:49.161100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29860d-bad5-4bbb-bf6f-e0b9a5806f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:49.161371 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29860d-bad5-4bbb-bf6f-e0b9a5806f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:49.162109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29860d-bad5-4bbb-bf6f-e0b9a5806f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:49.163693 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29860d-bad5-4bbb-bf6f-e0b9a5806f5e admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:49.167633 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143947c-1a99-484c-a212-361e65e9f44f admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:49.176582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865e0bd-222b-44e9-9870-c207165517c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:49.179933 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 938/1838] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:49.180252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865e0bd-222b-44e9-9870-c207165517c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:49.180252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865e0bd-222b-44e9-9870-c207165517c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:49.180252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865e0bd-222b-44e9-9870-c207165517c3 admin admin] PATH_INFO: `/v3/users/0b70fc14fe11472c8d93087eff6f5421` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:49.180252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865e0bd-222b-44e9-9870-c207165517c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b70fc14fe11472c8d93087eff6f5421)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:49.181221 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29860d-bad5-4bbb-bf6f-e0b9a5806f5e admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:49.181740 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865e0bd-222b-44e9-9870-c207165517c3 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:49.194319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29860d-bad5-4bbb-bf6f-e0b9a5806f5e admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:49.199732 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300a39f-495e-46d9-bc7c-4754756f79cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:49.200850 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300a39f-495e-46d9-bc7c-4754756f79cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:49.201126 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300a39f-495e-46d9-bc7c-4754756f79cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:49.201496 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300a39f-495e-46d9-bc7c-4754756f79cd admin admin] PATH_INFO: `/v3/projects/1365d85cd3c74212b9af26cf1013320d/users/1b075e98d9744897a2cd45dcd5d34788/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:49.218484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300a39f-495e-46d9-bc7c-4754756f79cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1365d85cd3c74212b9af26cf1013320d, user_id=1b075e98d9744897a2cd45dcd5d34788, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:49.221270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300a39f-495e-46d9-bc7c-4754756f79cd admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:49.227498 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-f865e0bd-222b-44e9-9870-c207165517c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b70fc14fe11472c8d93087eff6f5421'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:49.228154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-f865e0bd-222b-44e9-9870-c207165517c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b70fc14fe11472c8d93087eff6f5421'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:49.233891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 939/1839] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:49 2022] PUT /identity/v3/projects/1365d85cd3c74212b9af26cf1013320d/users/1b075e98d9744897a2cd45dcd5d34788/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:00:49.240041 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300a39f-495e-46d9-bc7c-4754756f79cd admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:49.244261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-f865e0bd-222b-44e9-9870-c207165517c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b70fc14fe11472c8d93087eff6f5421'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:49.251858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-f865e0bd-222b-44e9-9870-c207165517c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b70fc14fe11472c8d93087eff6f5421'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:49.253139 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-f865e0bd-222b-44e9-9870-c207165517c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b70fc14fe11472c8d93087eff6f5421'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:49.265076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 901/1840] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:49 2022] DELETE /identity/v3/users/0b70fc14fe11472c8d93087eff6f5421 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:00:49.269508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f73bcb-3aff-4529-88ed-b7735ac4658f None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:49.269799 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f73bcb-3aff-4529-88ed-b7735ac4658f None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:49.270088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f73bcb-3aff-4529-88ed-b7735ac4658f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:49.288639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-c3f73bcb-3aff-4529-88ed-b7735ac4658f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:49.290058 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-c3f73bcb-3aff-4529-88ed-b7735ac4658f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:49.302111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300a39f-495e-46d9-bc7c-4754756f79cd admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:49.351423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 902/1841] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:49.357191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d508a4-bbf6-4947-ac8c-444288ba9d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:49.357865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d508a4-bbf6-4947-ac8c-444288ba9d36 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:49.358144 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d508a4-bbf6-4947-ac8c-444288ba9d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:49.358420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d508a4-bbf6-4947-ac8c-444288ba9d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:49.359178 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d508a4-bbf6-4947-ac8c-444288ba9d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:49.360797 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d508a4-bbf6-4947-ac8c-444288ba9d36 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:49.360910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f73bcb-3aff-4529-88ed-b7735ac4658f None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:49.362133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-c3f73bcb-3aff-4529-88ed-b7735ac4658f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:49.370983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 940/1842] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:00:49.374956 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d508a4-bbf6-4947-ac8c-444288ba9d36 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:49.376681 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-22d508a4-bbf6-4947-ac8c-444288ba9d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:49.396454 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d508a4-bbf6-4947-ac8c-444288ba9d36 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:49.401834 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506c100-8d3d-4362-a409-2329f015c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:49.403323 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506c100-8d3d-4362-a409-2329f015c99e admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:49.404034 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506c100-8d3d-4362-a409-2329f015c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:49.404347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506c100-8d3d-4362-a409-2329f015c99e admin admin] PATH_INFO: `/v3/projects/1365d85cd3c74212b9af26cf1013320d/users/1b075e98d9744897a2cd45dcd5d34788/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:49.406694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506c100-8d3d-4362-a409-2329f015c99e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1365d85cd3c74212b9af26cf1013320d, user_id=1b075e98d9744897a2cd45dcd5d34788, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:49.409374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506c100-8d3d-4362-a409-2329f015c99e admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:49.419969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 941/1843] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:49 2022] PUT /identity/v3/projects/1365d85cd3c74212b9af26cf1013320d/users/1b075e98d9744897a2cd45dcd5d34788/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:00:49.430114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87710b25-9904-4b09-8575-d01cb0a56de4 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:49.430400 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87710b25-9904-4b09-8575-d01cb0a56de4 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:49.430680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87710b25-9904-4b09-8575-d01cb0a56de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:49.439521 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f73bcb-3aff-4529-88ed-b7735ac4658f None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:49.459899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-87710b25-9904-4b09-8575-d01cb0a56de4 None None] MFA Rules not processed for user `1b075e98d9744897a2cd45dcd5d34788`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:49.461523 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-87710b25-9904-4b09-8575-d01cb0a56de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:49.512599 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae07319-ca6e-4b8b-b688-2f518454228b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:49.513253 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae07319-ca6e-4b8b-b688-2f518454228b service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:49.513531 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae07319-ca6e-4b8b-b688-2f518454228b service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:49.513803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae07319-ca6e-4b8b-b688-2f518454228b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:49.546861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 942/1844] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:00:49.561381 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87710b25-9904-4b09-8575-d01cb0a56de4 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:49.562957 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-87710b25-9904-4b09-8575-d01cb0a56de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:49.586580 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae07319-ca6e-4b8b-b688-2f518454228b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:49.588102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae07319-ca6e-4b8b-b688-2f518454228b service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:49.597391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 903/1845] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:00:49.625839 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87710b25-9904-4b09-8575-d01cb0a56de4 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:49.629524 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9e98f-48ce-4992-a2e6-2a13bcce5336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:49.630117 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9e98f-48ce-4992-a2e6-2a13bcce5336 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:49.630401 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9e98f-48ce-4992-a2e6-2a13bcce5336 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:49.630672 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9e98f-48ce-4992-a2e6-2a13bcce5336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:49.639744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9e98f-48ce-4992-a2e6-2a13bcce5336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:49.641211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9e98f-48ce-4992-a2e6-2a13bcce5336 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:49.650953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 943/1846] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:49.952225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae07319-ca6e-4b8b-b688-2f518454228b service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:49.952225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-1ae07319-ca6e-4b8b-b688-2f518454228b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:49.963423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae07319-ca6e-4b8b-b688-2f518454228b service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:49.968929 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e52978-4bc1-455c-a79a-9966566aba4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:49.969688 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e52978-4bc1-455c-a79a-9966566aba4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:49.970323 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e52978-4bc1-455c-a79a-9966566aba4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:49.970724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e52978-4bc1-455c-a79a-9966566aba4c admin admin] PATH_INFO: `/v3/projects/5bd83f5761ed4240920a9920b801f599` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:49.972428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e52978-4bc1-455c-a79a-9966566aba4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd83f5761ed4240920a9920b801f599)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:49.973967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e52978-4bc1-455c-a79a-9966566aba4c admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:50.001917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9e98f-48ce-4992-a2e6-2a13bcce5336 service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:50.013400 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9e98f-48ce-4992-a2e6-2a13bcce5336 service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:50.019247 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6582f2-f4d3-4a8a-9c50-3e1c5c69dc2e tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b075e98d9744897a2cd45dcd5d34788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1365d85cd3c74212b9af26cf1013320d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:50.019906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6582f2-f4d3-4a8a-9c50-3e1c5c69dc2e tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:50.020390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6582f2-f4d3-4a8a-9c50-3e1c5c69dc2e tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:50.020828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6582f2-f4d3-4a8a-9c50-3e1c5c69dc2e tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:50.021691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6582f2-f4d3-4a8a-9c50-3e1c5c69dc2e tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:00:50.022007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6582f2-f4d3-4a8a-9c50-3e1c5c69dc2e tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:50.028431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6582f2-f4d3-4a8a-9c50-3e1c5c69dc2e tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:50.036249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 944/1847] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:00:50.042285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6582f2-f4d3-4a8a-9c50-3e1c5c69dc2e tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:50.046796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-86e52978-4bc1-455c-a79a-9966566aba4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd83f5761ed4240920a9920b801f599', 'request_id': 'req-86e52978-4bc1-455c-a79a-9966566aba4c'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.052211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-86e52978-4bc1-455c-a79a-9966566aba4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd83f5761ed4240920a9920b801f599', 'request_id': 'req-86e52978-4bc1-455c-a79a-9966566aba4c'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.052771 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6582f2-f4d3-4a8a-9c50-3e1c5c69dc2e tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:50.058145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-86e52978-4bc1-455c-a79a-9966566aba4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd83f5761ed4240920a9920b801f599', 'request_id': 'req-86e52978-4bc1-455c-a79a-9966566aba4c'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.071651 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-86e52978-4bc1-455c-a79a-9966566aba4c admin admin] The token cache is being invalidate because project 5bd83f5761ed4240920a9920b801f599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:50.071982 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-86e52978-4bc1-455c-a79a-9966566aba4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.072676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-86e52978-4bc1-455c-a79a-9966566aba4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.074851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 904/1848] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:49 2022] DELETE /identity/v3/projects/5bd83f5761ed4240920a9920b801f599 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:50.078702 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e52978-4bc1-455c-a79a-9966566aba4c admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:50.080162 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-86e52978-4bc1-455c-a79a-9966566aba4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:50.113526 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cab260-e606-4b03-9554-6149b120dad3 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b075e98d9744897a2cd45dcd5d34788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1365d85cd3c74212b9af26cf1013320d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:50.114210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cab260-e606-4b03-9554-6149b120dad3 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:50.114492 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cab260-e606-4b03-9554-6149b120dad3 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:50.114763 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cab260-e606-4b03-9554-6149b120dad3 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:50.115487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cab260-e606-4b03-9554-6149b120dad3 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:50.117430 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cab260-e606-4b03-9554-6149b120dad3 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:50.146131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 945/1849] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:50 2022] POST /identity/v3/projects => generated 355 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:00:50.151309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cab260-e606-4b03-9554-6149b120dad3 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:50.153564 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e52978-4bc1-455c-a79a-9966566aba4c admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:50.154731 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-91cab260-e606-4b03-9554-6149b120dad3 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:50.215179 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc8d0b-4921-4f4b-9bfd-9779000b959a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:50.216385 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc8d0b-4921-4f4b-9bfd-9779000b959a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:50.216662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc8d0b-4921-4f4b-9bfd-9779000b959a admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:50.216929 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc8d0b-4921-4f4b-9bfd-9779000b959a admin admin] PATH_INFO: `/v3/users/3bddb6368f364de4b407fdfaf0905088` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:50.218147 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc8d0b-4921-4f4b-9bfd-9779000b959a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bddb6368f364de4b407fdfaf0905088)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:50.220138 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc8d0b-4921-4f4b-9bfd-9779000b959a admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:50.233551 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cab260-e606-4b03-9554-6149b120dad3 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:50.238792 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784c428-3690-4c35-9cc2-1feccc6564e6 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b075e98d9744897a2cd45dcd5d34788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1365d85cd3c74212b9af26cf1013320d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:50.239463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784c428-3690-4c35-9cc2-1feccc6564e6 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:50.239752 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784c428-3690-4c35-9cc2-1feccc6564e6 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:50.240062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784c428-3690-4c35-9cc2-1feccc6564e6 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:50.240821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784c428-3690-4c35-9cc2-1feccc6564e6 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:00:50.241135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784c428-3690-4c35-9cc2-1feccc6564e6 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:50.242968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784c428-3690-4c35-9cc2-1feccc6564e6 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:50.258377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 946/1850] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:00:50.277585 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cdbc8d0b-4921-4f4b-9bfd-9779000b959a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bddb6368f364de4b407fdfaf0905088'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.278601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cdbc8d0b-4921-4f4b-9bfd-9779000b959a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bddb6368f364de4b407fdfaf0905088'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.300508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cdbc8d0b-4921-4f4b-9bfd-9779000b959a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bddb6368f364de4b407fdfaf0905088'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.305847 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784c428-3690-4c35-9cc2-1feccc6564e6 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:50.311069 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cdbc8d0b-4921-4f4b-9bfd-9779000b959a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bddb6368f364de4b407fdfaf0905088'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.311931 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cdbc8d0b-4921-4f4b-9bfd-9779000b959a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bddb6368f364de4b407fdfaf0905088'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.320862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784c428-3690-4c35-9cc2-1feccc6564e6 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:50.326548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125e8cc-b034-4289-9e91-4d856622af58 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b075e98d9744897a2cd45dcd5d34788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1365d85cd3c74212b9af26cf1013320d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:50.327830 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 905/1851] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:50 2022] DELETE /identity/v3/users/3bddb6368f364de4b407fdfaf0905088 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:50.328027 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125e8cc-b034-4289-9e91-4d856622af58 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:50.330775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125e8cc-b034-4289-9e91-4d856622af58 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:50.331171 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125e8cc-b034-4289-9e91-4d856622af58 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] PATH_INFO: `/v3/projects/180b50c39f3148a191a9805c8c83c886` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:50.333025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125e8cc-b034-4289-9e91-4d856622af58 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] RBAC: Authorizing `identity:delete_project(project_id=180b50c39f3148a191a9805c8c83c886)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:50.335151 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125e8cc-b034-4289-9e91-4d856622af58 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:50.405338 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b125e8cc-b034-4289-9e91-4d856622af58 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '180b50c39f3148a191a9805c8c83c886', 'request_id': 'req-b125e8cc-b034-4289-9e91-4d856622af58'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.418187 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b125e8cc-b034-4289-9e91-4d856622af58 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '180b50c39f3148a191a9805c8c83c886', 'request_id': 'req-b125e8cc-b034-4289-9e91-4d856622af58'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.424535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b125e8cc-b034-4289-9e91-4d856622af58 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '180b50c39f3148a191a9805c8c83c886', 'request_id': 'req-b125e8cc-b034-4289-9e91-4d856622af58'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.437894 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b125e8cc-b034-4289-9e91-4d856622af58 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] The token cache is being invalidate because project 180b50c39f3148a191a9805c8c83c886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:50.438180 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b125e8cc-b034-4289-9e91-4d856622af58 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.438857 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b125e8cc-b034-4289-9e91-4d856622af58 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.440708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 947/1852] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:50 2022] DELETE /identity/v3/projects/180b50c39f3148a191a9805c8c83c886 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:00:50.686079 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc8d0b-4921-4f4b-9bfd-9779000b959a admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:50.687920 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-cdbc8d0b-4921-4f4b-9bfd-9779000b959a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:50.718907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125e8cc-b034-4289-9e91-4d856622af58 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:50.721673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b125e8cc-b034-4289-9e91-4d856622af58 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:50.838683 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc8d0b-4921-4f4b-9bfd-9779000b959a admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:50.854598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125e8cc-b034-4289-9e91-4d856622af58 tempest-VolumeQuotaClassesTest-1880241414 tempest-VolumeQuotaClassesTest-1880241414-project-admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:50.862759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52b8b-2ac7-4681-88e2-974a56d6d606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:50.863441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52b8b-2ac7-4681-88e2-974a56d6d606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:50.863670 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52b8b-2ac7-4681-88e2-974a56d6d606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:50.863940 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52b8b-2ac7-4681-88e2-974a56d6d606 admin admin] PATH_INFO: `/v3/projects/b2985173de3a420aa722b138eb6c5d73` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:50.865195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff52b8b-2ac7-4681-88e2-974a56d6d606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2985173de3a420aa722b138eb6c5d73)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:50.867646 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff52b8b-2ac7-4681-88e2-974a56d6d606 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:50.929894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ca31c-ab11-43d4-978e-149974d4a5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:50.930783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ca31c-ab11-43d4-978e-149974d4a5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:50.931127 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ca31c-ab11-43d4-978e-149974d4a5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:50.936188 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ca31c-ab11-43d4-978e-149974d4a5e9 admin admin] PATH_INFO: `/v3/users/83f69515f35d4f5f86e76b2c9834988a` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:50.937712 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ca31c-ab11-43d4-978e-149974d4a5e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f69515f35d4f5f86e76b2c9834988a)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:50.939955 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ca31c-ab11-43d4-978e-149974d4a5e9 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:50.943339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9ff52b8b-2ac7-4681-88e2-974a56d6d606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2985173de3a420aa722b138eb6c5d73', 'request_id': 'req-9ff52b8b-2ac7-4681-88e2-974a56d6d606'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.953742 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9ff52b8b-2ac7-4681-88e2-974a56d6d606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2985173de3a420aa722b138eb6c5d73', 'request_id': 'req-9ff52b8b-2ac7-4681-88e2-974a56d6d606'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.963025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9ff52b8b-2ac7-4681-88e2-974a56d6d606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2985173de3a420aa722b138eb6c5d73', 'request_id': 'req-9ff52b8b-2ac7-4681-88e2-974a56d6d606'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.979975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9ff52b8b-2ac7-4681-88e2-974a56d6d606 admin admin] The token cache is being invalidate because project b2985173de3a420aa722b138eb6c5d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:50.980630 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9ff52b8b-2ac7-4681-88e2-974a56d6d606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.981707 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9ff52b8b-2ac7-4681-88e2-974a56d6d606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:50.998059 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 948/1853] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:50 2022] DELETE /identity/v3/projects/b2985173de3a420aa722b138eb6c5d73 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:00:51.005066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62712541-f6ca-4046-b336-a149be75d33e None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:51.005783 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62712541-f6ca-4046-b336-a149be75d33e None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:51.005783 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62712541-f6ca-4046-b336-a149be75d33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:51.031064 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-62712541-f6ca-4046-b336-a149be75d33e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:51.032480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-62712541-f6ca-4046-b336-a149be75d33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:51.046404 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-480ca31c-ab11-43d4-978e-149974d4a5e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f69515f35d4f5f86e76b2c9834988a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:51.047483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-480ca31c-ab11-43d4-978e-149974d4a5e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f69515f35d4f5f86e76b2c9834988a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:51.076234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-480ca31c-ab11-43d4-978e-149974d4a5e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f69515f35d4f5f86e76b2c9834988a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:51.087729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-480ca31c-ab11-43d4-978e-149974d4a5e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f69515f35d4f5f86e76b2c9834988a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:51.088876 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-480ca31c-ab11-43d4-978e-149974d4a5e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f69515f35d4f5f86e76b2c9834988a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:51.109452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 906/1854] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:50 2022] DELETE /identity/v3/users/83f69515f35d4f5f86e76b2c9834988a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:51.122407 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ba7fa-df5d-4dad-aa5e-747af1de6718 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:51.122407 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ba7fa-df5d-4dad-aa5e-747af1de6718 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:51.122407 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ba7fa-df5d-4dad-aa5e-747af1de6718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:51.154423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-0c4ba7fa-df5d-4dad-aa5e-747af1de6718 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:51.155654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0c4ba7fa-df5d-4dad-aa5e-747af1de6718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:51.157083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 949/1855] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:51.166896 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72f75-0614-4273-a4fb-419edfe260b5 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:51.167187 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72f75-0614-4273-a4fb-419edfe260b5 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:51.167464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72f75-0614-4273-a4fb-419edfe260b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:51.194950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-ddb72f75-0614-4273-a4fb-419edfe260b5 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:51.196577 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ddb72f75-0614-4273-a4fb-419edfe260b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:51.238369 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 907/1856] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:51.249774 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ba7fa-df5d-4dad-aa5e-747af1de6718 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:51.251334 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0c4ba7fa-df5d-4dad-aa5e-747af1de6718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:51.278161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 950/1857] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:51.280609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb72f75-0614-4273-a4fb-419edfe260b5 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:51.289900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb72f75-0614-4273-a4fb-419edfe260b5 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:51.294748 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171d5e8-e874-41a2-b4b9-8142601f79af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:51.295410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171d5e8-e874-41a2-b4b9-8142601f79af admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:51.295688 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171d5e8-e874-41a2-b4b9-8142601f79af admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:51.295988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171d5e8-e874-41a2-b4b9-8142601f79af admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:51.296748 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171d5e8-e874-41a2-b4b9-8142601f79af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:00:51.297051 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171d5e8-e874-41a2-b4b9-8142601f79af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:51.299070 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171d5e8-e874-41a2-b4b9-8142601f79af admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:51.313119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 951/1858] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:00:51.317506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171d5e8-e874-41a2-b4b9-8142601f79af admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:51.321063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ba7fa-df5d-4dad-aa5e-747af1de6718 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:51.326925 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149e8af-502a-4741-82c9-0ee910e1252e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:51.327605 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149e8af-502a-4741-82c9-0ee910e1252e service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:51.327881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149e8af-502a-4741-82c9-0ee910e1252e service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:51.328159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149e8af-502a-4741-82c9-0ee910e1252e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:51.328458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171d5e8-e874-41a2-b4b9-8142601f79af admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:51.333349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e2310-b470-4b59-90c6-b8d8aa23f974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:51.333985 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e2310-b470-4b59-90c6-b8d8aa23f974 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:51.334272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e2310-b470-4b59-90c6-b8d8aa23f974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:51.334536 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e2310-b470-4b59-90c6-b8d8aa23f974 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:51.335249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e2310-b470-4b59-90c6-b8d8aa23f974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:51.337263 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e2310-b470-4b59-90c6-b8d8aa23f974 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:51.337904 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149e8af-502a-4741-82c9-0ee910e1252e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:51.339582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149e8af-502a-4741-82c9-0ee910e1252e service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:51.351473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 908/1859] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:51.364222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 952/1860] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:51 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:00:51.368232 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149e8af-502a-4741-82c9-0ee910e1252e service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:51.378397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149e8af-502a-4741-82c9-0ee910e1252e service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:51.441440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db9d79-ab6e-4366-b8c4-b91e79a33920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:51.442122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db9d79-ab6e-4366-b8c4-b91e79a33920 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:51.442403 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db9d79-ab6e-4366-b8c4-b91e79a33920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:51.442676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db9d79-ab6e-4366-b8c4-b91e79a33920 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:51.443381 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db9d79-ab6e-4366-b8c4-b91e79a33920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:51.445324 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db9d79-ab6e-4366-b8c4-b91e79a33920 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:51.483427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 909/1861] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:00:51 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:51.488654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e2310-b470-4b59-90c6-b8d8aa23f974 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:51.504464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e2310-b470-4b59-90c6-b8d8aa23f974 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:51.510527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8956f-ecb2-4649-888b-9b86746dc94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:51.511630 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8956f-ecb2-4649-888b-9b86746dc94a admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:51.512132 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8956f-ecb2-4649-888b-9b86746dc94a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:51.512593 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8956f-ecb2-4649-888b-9b86746dc94a admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:51.513832 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8956f-ecb2-4649-888b-9b86746dc94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:51.515475 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8956f-ecb2-4649-888b-9b86746dc94a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:51.529571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 953/1862] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:51.533516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db9d79-ab6e-4366-b8c4-b91e79a33920 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:51.544410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db9d79-ab6e-4366-b8c4-b91e79a33920 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:51.549743 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c38dc-5f43-47b6-83f7-d7a4c882c829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:51.550420 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c38dc-5f43-47b6-83f7-d7a4c882c829 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:51.550707 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c38dc-5f43-47b6-83f7-d7a4c882c829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:51.550978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c38dc-5f43-47b6-83f7-d7a4c882c829 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:51.551704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c38dc-5f43-47b6-83f7-d7a4c882c829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:51.553936 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c38dc-5f43-47b6-83f7-d7a4c882c829 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:51.564213 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 910/1863] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:51.567881 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8956f-ecb2-4649-888b-9b86746dc94a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:51.577980 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8956f-ecb2-4649-888b-9b86746dc94a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:51.583336 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3312773-a6a8-4769-a49a-2bb89db4552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:51.584254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3312773-a6a8-4769-a49a-2bb89db4552b admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:51.584530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3312773-a6a8-4769-a49a-2bb89db4552b admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:51.584807 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3312773-a6a8-4769-a49a-2bb89db4552b admin admin] PATH_INFO: `/v3/projects/f6d96d848feb4cbdb56008ab2b5aebfe/users/6b32a6f93f0e4759a36643947fad3ce3/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:51.628367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3312773-a6a8-4769-a49a-2bb89db4552b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d96d848feb4cbdb56008ab2b5aebfe, user_id=6b32a6f93f0e4759a36643947fad3ce3, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:51.631475 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3312773-a6a8-4769-a49a-2bb89db4552b admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:51.657898 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 954/1864] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:51 2022] PUT /identity/v3/projects/f6d96d848feb4cbdb56008ab2b5aebfe/users/6b32a6f93f0e4759a36643947fad3ce3/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:51.660562 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fe3be-f011-4368-94d3-830e8349fbee None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:51.661067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fe3be-f011-4368-94d3-830e8349fbee None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:51.661550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fe3be-f011-4368-94d3-830e8349fbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:51.697538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-2f3fe3be-f011-4368-94d3-830e8349fbee None None] MFA Rules not processed for user `6b32a6f93f0e4759a36643947fad3ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:51.699483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-2f3fe3be-f011-4368-94d3-830e8349fbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:51.784762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 911/1865] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:51.785230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3312773-a6a8-4769-a49a-2bb89db4552b admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:51.828101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fe3be-f011-4368-94d3-830e8349fbee None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:51.830157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-2f3fe3be-f011-4368-94d3-830e8349fbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:51.910986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fe3be-f011-4368-94d3-830e8349fbee None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:51.918279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29af601-4638-400e-8a3a-910489640f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:51.919765 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29af601-4638-400e-8a3a-910489640f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:51.920050 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29af601-4638-400e-8a3a-910489640f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:51.920347 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29af601-4638-400e-8a3a-910489640f2b admin admin] PATH_INFO: `/v3/projects/2a5ee79f24684691bedc6b6a3924c7ec` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:51.921923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29af601-4638-400e-8a3a-910489640f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a5ee79f24684691bedc6b6a3924c7ec)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:51.924547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29af601-4638-400e-8a3a-910489640f2b admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:51.969891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3312773-a6a8-4769-a49a-2bb89db4552b admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:51.981720 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f10cd5-0bc8-43d6-82b7-8085298a8aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:51.982525 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10cd5-0bc8-43d6-82b7-8085298a8aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:51.983409 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10cd5-0bc8-43d6-82b7-8085298a8aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:51.983890 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10cd5-0bc8-43d6-82b7-8085298a8aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:51.985581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f10cd5-0bc8-43d6-82b7-8085298a8aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:51.988120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f10cd5-0bc8-43d6-82b7-8085298a8aa3 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:51.993102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b29af601-4638-400e-8a3a-910489640f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a5ee79f24684691bedc6b6a3924c7ec', 'request_id': 'req-b29af601-4638-400e-8a3a-910489640f2b'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:52.000288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b29af601-4638-400e-8a3a-910489640f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a5ee79f24684691bedc6b6a3924c7ec', 'request_id': 'req-b29af601-4638-400e-8a3a-910489640f2b'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:52.008676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b29af601-4638-400e-8a3a-910489640f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a5ee79f24684691bedc6b6a3924c7ec', 'request_id': 'req-b29af601-4638-400e-8a3a-910489640f2b'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:52.024706 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b29af601-4638-400e-8a3a-910489640f2b admin admin] The token cache is being invalidate because project 2a5ee79f24684691bedc6b6a3924c7ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:52.025052 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b29af601-4638-400e-8a3a-910489640f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:52.025630 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b29af601-4638-400e-8a3a-910489640f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:52.027919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 912/1866] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:51 2022] DELETE /identity/v3/projects/2a5ee79f24684691bedc6b6a3924c7ec => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:00:52.029295 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 955/1867] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:51 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:52.035240 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29af601-4638-400e-8a3a-910489640f2b admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:52.036092 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f10cd5-0bc8-43d6-82b7-8085298a8aa3 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:52.036761 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b29af601-4638-400e-8a3a-910489640f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:52.039916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-08f10cd5-0bc8-43d6-82b7-8085298a8aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:52.115961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29af601-4638-400e-8a3a-910489640f2b admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:52.133718 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f10cd5-0bc8-43d6-82b7-8085298a8aa3 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:52.141077 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b934c38-c408-4ab9-ade8-bb66ea72abe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:52.142391 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b934c38-c408-4ab9-ade8-bb66ea72abe7 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:52.142860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b934c38-c408-4ab9-ade8-bb66ea72abe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:52.143312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b934c38-c408-4ab9-ade8-bb66ea72abe7 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:52.144379 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b934c38-c408-4ab9-ade8-bb66ea72abe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:52.147186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b934c38-c408-4ab9-ade8-bb66ea72abe7 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:52.183746 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 956/1868] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:00:52 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:52.187672 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b934c38-c408-4ab9-ade8-bb66ea72abe7 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:52.189430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae1ef7-7fcf-494d-b0c4-76d7e90c9a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:52.190393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae1ef7-7fcf-494d-b0c4-76d7e90c9a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:52.190737 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae1ef7-7fcf-494d-b0c4-76d7e90c9a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:52.191245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae1ef7-7fcf-494d-b0c4-76d7e90c9a01 admin admin] PATH_INFO: `/v3/users/1b075e98d9744897a2cd45dcd5d34788` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:52.192637 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae1ef7-7fcf-494d-b0c4-76d7e90c9a01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b075e98d9744897a2cd45dcd5d34788)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:52.194777 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae1ef7-7fcf-494d-b0c4-76d7e90c9a01 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:52.201880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b934c38-c408-4ab9-ade8-bb66ea72abe7 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:52.213373 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441f379-fc68-4b59-baed-089a9e04b3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:52.214374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441f379-fc68-4b59-baed-089a9e04b3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:52.215408 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441f379-fc68-4b59-baed-089a9e04b3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:52.216867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441f379-fc68-4b59-baed-089a9e04b3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:52.218467 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441f379-fc68-4b59-baed-089a9e04b3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:52.221265 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441f379-fc68-4b59-baed-089a9e04b3b7 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:52.241839 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 957/1869] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:52.246093 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441f379-fc68-4b59-baed-089a9e04b3b7 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:52.279314 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441f379-fc68-4b59-baed-089a9e04b3b7 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:52.285655 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca415e-b8d2-4160-9127-a3cea9d4654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:52.286870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca415e-b8d2-4160-9127-a3cea9d4654a admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:52.287405 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca415e-b8d2-4160-9127-a3cea9d4654a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:52.287887 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca415e-b8d2-4160-9127-a3cea9d4654a admin admin] PATH_INFO: `/v3/projects/a8e5c7bce3c940798d38b96492fc2010/users/4156907c506a4b35919418d159262fd4/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:52.294193 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d9ae1ef7-7fcf-494d-b0c4-76d7e90c9a01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b075e98d9744897a2cd45dcd5d34788'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:52.294917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d9ae1ef7-7fcf-494d-b0c4-76d7e90c9a01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b075e98d9744897a2cd45dcd5d34788'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:52.306987 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca415e-b8d2-4160-9127-a3cea9d4654a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e5c7bce3c940798d38b96492fc2010, user_id=4156907c506a4b35919418d159262fd4, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:52.310987 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca415e-b8d2-4160-9127-a3cea9d4654a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:52.318073 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d9ae1ef7-7fcf-494d-b0c4-76d7e90c9a01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b075e98d9744897a2cd45dcd5d34788'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:52.329875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d9ae1ef7-7fcf-494d-b0c4-76d7e90c9a01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b075e98d9744897a2cd45dcd5d34788'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:52.331186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d9ae1ef7-7fcf-494d-b0c4-76d7e90c9a01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b075e98d9744897a2cd45dcd5d34788'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:52.334344 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 958/1870] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:52 2022] PUT /identity/v3/projects/a8e5c7bce3c940798d38b96492fc2010/users/4156907c506a4b35919418d159262fd4/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:00:52.339362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca415e-b8d2-4160-9127-a3cea9d4654a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:52.345661 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-96ca415e-b8d2-4160-9127-a3cea9d4654a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:52.352428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 913/1871] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:52 2022] DELETE /identity/v3/users/1b075e98d9744897a2cd45dcd5d34788 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:52.428710 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca415e-b8d2-4160-9127-a3cea9d4654a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:52.494517 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd800c65-6a42-42e4-8b05-05225765c057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:52.495109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd800c65-6a42-42e4-8b05-05225765c057 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:52.496519 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd800c65-6a42-42e4-8b05-05225765c057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:52.496798 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd800c65-6a42-42e4-8b05-05225765c057 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:52.497530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd800c65-6a42-42e4-8b05-05225765c057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:52.499108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd800c65-6a42-42e4-8b05-05225765c057 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:52.514520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 959/1872] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:52.516813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae1ef7-7fcf-494d-b0c4-76d7e90c9a01 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:52.529320 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae1ef7-7fcf-494d-b0c4-76d7e90c9a01 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:52.534274 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d829134-d078-4df2-913f-a18a5a6dd7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:52.535166 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d829134-d078-4df2-913f-a18a5a6dd7a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:52.536064 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d829134-d078-4df2-913f-a18a5a6dd7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:52.536499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d829134-d078-4df2-913f-a18a5a6dd7a2 admin admin] PATH_INFO: `/v3/projects/a8e5c7bce3c940798d38b96492fc2010/users/4156907c506a4b35919418d159262fd4/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:52.538839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d829134-d078-4df2-913f-a18a5a6dd7a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e5c7bce3c940798d38b96492fc2010, user_id=4156907c506a4b35919418d159262fd4, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:52.541732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d829134-d078-4df2-913f-a18a5a6dd7a2 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:52.554106 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 914/1873] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:52 2022] PUT /identity/v3/projects/a8e5c7bce3c940798d38b96492fc2010/users/4156907c506a4b35919418d159262fd4/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:52.566055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5c611-73bb-4df7-b717-20b3fdab83e9 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:52.566527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5c611-73bb-4df7-b717-20b3fdab83e9 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:52.566949 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5c611-73bb-4df7-b717-20b3fdab83e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:52.601082 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-25d5c611-73bb-4df7-b717-20b3fdab83e9 None None] MFA Rules not processed for user `4156907c506a4b35919418d159262fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:52.602784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-25d5c611-73bb-4df7-b717-20b3fdab83e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:52.692227 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 960/1874] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:00:52.700844 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d829134-d078-4df2-913f-a18a5a6dd7a2 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:52.702849 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-6d829134-d078-4df2-913f-a18a5a6dd7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:52.789147 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d829134-d078-4df2-913f-a18a5a6dd7a2 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:52.792978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a2e3a-4f63-415f-a980-140b13369348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:52.793628 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a2e3a-4f63-415f-a980-140b13369348 service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:52.793991 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a2e3a-4f63-415f-a980-140b13369348 service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:52.794268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a2e3a-4f63-415f-a980-140b13369348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:52.805818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a2e3a-4f63-415f-a980-140b13369348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:52.807390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a2e3a-4f63-415f-a980-140b13369348 service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:52.823621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 915/1875] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:52.939621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5c611-73bb-4df7-b717-20b3fdab83e9 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:52.949989 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5c611-73bb-4df7-b717-20b3fdab83e9 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:52.953969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e478d85-d9de-4bc4-a462-3e92eb952b4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:52.954625 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478d85-d9de-4bc4-a462-3e92eb952b4b service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:52.954910 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478d85-d9de-4bc4-a462-3e92eb952b4b service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:52.955189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478d85-d9de-4bc4-a462-3e92eb952b4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:52.957044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-4e478d85-d9de-4bc4-a462-3e92eb952b4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:53.026288 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e478d85-d9de-4bc4-a462-3e92eb952b4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:53.027870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e478d85-d9de-4bc4-a462-3e92eb952b4b service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:53.039205 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 961/1876] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:53.555123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a2e3a-4f63-415f-a980-140b13369348 service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:53.556597 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-5d7a2e3a-4f63-415f-a980-140b13369348 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:53.682534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a2e3a-4f63-415f-a980-140b13369348 service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:53.690189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ecf45-eceb-4bb4-9b1f-aee2a9e1fac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:53.691137 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ecf45-eceb-4bb4-9b1f-aee2a9e1fac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:53.691909 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ecf45-eceb-4bb4-9b1f-aee2a9e1fac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:53.692291 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ecf45-eceb-4bb4-9b1f-aee2a9e1fac6 admin admin] PATH_INFO: `/v3/projects/1365d85cd3c74212b9af26cf1013320d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:53.694008 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ecf45-eceb-4bb4-9b1f-aee2a9e1fac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1365d85cd3c74212b9af26cf1013320d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:53.696616 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ecf45-eceb-4bb4-9b1f-aee2a9e1fac6 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:53.780007 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-bb2ecf45-eceb-4bb4-9b1f-aee2a9e1fac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1365d85cd3c74212b9af26cf1013320d', 'request_id': 'req-bb2ecf45-eceb-4bb4-9b1f-aee2a9e1fac6'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:53.788975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-bb2ecf45-eceb-4bb4-9b1f-aee2a9e1fac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1365d85cd3c74212b9af26cf1013320d', 'request_id': 'req-bb2ecf45-eceb-4bb4-9b1f-aee2a9e1fac6'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:53.796305 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-bb2ecf45-eceb-4bb4-9b1f-aee2a9e1fac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1365d85cd3c74212b9af26cf1013320d', 'request_id': 'req-bb2ecf45-eceb-4bb4-9b1f-aee2a9e1fac6'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:53.816163 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-bb2ecf45-eceb-4bb4-9b1f-aee2a9e1fac6 admin admin] The token cache is being invalidate because project 1365d85cd3c74212b9af26cf1013320d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:53.819342 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-bb2ecf45-eceb-4bb4-9b1f-aee2a9e1fac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:53.823040 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-bb2ecf45-eceb-4bb4-9b1f-aee2a9e1fac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:53.833069 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 916/1877] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:53 2022] DELETE /identity/v3/projects/1365d85cd3c74212b9af26cf1013320d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:53.834004 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305a69e-1888-416d-a66a-afe6e3e66b85 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:53.834293 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305a69e-1888-416d-a66a-afe6e3e66b85 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:53.834572 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305a69e-1888-416d-a66a-afe6e3e66b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:53.863901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-7305a69e-1888-416d-a66a-afe6e3e66b85 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:53.865467 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-7305a69e-1888-416d-a66a-afe6e3e66b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:53.936544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 962/1878] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:00:53.942811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9cdab-e21b-4a0c-8d58-571f0fa11a5c None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:53.943242 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9cdab-e21b-4a0c-8d58-571f0fa11a5c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:53.943632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9cdab-e21b-4a0c-8d58-571f0fa11a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:53.964477 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-7ca9cdab-e21b-4a0c-8d58-571f0fa11a5c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:53.974753 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-7ca9cdab-e21b-4a0c-8d58-571f0fa11a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:53.984033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 917/1879] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:53.988382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305a69e-1888-416d-a66a-afe6e3e66b85 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:54.000052 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305a69e-1888-416d-a66a-afe6e3e66b85 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:54.005620 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d54bc-ccf3-49de-8af2-50e9a3f6607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:54.006286 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d54bc-ccf3-49de-8af2-50e9a3f6607d admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:54.006626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d54bc-ccf3-49de-8af2-50e9a3f6607d admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:54.006908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d54bc-ccf3-49de-8af2-50e9a3f6607d admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:54.008326 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d54bc-ccf3-49de-8af2-50e9a3f6607d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:00:54.008326 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d54bc-ccf3-49de-8af2-50e9a3f6607d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:54.009582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d54bc-ccf3-49de-8af2-50e9a3f6607d admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:54.021472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 963/1880] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:00:54.026326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9cdab-e21b-4a0c-8d58-571f0fa11a5c None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:54.037749 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9cdab-e21b-4a0c-8d58-571f0fa11a5c None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:54.044027 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d793ee6-7f94-4588-b389-10f8e8936ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:54.044887 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d793ee6-7f94-4588-b389-10f8e8936ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:54.046417 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d793ee6-7f94-4588-b389-10f8e8936ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:54.046856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d793ee6-7f94-4588-b389-10f8e8936ac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:54.047713 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d793ee6-7f94-4588-b389-10f8e8936ac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:54.049811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d793ee6-7f94-4588-b389-10f8e8936ac5 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:54.080256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 918/1881] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:54 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:54.084832 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d54bc-ccf3-49de-8af2-50e9a3f6607d admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:54.097887 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d54bc-ccf3-49de-8af2-50e9a3f6607d admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:54.154562 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4839a9b-d11d-4d79-9a38-e58edd458714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:54.155324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4839a9b-d11d-4d79-9a38-e58edd458714 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:54.155671 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4839a9b-d11d-4d79-9a38-e58edd458714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:54.156015 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4839a9b-d11d-4d79-9a38-e58edd458714 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:54.156972 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4839a9b-d11d-4d79-9a38-e58edd458714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:54.158943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4839a9b-d11d-4d79-9a38-e58edd458714 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:54.180804 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 964/1882] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:00:54 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:54.185790 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d793ee6-7f94-4588-b389-10f8e8936ac5 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:54.197387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d793ee6-7f94-4588-b389-10f8e8936ac5 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:54.202394 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056050eb-6307-47a9-bb96-b00118d8c617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:54.203057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056050eb-6307-47a9-bb96-b00118d8c617 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:54.203354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056050eb-6307-47a9-bb96-b00118d8c617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:54.204851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056050eb-6307-47a9-bb96-b00118d8c617 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:54.204851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056050eb-6307-47a9-bb96-b00118d8c617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:54.205991 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056050eb-6307-47a9-bb96-b00118d8c617 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:54.217554 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 919/1883] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:54.221777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4839a9b-d11d-4d79-9a38-e58edd458714 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:54.233224 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4839a9b-d11d-4d79-9a38-e58edd458714 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:54.238743 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f894a2c-c386-44bb-a61d-2a631d0fec62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:54.239946 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f894a2c-c386-44bb-a61d-2a631d0fec62 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:54.240248 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f894a2c-c386-44bb-a61d-2a631d0fec62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:54.240522 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f894a2c-c386-44bb-a61d-2a631d0fec62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:54.241243 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f894a2c-c386-44bb-a61d-2a631d0fec62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:54.242812 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f894a2c-c386-44bb-a61d-2a631d0fec62 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:54.253830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 965/1884] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:54.258473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056050eb-6307-47a9-bb96-b00118d8c617 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:54.269179 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056050eb-6307-47a9-bb96-b00118d8c617 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:54.274300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9bd55-a793-453a-a451-9b1849ca535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:54.275288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9bd55-a793-453a-a451-9b1849ca535b admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:54.275439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9bd55-a793-453a-a451-9b1849ca535b admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:54.275708 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9bd55-a793-453a-a451-9b1849ca535b admin admin] PATH_INFO: `/v3/projects/7f20600f569f42109476f7433433bbef/users/f21858ab496d4753b11b441eaf87378c/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:54.292080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9bd55-a793-453a-a451-9b1849ca535b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f20600f569f42109476f7433433bbef, user_id=f21858ab496d4753b11b441eaf87378c, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:54.295731 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9bd55-a793-453a-a451-9b1849ca535b admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:54.316894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 920/1885] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:54 2022] PUT /identity/v3/projects/7f20600f569f42109476f7433433bbef/users/f21858ab496d4753b11b441eaf87378c/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:54.328594 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fe300-da75-47f1-a725-c272b4b7d517 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:54.328946 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fe300-da75-47f1-a725-c272b4b7d517 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:54.329350 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fe300-da75-47f1-a725-c272b4b7d517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:54.359686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f37fe300-da75-47f1-a725-c272b4b7d517 None None] MFA Rules not processed for user `f21858ab496d4753b11b441eaf87378c`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:54.361415 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f37fe300-da75-47f1-a725-c272b4b7d517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:54.440310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 966/1886] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:54.442881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9bd55-a793-453a-a451-9b1849ca535b admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:54.549021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9bd55-a793-453a-a451-9b1849ca535b admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:54.560096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830320b3-3d78-4e5f-8829-9be999860d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:54.561586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830320b3-3d78-4e5f-8829-9be999860d45 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:54.561949 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830320b3-3d78-4e5f-8829-9be999860d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:54.562294 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830320b3-3d78-4e5f-8829-9be999860d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:54.567676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830320b3-3d78-4e5f-8829-9be999860d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:54.573403 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830320b3-3d78-4e5f-8829-9be999860d45 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:54.633182 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 921/1887] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:54 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:54.637589 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fe300-da75-47f1-a725-c272b4b7d517 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:54.666700 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fe300-da75-47f1-a725-c272b4b7d517 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:54.786935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c5d41-8bcb-4259-a7c5-c0d3868cade1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:54.787628 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c5d41-8bcb-4259-a7c5-c0d3868cade1 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:54.787964 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c5d41-8bcb-4259-a7c5-c0d3868cade1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:54.788296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c5d41-8bcb-4259-a7c5-c0d3868cade1 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:54.789006 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c5d41-8bcb-4259-a7c5-c0d3868cade1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:54.792347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c5d41-8bcb-4259-a7c5-c0d3868cade1 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:54.822884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 967/1888] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:00:54 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:54.827136 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830320b3-3d78-4e5f-8829-9be999860d45 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:54.842068 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830320b3-3d78-4e5f-8829-9be999860d45 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:54.844847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7e027-3ee4-4999-b1e2-585171e4ea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:54.845580 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7e027-3ee4-4999-b1e2-585171e4ea3d admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:54.845924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7e027-3ee4-4999-b1e2-585171e4ea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:54.846356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7e027-3ee4-4999-b1e2-585171e4ea3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:54.847202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7e027-3ee4-4999-b1e2-585171e4ea3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:54.849104 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7e027-3ee4-4999-b1e2-585171e4ea3d admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:54.871309 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 922/1889] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:54.871677 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c5d41-8bcb-4259-a7c5-c0d3868cade1 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:54.887101 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c5d41-8bcb-4259-a7c5-c0d3868cade1 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:54.905069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114a155-97a8-408f-81ba-559e4cf01588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:54.906853 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114a155-97a8-408f-81ba-559e4cf01588 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:54.907432 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114a155-97a8-408f-81ba-559e4cf01588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:54.907774 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114a155-97a8-408f-81ba-559e4cf01588 admin admin] PATH_INFO: `/v3/projects/36357f281754485896edfb96ce3a594d/users/4fa5c06aba5e43d8bcc24d1fc0c39afb/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:54.934146 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114a155-97a8-408f-81ba-559e4cf01588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36357f281754485896edfb96ce3a594d, user_id=4fa5c06aba5e43d8bcc24d1fc0c39afb, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:54.937803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114a155-97a8-408f-81ba-559e4cf01588 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:54.955807 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 968/1890] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:54 2022] PUT /identity/v3/projects/36357f281754485896edfb96ce3a594d/users/4fa5c06aba5e43d8bcc24d1fc0c39afb/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:00:54.960843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7e027-3ee4-4999-b1e2-585171e4ea3d admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:54.983544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7e027-3ee4-4999-b1e2-585171e4ea3d admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:55.071848 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee7fdd-eb60-44e0-9b4c-507f918a56f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:55.072566 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee7fdd-eb60-44e0-9b4c-507f918a56f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:55.072867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee7fdd-eb60-44e0-9b4c-507f918a56f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:55.073145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee7fdd-eb60-44e0-9b4c-507f918a56f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:55.077010 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee7fdd-eb60-44e0-9b4c-507f918a56f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:55.079306 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee7fdd-eb60-44e0-9b4c-507f918a56f6 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:55.099778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 923/1891] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:55.101204 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114a155-97a8-408f-81ba-559e4cf01588 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:55.113113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114a155-97a8-408f-81ba-559e4cf01588 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:55.119794 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8ae11-4b89-4ec2-b055-e73e8d842b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:55.121288 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8ae11-4b89-4ec2-b055-e73e8d842b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:55.121629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8ae11-4b89-4ec2-b055-e73e8d842b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:55.122102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8ae11-4b89-4ec2-b055-e73e8d842b54 admin admin] PATH_INFO: `/v3/projects/36357f281754485896edfb96ce3a594d/users/4fa5c06aba5e43d8bcc24d1fc0c39afb/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:55.124777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8ae11-4b89-4ec2-b055-e73e8d842b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36357f281754485896edfb96ce3a594d, user_id=4fa5c06aba5e43d8bcc24d1fc0c39afb, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:55.127865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8ae11-4b89-4ec2-b055-e73e8d842b54 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:55.145260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 969/1892] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:55 2022] PUT /identity/v3/projects/36357f281754485896edfb96ce3a594d/users/4fa5c06aba5e43d8bcc24d1fc0c39afb/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:55.156312 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227043e-9be7-4ae6-9e2d-24475b6a3428 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:55.156876 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227043e-9be7-4ae6-9e2d-24475b6a3428 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:55.157923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227043e-9be7-4ae6-9e2d-24475b6a3428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:55.194164 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-b227043e-9be7-4ae6-9e2d-24475b6a3428 None None] MFA Rules not processed for user `4fa5c06aba5e43d8bcc24d1fc0c39afb`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:55.195516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b227043e-9be7-4ae6-9e2d-24475b6a3428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:55.281582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 924/1893] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:55.296298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8ae11-4b89-4ec2-b055-e73e8d842b54 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:55.298295 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c5c8ae11-4b89-4ec2-b055-e73e8d842b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:55.386605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8ae11-4b89-4ec2-b055-e73e8d842b54 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:55.396951 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387f185-b637-40df-be83-e015743468c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:55.398206 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387f185-b637-40df-be83-e015743468c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:55.398558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387f185-b637-40df-be83-e015743468c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:55.398917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387f185-b637-40df-be83-e015743468c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:55.471427 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387f185-b637-40df-be83-e015743468c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:55.472889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387f185-b637-40df-be83-e015743468c9 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:55.483432 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 970/1894] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:55.947059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227043e-9be7-4ae6-9e2d-24475b6a3428 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:55.948679 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b227043e-9be7-4ae6-9e2d-24475b6a3428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:56.068311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227043e-9be7-4ae6-9e2d-24475b6a3428 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:56.075049 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbefe3-1b92-4962-a2a5-69758134149d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:56.075941 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbefe3-1b92-4962-a2a5-69758134149d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:56.076255 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbefe3-1b92-4962-a2a5-69758134149d admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:56.076531 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbefe3-1b92-4962-a2a5-69758134149d admin admin] PATH_INFO: `/v3/users/6b32a6f93f0e4759a36643947fad3ce3` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:56.077773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbefe3-1b92-4962-a2a5-69758134149d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b32a6f93f0e4759a36643947fad3ce3)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:56.079979 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbefe3-1b92-4962-a2a5-69758134149d admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:56.145804 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-24dbefe3-1b92-4962-a2a5-69758134149d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b32a6f93f0e4759a36643947fad3ce3'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:56.146487 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-24dbefe3-1b92-4962-a2a5-69758134149d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b32a6f93f0e4759a36643947fad3ce3'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:56.164831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-24dbefe3-1b92-4962-a2a5-69758134149d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b32a6f93f0e4759a36643947fad3ce3'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:56.176504 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-24dbefe3-1b92-4962-a2a5-69758134149d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b32a6f93f0e4759a36643947fad3ce3'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:56.177252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-24dbefe3-1b92-4962-a2a5-69758134149d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b32a6f93f0e4759a36643947fad3ce3'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:56.196251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 925/1895] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:55 2022] DELETE /identity/v3/users/6b32a6f93f0e4759a36643947fad3ce3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:00:56.199526 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777a510-348a-4359-8ce5-0c2dd24d3b8c None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:56.200037 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777a510-348a-4359-8ce5-0c2dd24d3b8c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:56.200119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777a510-348a-4359-8ce5-0c2dd24d3b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:56.223192 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-5777a510-348a-4359-8ce5-0c2dd24d3b8c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:56.224523 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-5777a510-348a-4359-8ce5-0c2dd24d3b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:56.299298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 971/1896] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:56.310919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbefe3-1b92-4962-a2a5-69758134149d admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:56.312284 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-24dbefe3-1b92-4962-a2a5-69758134149d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:56.394015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbefe3-1b92-4962-a2a5-69758134149d admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:56.398753 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4fa6f-1f36-4fc7-bcbf-084d9e62eda0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:56.399781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4fa6f-1f36-4fc7-bcbf-084d9e62eda0 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:56.400338 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4fa6f-1f36-4fc7-bcbf-084d9e62eda0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:56.400822 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4fa6f-1f36-4fc7-bcbf-084d9e62eda0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:56.422175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4fa6f-1f36-4fc7-bcbf-084d9e62eda0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:56.425355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4fa6f-1f36-4fc7-bcbf-084d9e62eda0 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:56.441572 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 926/1897] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:00:56.748410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777a510-348a-4359-8ce5-0c2dd24d3b8c None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:56.749836 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-5777a510-348a-4359-8ce5-0c2dd24d3b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:56.763244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777a510-348a-4359-8ce5-0c2dd24d3b8c None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:56.768900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105fc47-16ab-4632-bf6d-d3e9f5716436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:56.769777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105fc47-16ab-4632-bf6d-d3e9f5716436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:56.770217 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105fc47-16ab-4632-bf6d-d3e9f5716436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:56.770500 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105fc47-16ab-4632-bf6d-d3e9f5716436 admin admin] PATH_INFO: `/v3/projects/f6d96d848feb4cbdb56008ab2b5aebfe` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:56.771831 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105fc47-16ab-4632-bf6d-d3e9f5716436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d96d848feb4cbdb56008ab2b5aebfe)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:56.774077 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105fc47-16ab-4632-bf6d-d3e9f5716436 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:56.830717 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-1105fc47-16ab-4632-bf6d-d3e9f5716436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d96d848feb4cbdb56008ab2b5aebfe', 'request_id': 'req-1105fc47-16ab-4632-bf6d-d3e9f5716436'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:56.838433 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-1105fc47-16ab-4632-bf6d-d3e9f5716436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d96d848feb4cbdb56008ab2b5aebfe', 'request_id': 'req-1105fc47-16ab-4632-bf6d-d3e9f5716436'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:56.849937 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-1105fc47-16ab-4632-bf6d-d3e9f5716436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d96d848feb4cbdb56008ab2b5aebfe', 'request_id': 'req-1105fc47-16ab-4632-bf6d-d3e9f5716436'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:56.864798 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-1105fc47-16ab-4632-bf6d-d3e9f5716436 admin admin] The token cache is being invalidate because project f6d96d848feb4cbdb56008ab2b5aebfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:56.865991 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-1105fc47-16ab-4632-bf6d-d3e9f5716436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:56.866836 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-1105fc47-16ab-4632-bf6d-d3e9f5716436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:56.869456 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 972/1898] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:56 2022] DELETE /identity/v3/projects/f6d96d848feb4cbdb56008ab2b5aebfe => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:56.873334 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4fa6f-1f36-4fc7-bcbf-084d9e62eda0 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:56.890490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4fa6f-1f36-4fc7-bcbf-084d9e62eda0 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:56.972063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85d980-e119-4bad-8a37-c67d258e8489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:56.973064 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85d980-e119-4bad-8a37-c67d258e8489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:56.973412 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85d980-e119-4bad-8a37-c67d258e8489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:56.973783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85d980-e119-4bad-8a37-c67d258e8489 admin admin] PATH_INFO: `/v3/users/4156907c506a4b35919418d159262fd4` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:56.975052 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd85d980-e119-4bad-8a37-c67d258e8489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4156907c506a4b35919418d159262fd4)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:56.977003 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd85d980-e119-4bad-8a37-c67d258e8489 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:57.028734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fd85d980-e119-4bad-8a37-c67d258e8489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4156907c506a4b35919418d159262fd4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:57.029463 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fd85d980-e119-4bad-8a37-c67d258e8489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4156907c506a4b35919418d159262fd4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:57.041493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fd85d980-e119-4bad-8a37-c67d258e8489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4156907c506a4b35919418d159262fd4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:57.049048 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fd85d980-e119-4bad-8a37-c67d258e8489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4156907c506a4b35919418d159262fd4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:57.049782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fd85d980-e119-4bad-8a37-c67d258e8489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4156907c506a4b35919418d159262fd4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:57.062399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 927/1899] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:56 2022] DELETE /identity/v3/users/4156907c506a4b35919418d159262fd4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:57.327393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105fc47-16ab-4632-bf6d-d3e9f5716436 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:57.328864 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-1105fc47-16ab-4632-bf6d-d3e9f5716436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:57.342200 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105fc47-16ab-4632-bf6d-d3e9f5716436 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:57.403032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397fe1a-67f4-46fd-8f48-e31b58e90c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:57.403905 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397fe1a-67f4-46fd-8f48-e31b58e90c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:57.404212 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397fe1a-67f4-46fd-8f48-e31b58e90c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:57.404491 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397fe1a-67f4-46fd-8f48-e31b58e90c5c admin admin] PATH_INFO: `/v3/projects/a8e5c7bce3c940798d38b96492fc2010` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:57.405680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397fe1a-67f4-46fd-8f48-e31b58e90c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8e5c7bce3c940798d38b96492fc2010)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:57.407568 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397fe1a-67f4-46fd-8f48-e31b58e90c5c admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:57.454906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-0397fe1a-67f4-46fd-8f48-e31b58e90c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8e5c7bce3c940798d38b96492fc2010', 'request_id': 'req-0397fe1a-67f4-46fd-8f48-e31b58e90c5c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:57.463998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-0397fe1a-67f4-46fd-8f48-e31b58e90c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8e5c7bce3c940798d38b96492fc2010', 'request_id': 'req-0397fe1a-67f4-46fd-8f48-e31b58e90c5c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:57.470532 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-0397fe1a-67f4-46fd-8f48-e31b58e90c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8e5c7bce3c940798d38b96492fc2010', 'request_id': 'req-0397fe1a-67f4-46fd-8f48-e31b58e90c5c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:57.482860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-0397fe1a-67f4-46fd-8f48-e31b58e90c5c admin admin] The token cache is being invalidate because project a8e5c7bce3c940798d38b96492fc2010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:00:57.483281 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-0397fe1a-67f4-46fd-8f48-e31b58e90c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:57.483944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-0397fe1a-67f4-46fd-8f48-e31b58e90c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:57.486194 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 973/1900] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:00:57 2022] DELETE /identity/v3/projects/a8e5c7bce3c940798d38b96492fc2010 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:00:57.491258 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3937770-22c8-4d82-b94d-cf77745dae6d None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:57.491762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3937770-22c8-4d82-b94d-cf77745dae6d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:57.492865 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3937770-22c8-4d82-b94d-cf77745dae6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:57.510857 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-f3937770-22c8-4d82-b94d-cf77745dae6d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:57.512802 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-f3937770-22c8-4d82-b94d-cf77745dae6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:57.584323 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 928/1901] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:57.591274 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97d987-c9e1-4fc2-86fa-d19b0acdf2a1 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:57.591563 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97d987-c9e1-4fc2-86fa-d19b0acdf2a1 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:57.591846 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97d987-c9e1-4fc2-86fa-d19b0acdf2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:57.611314 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-fb97d987-c9e1-4fc2-86fa-d19b0acdf2a1 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:57.612559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-fb97d987-c9e1-4fc2-86fa-d19b0acdf2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:57.621554 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 974/1902] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:57.625654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3937770-22c8-4d82-b94d-cf77745dae6d None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:57.635361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3937770-22c8-4d82-b94d-cf77745dae6d None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:57.640456 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d634726-c738-4c08-9d34-301191bc3408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:57.641113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d634726-c738-4c08-9d34-301191bc3408 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:57.641390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d634726-c738-4c08-9d34-301191bc3408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:57.641661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d634726-c738-4c08-9d34-301191bc3408 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:57.642418 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d634726-c738-4c08-9d34-301191bc3408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:00:57.642679 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d634726-c738-4c08-9d34-301191bc3408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:57.644292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d634726-c738-4c08-9d34-301191bc3408 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:57.657981 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 929/1903] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:00:57.662754 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97d987-c9e1-4fc2-86fa-d19b0acdf2a1 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:57.673418 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97d987-c9e1-4fc2-86fa-d19b0acdf2a1 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:57.678264 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10227d-42c5-482f-a53f-c778bbb0c4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:57.678958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10227d-42c5-482f-a53f-c778bbb0c4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:57.679237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10227d-42c5-482f-a53f-c778bbb0c4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:57.679651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10227d-42c5-482f-a53f-c778bbb0c4d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:57.680379 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10227d-42c5-482f-a53f-c778bbb0c4d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:57.682537 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10227d-42c5-482f-a53f-c778bbb0c4d1 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:57.714200 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 975/1904] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:57 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:57.718183 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d634726-c738-4c08-9d34-301191bc3408 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:57.728294 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d634726-c738-4c08-9d34-301191bc3408 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:57.783604 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb94ed-a216-4aad-a14c-df8b2e229545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:57.784310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb94ed-a216-4aad-a14c-df8b2e229545 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:57.784591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb94ed-a216-4aad-a14c-df8b2e229545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:57.784861 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb94ed-a216-4aad-a14c-df8b2e229545 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:57.785583 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb94ed-a216-4aad-a14c-df8b2e229545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:57.787514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb94ed-a216-4aad-a14c-df8b2e229545 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:57.812433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 930/1905] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:00:57 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:57.814877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10227d-42c5-482f-a53f-c778bbb0c4d1 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:57.829390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10227d-42c5-482f-a53f-c778bbb0c4d1 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:57.834722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f29f31-1824-466e-a60d-231e83dfdc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:57.835846 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f29f31-1824-466e-a60d-231e83dfdc3e admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:57.836425 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f29f31-1824-466e-a60d-231e83dfdc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:57.836795 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f29f31-1824-466e-a60d-231e83dfdc3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:57.837616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f29f31-1824-466e-a60d-231e83dfdc3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:57.839296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f29f31-1824-466e-a60d-231e83dfdc3e admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:57.857309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 976/1906] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:57.858697 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb94ed-a216-4aad-a14c-df8b2e229545 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:57.868871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb94ed-a216-4aad-a14c-df8b2e229545 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:57.874128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcd779-1a20-4165-8d28-41740a8d7b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:57.874901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcd779-1a20-4165-8d28-41740a8d7b66 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:57.875189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcd779-1a20-4165-8d28-41740a8d7b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:57.875464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcd779-1a20-4165-8d28-41740a8d7b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:57.876225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcd779-1a20-4165-8d28-41740a8d7b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:57.877846 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcd779-1a20-4165-8d28-41740a8d7b66 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:57.889778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 931/1907] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:57.894484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f29f31-1824-466e-a60d-231e83dfdc3e admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:57.905427 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f29f31-1824-466e-a60d-231e83dfdc3e admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:57.910192 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c021af-4ad3-4020-a3a4-59a6a7abfd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:57.911145 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c021af-4ad3-4020-a3a4-59a6a7abfd70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:57.911482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c021af-4ad3-4020-a3a4-59a6a7abfd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:57.911918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c021af-4ad3-4020-a3a4-59a6a7abfd70 admin admin] PATH_INFO: `/v3/projects/945f814876b948f9a806e4654e9b6ae5/users/a08b97150dae4bcda1d2fb1e8a182d7b/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:57.926828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c021af-4ad3-4020-a3a4-59a6a7abfd70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=945f814876b948f9a806e4654e9b6ae5, user_id=a08b97150dae4bcda1d2fb1e8a182d7b, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:57.929905 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c021af-4ad3-4020-a3a4-59a6a7abfd70 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:57.943153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 977/1908] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:57 2022] PUT /identity/v3/projects/945f814876b948f9a806e4654e9b6ae5/users/a08b97150dae4bcda1d2fb1e8a182d7b/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:57.953275 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271d352-64b9-40cc-8916-0b2c34dec6bf None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:57.953563 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271d352-64b9-40cc-8916-0b2c34dec6bf None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:57.953837 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271d352-64b9-40cc-8916-0b2c34dec6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:57.979512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-0271d352-64b9-40cc-8916-0b2c34dec6bf None None] MFA Rules not processed for user `a08b97150dae4bcda1d2fb1e8a182d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:57.981281 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0271d352-64b9-40cc-8916-0b2c34dec6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:58.046015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 932/1909] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:58.050643 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c021af-4ad3-4020-a3a4-59a6a7abfd70 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:58.110132 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c021af-4ad3-4020-a3a4-59a6a7abfd70 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:58.114892 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cda5e-bfa2-4434-92ce-70c2f0799d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:58.115547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cda5e-bfa2-4434-92ce-70c2f0799d22 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:58.116026 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cda5e-bfa2-4434-92ce-70c2f0799d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:58.116131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cda5e-bfa2-4434-92ce-70c2f0799d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:58.116796 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82cda5e-bfa2-4434-92ce-70c2f0799d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:58.118673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82cda5e-bfa2-4434-92ce-70c2f0799d22 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:58.145740 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 978/1910] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:00:58 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:58.150156 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271d352-64b9-40cc-8916-0b2c34dec6bf None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:58.161939 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271d352-64b9-40cc-8916-0b2c34dec6bf None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:58.216373 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342cd79-2568-4646-8a3e-7db314f9c3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:58.216953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342cd79-2568-4646-8a3e-7db314f9c3d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:58.217236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342cd79-2568-4646-8a3e-7db314f9c3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:58.217509 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342cd79-2568-4646-8a3e-7db314f9c3d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:58.218191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342cd79-2568-4646-8a3e-7db314f9c3d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:58.220128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342cd79-2568-4646-8a3e-7db314f9c3d6 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:58.242868 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 933/1911] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:00:58 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:00:58.247015 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cda5e-bfa2-4434-92ce-70c2f0799d22 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:58.257701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cda5e-bfa2-4434-92ce-70c2f0799d22 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:58.263518 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20ea24-e6bd-4c57-bf4b-8d7293a1aa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:58.264351 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ea24-e6bd-4c57-bf4b-8d7293a1aa25 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:58.264633 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ea24-e6bd-4c57-bf4b-8d7293a1aa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:58.264949 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ea24-e6bd-4c57-bf4b-8d7293a1aa25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:58.265582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20ea24-e6bd-4c57-bf4b-8d7293a1aa25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:58.267305 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20ea24-e6bd-4c57-bf4b-8d7293a1aa25 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:58.279188 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 979/1912] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:58.283447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342cd79-2568-4646-8a3e-7db314f9c3d6 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:58.294714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342cd79-2568-4646-8a3e-7db314f9c3d6 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:58.299386 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779d7d9-fda0-494d-80ba-87c34c29603b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:58.300292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779d7d9-fda0-494d-80ba-87c34c29603b admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:58.300569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779d7d9-fda0-494d-80ba-87c34c29603b admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:58.300868 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779d7d9-fda0-494d-80ba-87c34c29603b admin admin] PATH_INFO: `/v3/projects/1febf381d67a4ca7bf0a9514820ffa9a/users/6f417bed6d9e413bbe60a159487e22c4/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:58.315486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779d7d9-fda0-494d-80ba-87c34c29603b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1febf381d67a4ca7bf0a9514820ffa9a, user_id=6f417bed6d9e413bbe60a159487e22c4, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:58.318158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779d7d9-fda0-494d-80ba-87c34c29603b admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:58.331420 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 934/1913] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:58 2022] PUT /identity/v3/projects/1febf381d67a4ca7bf0a9514820ffa9a/users/6f417bed6d9e413bbe60a159487e22c4/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:58.335650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20ea24-e6bd-4c57-bf4b-8d7293a1aa25 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:58.346919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20ea24-e6bd-4c57-bf4b-8d7293a1aa25 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:58.409141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ec08d-451d-4763-9a35-c5dbc54b776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:58.409814 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ec08d-451d-4763-9a35-c5dbc54b776e admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:58.410095 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ec08d-451d-4763-9a35-c5dbc54b776e admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:58.410371 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ec08d-451d-4763-9a35-c5dbc54b776e admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:58.411096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ec08d-451d-4763-9a35-c5dbc54b776e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:58.412848 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ec08d-451d-4763-9a35-c5dbc54b776e admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:58.423082 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 980/1914] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:00:58.427348 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779d7d9-fda0-494d-80ba-87c34c29603b admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:58.438380 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779d7d9-fda0-494d-80ba-87c34c29603b admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:58.443229 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27b7d0-7603-41ac-8f80-d3e56ecba70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:58.444109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27b7d0-7603-41ac-8f80-d3e56ecba70c admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:58.444422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27b7d0-7603-41ac-8f80-d3e56ecba70c admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:58.444696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27b7d0-7603-41ac-8f80-d3e56ecba70c admin admin] PATH_INFO: `/v3/projects/1febf381d67a4ca7bf0a9514820ffa9a/users/6f417bed6d9e413bbe60a159487e22c4/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:58.446682 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27b7d0-7603-41ac-8f80-d3e56ecba70c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1febf381d67a4ca7bf0a9514820ffa9a, user_id=6f417bed6d9e413bbe60a159487e22c4, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:58.449479 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27b7d0-7603-41ac-8f80-d3e56ecba70c admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:58.459605 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 935/1915] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:00:58 2022] PUT /identity/v3/projects/1febf381d67a4ca7bf0a9514820ffa9a/users/6f417bed6d9e413bbe60a159487e22c4/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:00:58.471547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe366c-2ec0-4f22-8b95-6da2919f2e06 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:58.471778 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe366c-2ec0-4f22-8b95-6da2919f2e06 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:58.472054 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe366c-2ec0-4f22-8b95-6da2919f2e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:58.498635 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-84fe366c-2ec0-4f22-8b95-6da2919f2e06 None None] MFA Rules not processed for user `6f417bed6d9e413bbe60a159487e22c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:58.499833 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-84fe366c-2ec0-4f22-8b95-6da2919f2e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:58.573192 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 981/1916] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:58.584556 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27b7d0-7603-41ac-8f80-d3e56ecba70c admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:58.586485 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-af27b7d0-7603-41ac-8f80-d3e56ecba70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:58.648104 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27b7d0-7603-41ac-8f80-d3e56ecba70c admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:58.652763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c78fee-922d-4101-9e7f-b0378a7c7bbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:58.653402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c78fee-922d-4101-9e7f-b0378a7c7bbb service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:58.653681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c78fee-922d-4101-9e7f-b0378a7c7bbb service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:58.653952 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c78fee-922d-4101-9e7f-b0378a7c7bbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:58.663443 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c78fee-922d-4101-9e7f-b0378a7c7bbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:58.664896 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c78fee-922d-4101-9e7f-b0378a7c7bbb service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:58.675138 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 936/1917] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:00:59.319490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe366c-2ec0-4f22-8b95-6da2919f2e06 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:59.382124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe366c-2ec0-4f22-8b95-6da2919f2e06 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:59.387726 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c83757-65e8-4257-b721-59c0f7f57a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:59.389347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c83757-65e8-4257-b721-59c0f7f57a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:59.389347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c83757-65e8-4257-b721-59c0f7f57a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:59.389515 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c83757-65e8-4257-b721-59c0f7f57a52 admin admin] PATH_INFO: `/v3/users/a08b97150dae4bcda1d2fb1e8a182d7b` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:59.390756 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c83757-65e8-4257-b721-59c0f7f57a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a08b97150dae4bcda1d2fb1e8a182d7b)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:59.392841 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c83757-65e8-4257-b721-59c0f7f57a52 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:59.438753 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-60c83757-65e8-4257-b721-59c0f7f57a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a08b97150dae4bcda1d2fb1e8a182d7b'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:59.451013 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-60c83757-65e8-4257-b721-59c0f7f57a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a08b97150dae4bcda1d2fb1e8a182d7b'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:59.457901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-60c83757-65e8-4257-b721-59c0f7f57a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a08b97150dae4bcda1d2fb1e8a182d7b'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:59.458585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-60c83757-65e8-4257-b721-59c0f7f57a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a08b97150dae4bcda1d2fb1e8a182d7b'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:59.466702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-60c83757-65e8-4257-b721-59c0f7f57a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a08b97150dae4bcda1d2fb1e8a182d7b'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:00:59.474451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 982/1918] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:00:59 2022] DELETE /identity/v3/users/a08b97150dae4bcda1d2fb1e8a182d7b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:00:59.481717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92540685-4fa6-4da1-bb04-0d48c0960372 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:59.482475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92540685-4fa6-4da1-bb04-0d48c0960372 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:59.482475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92540685-4fa6-4da1-bb04-0d48c0960372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:59.501358 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-92540685-4fa6-4da1-bb04-0d48c0960372 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:00:59.502598 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-92540685-4fa6-4da1-bb04-0d48c0960372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:59.566600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 937/1919] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:00:59.576377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c83757-65e8-4257-b721-59c0f7f57a52 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:00:59.577843 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-60c83757-65e8-4257-b721-59c0f7f57a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:00:59.634578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c83757-65e8-4257-b721-59c0f7f57a52 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:00:59.638336 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319271d-7e3f-4b84-9b08-23647784787c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:00:59.638986 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319271d-7e3f-4b84-9b08-23647784787c service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:00:59.639268 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319271d-7e3f-4b84-9b08-23647784787c service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:00:59.639544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319271d-7e3f-4b84-9b08-23647784787c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:00:59.649438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319271d-7e3f-4b84-9b08-23647784787c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:00:59.650902 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319271d-7e3f-4b84-9b08-23647784787c service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:00:59.661309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 983/1920] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:00.010859 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92540685-4fa6-4da1-bb04-0d48c0960372 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:00.012328 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-92540685-4fa6-4da1-bb04-0d48c0960372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:00.024346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92540685-4fa6-4da1-bb04-0d48c0960372 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:00.029396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a27131-0952-455d-b8c1-9306b754153c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:00.030246 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a27131-0952-455d-b8c1-9306b754153c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:00.030522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a27131-0952-455d-b8c1-9306b754153c admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:00.030794 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a27131-0952-455d-b8c1-9306b754153c admin admin] PATH_INFO: `/v3/projects/945f814876b948f9a806e4654e9b6ae5` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:00.031966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a27131-0952-455d-b8c1-9306b754153c admin admin] RBAC: Authorizing `identity:delete_project(project_id=945f814876b948f9a806e4654e9b6ae5)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:00.033887 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a27131-0952-455d-b8c1-9306b754153c admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:00.077405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-10a27131-0952-455d-b8c1-9306b754153c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945f814876b948f9a806e4654e9b6ae5', 'request_id': 'req-10a27131-0952-455d-b8c1-9306b754153c'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:00.082668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-10a27131-0952-455d-b8c1-9306b754153c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945f814876b948f9a806e4654e9b6ae5', 'request_id': 'req-10a27131-0952-455d-b8c1-9306b754153c'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:00.088646 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-10a27131-0952-455d-b8c1-9306b754153c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945f814876b948f9a806e4654e9b6ae5', 'request_id': 'req-10a27131-0952-455d-b8c1-9306b754153c'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:00.102837 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-10a27131-0952-455d-b8c1-9306b754153c admin admin] The token cache is being invalidate because project 945f814876b948f9a806e4654e9b6ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:00.103125 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-10a27131-0952-455d-b8c1-9306b754153c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:00.103762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-10a27131-0952-455d-b8c1-9306b754153c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:00.105933 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 938/1921] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:00 2022] DELETE /identity/v3/projects/945f814876b948f9a806e4654e9b6ae5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:00.109844 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319271d-7e3f-4b84-9b08-23647784787c service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:00.119613 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319271d-7e3f-4b84-9b08-23647784787c service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:00.176956 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0d8ae-fe41-428f-839e-dff1aa96c8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:00.177836 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0d8ae-fe41-428f-839e-dff1aa96c8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:00.178110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0d8ae-fe41-428f-839e-dff1aa96c8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:00.178380 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0d8ae-fe41-428f-839e-dff1aa96c8d6 admin admin] PATH_INFO: `/v3/users/6f417bed6d9e413bbe60a159487e22c4` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:00.179586 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0d8ae-fe41-428f-839e-dff1aa96c8d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f417bed6d9e413bbe60a159487e22c4)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:00.181536 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0d8ae-fe41-428f-839e-dff1aa96c8d6 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:00.237328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-92c0d8ae-fe41-428f-839e-dff1aa96c8d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f417bed6d9e413bbe60a159487e22c4'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:00.249742 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-92c0d8ae-fe41-428f-839e-dff1aa96c8d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f417bed6d9e413bbe60a159487e22c4'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:00.256470 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-92c0d8ae-fe41-428f-839e-dff1aa96c8d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f417bed6d9e413bbe60a159487e22c4'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:00.257261 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-92c0d8ae-fe41-428f-839e-dff1aa96c8d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f417bed6d9e413bbe60a159487e22c4'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:00.267100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-92c0d8ae-fe41-428f-839e-dff1aa96c8d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f417bed6d9e413bbe60a159487e22c4'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:00.273646 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 984/1922] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:00 2022] DELETE /identity/v3/users/6f417bed6d9e413bbe60a159487e22c4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:00.533748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a27131-0952-455d-b8c1-9306b754153c admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:00.535771 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-10a27131-0952-455d-b8c1-9306b754153c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:00.548322 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a27131-0952-455d-b8c1-9306b754153c admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:00.610261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547849e9-9deb-4138-bb2f-61f5fa1e8325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:00.611158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547849e9-9deb-4138-bb2f-61f5fa1e8325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:00.611425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547849e9-9deb-4138-bb2f-61f5fa1e8325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:00.611742 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547849e9-9deb-4138-bb2f-61f5fa1e8325 admin admin] PATH_INFO: `/v3/projects/1febf381d67a4ca7bf0a9514820ffa9a` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:00.612924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547849e9-9deb-4138-bb2f-61f5fa1e8325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1febf381d67a4ca7bf0a9514820ffa9a)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:00.614804 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547849e9-9deb-4138-bb2f-61f5fa1e8325 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:00.658616 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-547849e9-9deb-4138-bb2f-61f5fa1e8325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1febf381d67a4ca7bf0a9514820ffa9a', 'request_id': 'req-547849e9-9deb-4138-bb2f-61f5fa1e8325'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:00.663716 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-547849e9-9deb-4138-bb2f-61f5fa1e8325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1febf381d67a4ca7bf0a9514820ffa9a', 'request_id': 'req-547849e9-9deb-4138-bb2f-61f5fa1e8325'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:00.669582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-547849e9-9deb-4138-bb2f-61f5fa1e8325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1febf381d67a4ca7bf0a9514820ffa9a', 'request_id': 'req-547849e9-9deb-4138-bb2f-61f5fa1e8325'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:00.680821 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-547849e9-9deb-4138-bb2f-61f5fa1e8325 admin admin] The token cache is being invalidate because project 1febf381d67a4ca7bf0a9514820ffa9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:00.681102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-547849e9-9deb-4138-bb2f-61f5fa1e8325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:00.681713 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-547849e9-9deb-4138-bb2f-61f5fa1e8325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:00.683749 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 939/1923] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:00 2022] DELETE /identity/v3/projects/1febf381d67a4ca7bf0a9514820ffa9a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:00.688626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658e613-c543-438e-99c4-9cf8d0fc3041 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:00.689114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658e613-c543-438e-99c4-9cf8d0fc3041 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:00.689206 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658e613-c543-438e-99c4-9cf8d0fc3041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:00.710133 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-b658e613-c543-438e-99c4-9cf8d0fc3041 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:00.711338 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b658e613-c543-438e-99c4-9cf8d0fc3041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:00.773769 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 985/1924] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:00.781690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b15d8c-230e-47b5-8fb0-846386c20a0e None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:00.782051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b15d8c-230e-47b5-8fb0-846386c20a0e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:00.782497 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b15d8c-230e-47b5-8fb0-846386c20a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:00.802600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-79b15d8c-230e-47b5-8fb0-846386c20a0e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:00.803799 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-79b15d8c-230e-47b5-8fb0-846386c20a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:00.812423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 940/1925] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:00.816693 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658e613-c543-438e-99c4-9cf8d0fc3041 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:00.829354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658e613-c543-438e-99c4-9cf8d0fc3041 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:00.834012 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66cb39-4a2a-408a-b806-46913897de40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:00.834673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66cb39-4a2a-408a-b806-46913897de40 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:00.834955 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66cb39-4a2a-408a-b806-46913897de40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:00.835231 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66cb39-4a2a-408a-b806-46913897de40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:00.836038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66cb39-4a2a-408a-b806-46913897de40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:00.836383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66cb39-4a2a-408a-b806-46913897de40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:00.837963 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66cb39-4a2a-408a-b806-46913897de40 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:00.849628 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 986/1926] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:01:00.853871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b15d8c-230e-47b5-8fb0-846386c20a0e None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:00.863065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b15d8c-230e-47b5-8fb0-846386c20a0e None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:00.867628 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995f786-4c53-43b7-b210-24bd98f34da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:00.868326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995f786-4c53-43b7-b210-24bd98f34da7 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:00.868608 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995f786-4c53-43b7-b210-24bd98f34da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:00.868880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995f786-4c53-43b7-b210-24bd98f34da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:00.869660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995f786-4c53-43b7-b210-24bd98f34da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:00.872087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995f786-4c53-43b7-b210-24bd98f34da7 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:00.897299 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 941/1927] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:00 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:00.901572 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66cb39-4a2a-408a-b806-46913897de40 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:00.911208 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66cb39-4a2a-408a-b806-46913897de40 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:00.967631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128919de-2f54-472f-b7fc-697e001868f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:00.968452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128919de-2f54-472f-b7fc-697e001868f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:00.968741 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128919de-2f54-472f-b7fc-697e001868f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:00.969052 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128919de-2f54-472f-b7fc-697e001868f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:00.969809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128919de-2f54-472f-b7fc-697e001868f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:00.979309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128919de-2f54-472f-b7fc-697e001868f2 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:01.004199 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 987/1928] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:00 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:01.015062 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995f786-4c53-43b7-b210-24bd98f34da7 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:01.025464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995f786-4c53-43b7-b210-24bd98f34da7 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:01.030177 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b84911-691d-41a3-aeb9-f96d21adef0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:01.030836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b84911-691d-41a3-aeb9-f96d21adef0e admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:01.031118 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b84911-691d-41a3-aeb9-f96d21adef0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:01.031387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b84911-691d-41a3-aeb9-f96d21adef0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:01.032136 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b84911-691d-41a3-aeb9-f96d21adef0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:01.033751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b84911-691d-41a3-aeb9-f96d21adef0e admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:01.045622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 942/1929] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:01.049610 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128919de-2f54-472f-b7fc-697e001868f2 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:01.059610 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128919de-2f54-472f-b7fc-697e001868f2 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:01.064952 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d8525-7108-4c3d-869e-19a1b960c208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:01.065701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d8525-7108-4c3d-869e-19a1b960c208 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:01.065892 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d8525-7108-4c3d-869e-19a1b960c208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:01.066302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d8525-7108-4c3d-869e-19a1b960c208 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:01.067031 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d8525-7108-4c3d-869e-19a1b960c208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:01.068649 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d8525-7108-4c3d-869e-19a1b960c208 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:01.078934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 988/1930] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:01.082919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b84911-691d-41a3-aeb9-f96d21adef0e admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:01.092712 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b84911-691d-41a3-aeb9-f96d21adef0e admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:01.097307 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4754a-b267-41f2-8100-69231827cb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:01.098172 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4754a-b267-41f2-8100-69231827cb0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:01.098450 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4754a-b267-41f2-8100-69231827cb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:01.098723 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4754a-b267-41f2-8100-69231827cb0e admin admin] PATH_INFO: `/v3/projects/ef544062524b487693cb622a13c763b8/users/96accf2f3bb1461abbca6b3373a4336a/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:01.113140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4754a-b267-41f2-8100-69231827cb0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef544062524b487693cb622a13c763b8, user_id=96accf2f3bb1461abbca6b3373a4336a, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:01.115683 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4754a-b267-41f2-8100-69231827cb0e admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:01.129074 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 943/1931] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:01 2022] PUT /identity/v3/projects/ef544062524b487693cb622a13c763b8/users/96accf2f3bb1461abbca6b3373a4336a/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:01.140263 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da9288-372b-418c-8ab3-ad8d340d73fa None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:01.140580 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da9288-372b-418c-8ab3-ad8d340d73fa None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:01.140861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da9288-372b-418c-8ab3-ad8d340d73fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:01.166477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-51da9288-372b-418c-8ab3-ad8d340d73fa None None] MFA Rules not processed for user `96accf2f3bb1461abbca6b3373a4336a`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:01.168313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-51da9288-372b-418c-8ab3-ad8d340d73fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:01.228962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 989/1932] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:01.233851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4754a-b267-41f2-8100-69231827cb0e admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:01.294579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4754a-b267-41f2-8100-69231827cb0e admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:01.302820 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a078c0-4e7a-452e-b1a6-4c791126d98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:01.303657 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a078c0-4e7a-452e-b1a6-4c791126d98a admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:01.303941 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a078c0-4e7a-452e-b1a6-4c791126d98a admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:01.304371 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a078c0-4e7a-452e-b1a6-4c791126d98a admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:01.305084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a078c0-4e7a-452e-b1a6-4c791126d98a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:01.307016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a078c0-4e7a-452e-b1a6-4c791126d98a admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:01.342427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 944/1933] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:01 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:01.342537 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da9288-372b-418c-8ab3-ad8d340d73fa None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:01.349764 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da9288-372b-418c-8ab3-ad8d340d73fa None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:01.408224 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230462a7-2166-411a-9b3b-95b9a18f3064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:01.408904 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230462a7-2166-411a-9b3b-95b9a18f3064 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:01.409188 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230462a7-2166-411a-9b3b-95b9a18f3064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:01.409462 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230462a7-2166-411a-9b3b-95b9a18f3064 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:01.410182 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230462a7-2166-411a-9b3b-95b9a18f3064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:01.412066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230462a7-2166-411a-9b3b-95b9a18f3064 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:01.431308 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 990/1934] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:01 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:01.435632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a078c0-4e7a-452e-b1a6-4c791126d98a admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:01.445617 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a078c0-4e7a-452e-b1a6-4c791126d98a admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:01.450727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf13f6-c14d-4c78-8377-bde4600a2ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:01.451368 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf13f6-c14d-4c78-8377-bde4600a2ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:01.451644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf13f6-c14d-4c78-8377-bde4600a2ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:01.451921 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf13f6-c14d-4c78-8377-bde4600a2ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:01.452670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf13f6-c14d-4c78-8377-bde4600a2ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:01.454238 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf13f6-c14d-4c78-8377-bde4600a2ee6 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:01.464218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 945/1935] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:01.467936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230462a7-2166-411a-9b3b-95b9a18f3064 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:01.477639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230462a7-2166-411a-9b3b-95b9a18f3064 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:01.482249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947300b-31a4-4ee5-8c9b-02cefc594dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:01.483110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947300b-31a4-4ee5-8c9b-02cefc594dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:01.483391 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947300b-31a4-4ee5-8c9b-02cefc594dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:01.483668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947300b-31a4-4ee5-8c9b-02cefc594dd3 admin admin] PATH_INFO: `/v3/projects/04a559fdf81f404a9a321a8f355664c0/users/04e2b0e1cf5f421b9c9f2c79a00c7d18/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:01.498298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947300b-31a4-4ee5-8c9b-02cefc594dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a559fdf81f404a9a321a8f355664c0, user_id=04e2b0e1cf5f421b9c9f2c79a00c7d18, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:01.501035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947300b-31a4-4ee5-8c9b-02cefc594dd3 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:01.513859 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 991/1936] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:01 2022] PUT /identity/v3/projects/04a559fdf81f404a9a321a8f355664c0/users/04e2b0e1cf5f421b9c9f2c79a00c7d18/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:01.517631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf13f6-c14d-4c78-8377-bde4600a2ee6 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:01.527594 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf13f6-c14d-4c78-8377-bde4600a2ee6 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:01.582683 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a0feb-0ed7-431f-86aa-2468e55c893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:01.583351 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a0feb-0ed7-431f-86aa-2468e55c893d admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:01.583660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a0feb-0ed7-431f-86aa-2468e55c893d admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:01.583930 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a0feb-0ed7-431f-86aa-2468e55c893d admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:01.584727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a0feb-0ed7-431f-86aa-2468e55c893d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:01.586481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a0feb-0ed7-431f-86aa-2468e55c893d admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:01.596466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 946/1937] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:01.600582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947300b-31a4-4ee5-8c9b-02cefc594dd3 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:01.610647 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947300b-31a4-4ee5-8c9b-02cefc594dd3 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:01.615843 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6626f8-6c7e-4b57-b048-aa7bc67369cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:01.616744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6626f8-6c7e-4b57-b048-aa7bc67369cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:01.617025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6626f8-6c7e-4b57-b048-aa7bc67369cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:01.617295 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6626f8-6c7e-4b57-b048-aa7bc67369cb admin admin] PATH_INFO: `/v3/projects/04a559fdf81f404a9a321a8f355664c0/users/04e2b0e1cf5f421b9c9f2c79a00c7d18/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:01.621202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6626f8-6c7e-4b57-b048-aa7bc67369cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a559fdf81f404a9a321a8f355664c0, user_id=04e2b0e1cf5f421b9c9f2c79a00c7d18, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:01.623823 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6626f8-6c7e-4b57-b048-aa7bc67369cb admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:01.634279 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 992/1938] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:01 2022] PUT /identity/v3/projects/04a559fdf81f404a9a321a8f355664c0/users/04e2b0e1cf5f421b9c9f2c79a00c7d18/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:01.645871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450626c7-f6ca-4afc-85f3-efa78d42699a None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:01.646145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450626c7-f6ca-4afc-85f3-efa78d42699a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:01.646478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450626c7-f6ca-4afc-85f3-efa78d42699a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:01.672401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-450626c7-f6ca-4afc-85f3-efa78d42699a None None] MFA Rules not processed for user `04e2b0e1cf5f421b9c9f2c79a00c7d18`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:01.673576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-450626c7-f6ca-4afc-85f3-efa78d42699a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:01.740150 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 947/1939] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:01.752094 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6626f8-6c7e-4b57-b048-aa7bc67369cb admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:01.753839 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ec6626f8-6c7e-4b57-b048-aa7bc67369cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:01.814878 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6626f8-6c7e-4b57-b048-aa7bc67369cb admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:01.819725 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73054f16-1775-486c-b77e-7351476c7cc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:01.820504 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73054f16-1775-486c-b77e-7351476c7cc0 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:01.820790 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73054f16-1775-486c-b77e-7351476c7cc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:01.821065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73054f16-1775-486c-b77e-7351476c7cc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:01.831156 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73054f16-1775-486c-b77e-7351476c7cc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:01.832639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73054f16-1775-486c-b77e-7351476c7cc0 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:01.841979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 993/1940] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:01.910024 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450626c7-f6ca-4afc-85f3-efa78d42699a None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:01.919949 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450626c7-f6ca-4afc-85f3-efa78d42699a None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:01.923544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a9edc-42ed-49a2-919c-b80fa3c06833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:01.924192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a9edc-42ed-49a2-919c-b80fa3c06833 service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:01.924477 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a9edc-42ed-49a2-919c-b80fa3c06833 service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:01.924746 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a9edc-42ed-49a2-919c-b80fa3c06833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:01.977802 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a9edc-42ed-49a2-919c-b80fa3c06833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:01.979244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a9edc-42ed-49a2-919c-b80fa3c06833 service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:01.988520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 948/1941] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:02.267719 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73054f16-1775-486c-b77e-7351476c7cc0 service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:02.364121 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73054f16-1775-486c-b77e-7351476c7cc0 service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:02.371560 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a9edc-42ed-49a2-919c-b80fa3c06833 service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:02.372159 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273d634-5718-4e90-b431-4d9c2f54bd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:02.373214 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273d634-5718-4e90-b431-4d9c2f54bd07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:02.373367 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-e58a9edc-42ed-49a2-919c-b80fa3c06833 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:02.373962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273d634-5718-4e90-b431-4d9c2f54bd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:02.374326 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273d634-5718-4e90-b431-4d9c2f54bd07 admin admin] PATH_INFO: `/v3/users/96accf2f3bb1461abbca6b3373a4336a` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:02.375944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273d634-5718-4e90-b431-4d9c2f54bd07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96accf2f3bb1461abbca6b3373a4336a)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:02.378553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273d634-5718-4e90-b431-4d9c2f54bd07 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:02.393005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a9edc-42ed-49a2-919c-b80fa3c06833 service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:02.399875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbd567-0ead-4b36-87d5-51c1a8f5134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:02.401118 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbd567-0ead-4b36-87d5-51c1a8f5134b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:02.401635 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbd567-0ead-4b36-87d5-51c1a8f5134b admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:02.402059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbd567-0ead-4b36-87d5-51c1a8f5134b admin admin] PATH_INFO: `/v3/users/f21858ab496d4753b11b441eaf87378c` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:02.403547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbd567-0ead-4b36-87d5-51c1a8f5134b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21858ab496d4753b11b441eaf87378c)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:02.405789 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbd567-0ead-4b36-87d5-51c1a8f5134b admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:02.463744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2273d634-5718-4e90-b431-4d9c2f54bd07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96accf2f3bb1461abbca6b3373a4336a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:02.495038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2273d634-5718-4e90-b431-4d9c2f54bd07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96accf2f3bb1461abbca6b3373a4336a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:02.512122 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2273d634-5718-4e90-b431-4d9c2f54bd07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96accf2f3bb1461abbca6b3373a4336a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:02.513717 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2273d634-5718-4e90-b431-4d9c2f54bd07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96accf2f3bb1461abbca6b3373a4336a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:02.514352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-6ebbd567-0ead-4b36-87d5-51c1a8f5134b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21858ab496d4753b11b441eaf87378c'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:02.517649 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-6ebbd567-0ead-4b36-87d5-51c1a8f5134b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21858ab496d4753b11b441eaf87378c'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:02.524686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2273d634-5718-4e90-b431-4d9c2f54bd07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96accf2f3bb1461abbca6b3373a4336a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:02.533357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 994/1942] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:02 2022] DELETE /identity/v3/users/96accf2f3bb1461abbca6b3373a4336a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:02.540680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d97139-6769-477a-99e6-b8c40e05c0f2 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:02.541255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d97139-6769-477a-99e6-b8c40e05c0f2 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:02.541773 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d97139-6769-477a-99e6-b8c40e05c0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:02.546318 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-6ebbd567-0ead-4b36-87d5-51c1a8f5134b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21858ab496d4753b11b441eaf87378c'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:02.556725 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-6ebbd567-0ead-4b36-87d5-51c1a8f5134b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21858ab496d4753b11b441eaf87378c'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:02.559557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-6ebbd567-0ead-4b36-87d5-51c1a8f5134b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21858ab496d4753b11b441eaf87378c'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:02.566300 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-c1d97139-6769-477a-99e6-b8c40e05c0f2 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:02.567909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c1d97139-6769-477a-99e6-b8c40e05c0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:02.575686 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 949/1943] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:02 2022] DELETE /identity/v3/users/f21858ab496d4753b11b441eaf87378c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:02.580499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7949258-a024-40af-bae7-8440dd369a83 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:02.581263 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7949258-a024-40af-bae7-8440dd369a83 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:02.581693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7949258-a024-40af-bae7-8440dd369a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:02.626215 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-f7949258-a024-40af-bae7-8440dd369a83 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:02.627451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-f7949258-a024-40af-bae7-8440dd369a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:02.651983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 995/1944] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:02.659244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d97139-6769-477a-99e6-b8c40e05c0f2 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:02.660635 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c1d97139-6769-477a-99e6-b8c40e05c0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:02.693186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 950/1945] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:02.704107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7949258-a024-40af-bae7-8440dd369a83 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:02.707004 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-f7949258-a024-40af-bae7-8440dd369a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:02.719010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d97139-6769-477a-99e6-b8c40e05c0f2 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:02.762267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7949258-a024-40af-bae7-8440dd369a83 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:02.765566 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b67e4b-8172-44af-a40a-e0ab5387c18b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:02.766034 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc2baf-6ba3-4b58-8ce4-a59dfdc22ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:02.766375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b67e4b-8172-44af-a40a-e0ab5387c18b service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:02.766506 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc2baf-6ba3-4b58-8ce4-a59dfdc22ecf service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:02.766655 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b67e4b-8172-44af-a40a-e0ab5387c18b service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:02.766786 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc2baf-6ba3-4b58-8ce4-a59dfdc22ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:02.766924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b67e4b-8172-44af-a40a-e0ab5387c18b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:02.767059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc2baf-6ba3-4b58-8ce4-a59dfdc22ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:02.776310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc2baf-6ba3-4b58-8ce4-a59dfdc22ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:02.776486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b67e4b-8172-44af-a40a-e0ab5387c18b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:02.777757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc2baf-6ba3-4b58-8ce4-a59dfdc22ecf service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:02.777855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b67e4b-8172-44af-a40a-e0ab5387c18b service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:02.786999 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 996/1946] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:02.787511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 951/1947] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:03.165813 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b67e4b-8172-44af-a40a-e0ab5387c18b service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:03.167575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-75b67e4b-8172-44af-a40a-e0ab5387c18b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:03.189202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc2baf-6ba3-4b58-8ce4-a59dfdc22ecf service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:03.192482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b67e4b-8172-44af-a40a-e0ab5387c18b service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:03.192939 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-99cc2baf-6ba3-4b58-8ce4-a59dfdc22ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:03.209984 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b43ff1-670c-4291-93f3-fe46b720e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:03.211500 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b43ff1-670c-4291-93f3-fe46b720e742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:03.212195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b43ff1-670c-4291-93f3-fe46b720e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:03.213745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b43ff1-670c-4291-93f3-fe46b720e742 admin admin] PATH_INFO: `/v3/projects/ef544062524b487693cb622a13c763b8` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:03.214963 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc2baf-6ba3-4b58-8ce4-a59dfdc22ecf service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:03.217988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b43ff1-670c-4291-93f3-fe46b720e742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef544062524b487693cb622a13c763b8)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:03.222495 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b43ff1-670c-4291-93f3-fe46b720e742 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:03.228682 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:03.231835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:03.232530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:03.235837 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d admin admin] PATH_INFO: `/v3/projects/7f20600f569f42109476f7433433bbef` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:03.238701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f20600f569f42109476f7433433bbef)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:03.241073 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:03.305557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a1b43ff1-670c-4291-93f3-fe46b720e742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef544062524b487693cb622a13c763b8', 'request_id': 'req-a1b43ff1-670c-4291-93f3-fe46b720e742'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.319152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a1b43ff1-670c-4291-93f3-fe46b720e742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef544062524b487693cb622a13c763b8', 'request_id': 'req-a1b43ff1-670c-4291-93f3-fe46b720e742'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.319571 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f20600f569f42109476f7433433bbef', 'request_id': 'req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.326419 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a1b43ff1-670c-4291-93f3-fe46b720e742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef544062524b487693cb622a13c763b8', 'request_id': 'req-a1b43ff1-670c-4291-93f3-fe46b720e742'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.331558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f20600f569f42109476f7433433bbef', 'request_id': 'req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.339808 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f20600f569f42109476f7433433bbef', 'request_id': 'req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.355834 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a1b43ff1-670c-4291-93f3-fe46b720e742 admin admin] The token cache is being invalidate because project ef544062524b487693cb622a13c763b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:03.356428 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a1b43ff1-670c-4291-93f3-fe46b720e742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.358168 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a1b43ff1-670c-4291-93f3-fe46b720e742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.361135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 997/1948] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:03 2022] DELETE /identity/v3/projects/ef544062524b487693cb622a13c763b8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:03.364774 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b43ff1-670c-4291-93f3-fe46b720e742 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:03.366744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a1b43ff1-670c-4291-93f3-fe46b720e742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:03.369088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d admin admin] The token cache is being invalidate because project 7f20600f569f42109476f7433433bbef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:03.369351 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.371947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.377412 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 952/1949] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:03 2022] DELETE /identity/v3/projects/7f20600f569f42109476f7433433bbef => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:03.379468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:03.382384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:03.460465 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b43ff1-670c-4291-93f3-fe46b720e742 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:03.549598 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e29fa6-4e93-4cd7-9d0f-f72921eb678d admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:03.563284 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc22eb4-09b0-4e1a-bcf1-2490e2e6f042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:03.564506 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc22eb4-09b0-4e1a-bcf1-2490e2e6f042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:03.564795 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc22eb4-09b0-4e1a-bcf1-2490e2e6f042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:03.565171 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc22eb4-09b0-4e1a-bcf1-2490e2e6f042 admin admin] PATH_INFO: `/v3/users/4fa5c06aba5e43d8bcc24d1fc0c39afb` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:03.575023 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc22eb4-09b0-4e1a-bcf1-2490e2e6f042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa5c06aba5e43d8bcc24d1fc0c39afb)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:03.575736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a025377-3d78-4892-9c09-e8e92ffe1b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:03.575736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a025377-3d78-4892-9c09-e8e92ffe1b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:03.575947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc22eb4-09b0-4e1a-bcf1-2490e2e6f042 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:03.576036 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a025377-3d78-4892-9c09-e8e92ffe1b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:03.576036 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a025377-3d78-4892-9c09-e8e92ffe1b4d admin admin] PATH_INFO: `/v3/users/04e2b0e1cf5f421b9c9f2c79a00c7d18` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:03.576036 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a025377-3d78-4892-9c09-e8e92ffe1b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e2b0e1cf5f421b9c9f2c79a00c7d18)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:03.576036 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a025377-3d78-4892-9c09-e8e92ffe1b4d admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:03.656644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cbc22eb4-09b0-4e1a-bcf1-2490e2e6f042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa5c06aba5e43d8bcc24d1fc0c39afb'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.657644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cbc22eb4-09b0-4e1a-bcf1-2490e2e6f042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa5c06aba5e43d8bcc24d1fc0c39afb'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.668391 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8a025377-3d78-4892-9c09-e8e92ffe1b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e2b0e1cf5f421b9c9f2c79a00c7d18'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.681916 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cbc22eb4-09b0-4e1a-bcf1-2490e2e6f042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa5c06aba5e43d8bcc24d1fc0c39afb'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.695053 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8a025377-3d78-4892-9c09-e8e92ffe1b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e2b0e1cf5f421b9c9f2c79a00c7d18'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.700011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cbc22eb4-09b0-4e1a-bcf1-2490e2e6f042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa5c06aba5e43d8bcc24d1fc0c39afb'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.700788 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cbc22eb4-09b0-4e1a-bcf1-2490e2e6f042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa5c06aba5e43d8bcc24d1fc0c39afb'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.715020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8a025377-3d78-4892-9c09-e8e92ffe1b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e2b0e1cf5f421b9c9f2c79a00c7d18'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.716163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8a025377-3d78-4892-9c09-e8e92ffe1b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e2b0e1cf5f421b9c9f2c79a00c7d18'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.724212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 953/1950] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:03 2022] DELETE /identity/v3/users/4fa5c06aba5e43d8bcc24d1fc0c39afb => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:03.750009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8a025377-3d78-4892-9c09-e8e92ffe1b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e2b0e1cf5f421b9c9f2c79a00c7d18'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:03.764237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 998/1951] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:03 2022] DELETE /identity/v3/users/04e2b0e1cf5f421b9c9f2c79a00c7d18 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:04.423922 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc22eb4-09b0-4e1a-bcf1-2490e2e6f042 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:04.426054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-cbc22eb4-09b0-4e1a-bcf1-2490e2e6f042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:04.514786 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc22eb4-09b0-4e1a-bcf1-2490e2e6f042 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:04.572535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599845db-e535-4e4e-abb8-f15208897ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:04.573455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599845db-e535-4e4e-abb8-f15208897ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:04.573883 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599845db-e535-4e4e-abb8-f15208897ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:04.574171 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599845db-e535-4e4e-abb8-f15208897ce8 admin admin] PATH_INFO: `/v3/projects/04a559fdf81f404a9a321a8f355664c0` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:04.575425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599845db-e535-4e4e-abb8-f15208897ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a559fdf81f404a9a321a8f355664c0)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:04.577395 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599845db-e535-4e4e-abb8-f15208897ce8 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:04.631303 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-599845db-e535-4e4e-abb8-f15208897ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a559fdf81f404a9a321a8f355664c0', 'request_id': 'req-599845db-e535-4e4e-abb8-f15208897ce8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:04.637922 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-599845db-e535-4e4e-abb8-f15208897ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a559fdf81f404a9a321a8f355664c0', 'request_id': 'req-599845db-e535-4e4e-abb8-f15208897ce8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:04.645955 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-599845db-e535-4e4e-abb8-f15208897ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a559fdf81f404a9a321a8f355664c0', 'request_id': 'req-599845db-e535-4e4e-abb8-f15208897ce8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:04.668804 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-599845db-e535-4e4e-abb8-f15208897ce8 admin admin] The token cache is being invalidate because project 04a559fdf81f404a9a321a8f355664c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:04.669417 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-599845db-e535-4e4e-abb8-f15208897ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:04.670148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-599845db-e535-4e4e-abb8-f15208897ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:04.672376 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 954/1952] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:04 2022] DELETE /identity/v3/projects/04a559fdf81f404a9a321a8f355664c0 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:04.677311 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd958a22-f5b2-4d93-ac04-f3da736ff7df None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:04.677771 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd958a22-f5b2-4d93-ac04-f3da736ff7df None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:04.678051 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd958a22-f5b2-4d93-ac04-f3da736ff7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:04.701244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-cd958a22-f5b2-4d93-ac04-f3da736ff7df None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:04.702941 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cd958a22-f5b2-4d93-ac04-f3da736ff7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:04.816630 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 999/1953] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:04.829016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8a3c2-91bc-4dcd-8845-c4aebb2f7d08 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:04.829309 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8a3c2-91bc-4dcd-8845-c4aebb2f7d08 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:04.829588 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8a3c2-91bc-4dcd-8845-c4aebb2f7d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:04.838427 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd958a22-f5b2-4d93-ac04-f3da736ff7df None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:04.843668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cd958a22-f5b2-4d93-ac04-f3da736ff7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:04.864697 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-c3a8a3c2-91bc-4dcd-8845-c4aebb2f7d08 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:04.866155 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-c3a8a3c2-91bc-4dcd-8845-c4aebb2f7d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:04.869003 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd958a22-f5b2-4d93-ac04-f3da736ff7df None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:04.884959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95ac96-b098-46cb-969f-7bc1dcc51e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:04.888973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95ac96-b098-46cb-969f-7bc1dcc51e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:04.889607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95ac96-b098-46cb-969f-7bc1dcc51e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:04.890100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95ac96-b098-46cb-969f-7bc1dcc51e8b admin admin] PATH_INFO: `/v3/projects/36357f281754485896edfb96ce3a594d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:04.894048 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 955/1954] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:04.905468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8a3c2-91bc-4dcd-8845-c4aebb2f7d08 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:04.908428 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95ac96-b098-46cb-969f-7bc1dcc51e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=36357f281754485896edfb96ce3a594d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:04.912826 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95ac96-b098-46cb-969f-7bc1dcc51e8b admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:04.946977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8a3c2-91bc-4dcd-8845-c4aebb2f7d08 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:04.962426 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d8b8d-81c5-40ff-aa1d-ce1cc2ccad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:04.963329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d8b8d-81c5-40ff-aa1d-ce1cc2ccad63 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:04.963924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d8b8d-81c5-40ff-aa1d-ce1cc2ccad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:04.964386 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d8b8d-81c5-40ff-aa1d-ce1cc2ccad63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:04.966021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d8b8d-81c5-40ff-aa1d-ce1cc2ccad63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:04.966493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d8b8d-81c5-40ff-aa1d-ce1cc2ccad63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:04.968354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d8b8d-81c5-40ff-aa1d-ce1cc2ccad63 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:04.989263 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 956/1955] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:04.993027 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d8b8d-81c5-40ff-aa1d-ce1cc2ccad63 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:05.023164 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d8b8d-81c5-40ff-aa1d-ce1cc2ccad63 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:05.037504 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167786fc-1889-412f-8e4f-cb5df37be7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:05.038291 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167786fc-1889-412f-8e4f-cb5df37be7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.038581 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167786fc-1889-412f-8e4f-cb5df37be7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.039080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167786fc-1889-412f-8e4f-cb5df37be7b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.039634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167786fc-1889-412f-8e4f-cb5df37be7b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:05.043233 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167786fc-1889-412f-8e4f-cb5df37be7b0 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:05.058936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-ac95ac96-b098-46cb-969f-7bc1dcc51e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36357f281754485896edfb96ce3a594d', 'request_id': 'req-ac95ac96-b098-46cb-969f-7bc1dcc51e8b'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:05.074796 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-ac95ac96-b098-46cb-969f-7bc1dcc51e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36357f281754485896edfb96ce3a594d', 'request_id': 'req-ac95ac96-b098-46cb-969f-7bc1dcc51e8b'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:05.081623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-ac95ac96-b098-46cb-969f-7bc1dcc51e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36357f281754485896edfb96ce3a594d', 'request_id': 'req-ac95ac96-b098-46cb-969f-7bc1dcc51e8b'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:05.084501 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 957/1956] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:04 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:05.087986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167786fc-1889-412f-8e4f-cb5df37be7b0 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:05.094575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-ac95ac96-b098-46cb-969f-7bc1dcc51e8b admin admin] The token cache is being invalidate because project 36357f281754485896edfb96ce3a594d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:05.095063 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-ac95ac96-b098-46cb-969f-7bc1dcc51e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:05.096079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-ac95ac96-b098-46cb-969f-7bc1dcc51e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:05.100444 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1000/1957] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:04 2022] DELETE /identity/v3/projects/36357f281754485896edfb96ce3a594d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:05.106305 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d8aee-d027-4384-857a-408048ddd007 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.107301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d8aee-d027-4384-857a-408048ddd007 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.107692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d8aee-d027-4384-857a-408048ddd007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.152068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-254d8aee-d027-4384-857a-408048ddd007 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:05.153482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-254d8aee-d027-4384-857a-408048ddd007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:05.220316 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167786fc-1889-412f-8e4f-cb5df37be7b0 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:05.236897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aec626-9db5-4057-b8f1-ca2d9800501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:05.238074 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aec626-9db5-4057-b8f1-ca2d9800501c admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.238508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aec626-9db5-4057-b8f1-ca2d9800501c admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.239216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aec626-9db5-4057-b8f1-ca2d9800501c admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.240530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aec626-9db5-4057-b8f1-ca2d9800501c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:05.242468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aec626-9db5-4057-b8f1-ca2d9800501c admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:05.282585 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 958/1958] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:05 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:05.288186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aec626-9db5-4057-b8f1-ca2d9800501c admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:05.289439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a6aec626-9db5-4057-b8f1-ca2d9800501c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:05.298372 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1001/1959] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:05.307060 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aec626-9db5-4057-b8f1-ca2d9800501c admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:05.307473 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11a45f-1c5f-4036-8736-33e1a1934029 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.309784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11a45f-1c5f-4036-8736-33e1a1934029 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.310536 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11a45f-1c5f-4036-8736-33e1a1934029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.314062 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd1fd0-961f-4c55-b85d-8cedac5969d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:05.314743 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd1fd0-961f-4c55-b85d-8cedac5969d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.315026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd1fd0-961f-4c55-b85d-8cedac5969d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.315304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd1fd0-961f-4c55-b85d-8cedac5969d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.316631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd1fd0-961f-4c55-b85d-8cedac5969d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:05.318178 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd1fd0-961f-4c55-b85d-8cedac5969d2 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:05.329967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 959/1960] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:05.331301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-cf11a45f-1c5f-4036-8736-33e1a1934029 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:05.333512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cf11a45f-1c5f-4036-8736-33e1a1934029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:05.334576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd1fd0-961f-4c55-b85d-8cedac5969d2 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:05.342317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1002/1961] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:05.344433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd1fd0-961f-4c55-b85d-8cedac5969d2 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:05.346278 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11a45f-1c5f-4036-8736-33e1a1934029 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:05.350334 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ffd49-acb5-4ae9-87ac-1f33c593d946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:05.351041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ffd49-acb5-4ae9-87ac-1f33c593d946 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.351550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ffd49-acb5-4ae9-87ac-1f33c593d946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.351835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ffd49-acb5-4ae9-87ac-1f33c593d946 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.352612 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ffd49-acb5-4ae9-87ac-1f33c593d946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:05.354270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ffd49-acb5-4ae9-87ac-1f33c593d946 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:05.357406 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11a45f-1c5f-4036-8736-33e1a1934029 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:05.363917 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7ce35-563c-441e-846f-5b943833bfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:05.364609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7ce35-563c-441e-846f-5b943833bfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.364955 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7ce35-563c-441e-846f-5b943833bfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.365160 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7ce35-563c-441e-846f-5b943833bfe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.366292 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7ce35-563c-441e-846f-5b943833bfe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:05.366867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7ce35-563c-441e-846f-5b943833bfe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:05.368254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 960/1962] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:05.368677 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7ce35-563c-441e-846f-5b943833bfe4 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:05.368992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ffd49-acb5-4ae9-87ac-1f33c593d946 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:05.379407 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ffd49-acb5-4ae9-87ac-1f33c593d946 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:05.381601 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1003/1963] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:05.384467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0ca25-a156-4d11-9716-02d6fd9e3ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:05.385450 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0ca25-a156-4d11-9716-02d6fd9e3ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.385800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0ca25-a156-4d11-9716-02d6fd9e3ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.386601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0ca25-a156-4d11-9716-02d6fd9e3ac8 admin admin] PATH_INFO: `/v3/projects/64ce5a253da0446eb63617480a8f6a72/users/671dcda09f1d4c768b3e7827c707fd77/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.386851 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7ce35-563c-441e-846f-5b943833bfe4 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:05.400724 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7ce35-563c-441e-846f-5b943833bfe4 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:05.405817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce0abc-1311-4c83-b389-bfd122da8fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:05.406433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0ca25-a156-4d11-9716-02d6fd9e3ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ce5a253da0446eb63617480a8f6a72, user_id=671dcda09f1d4c768b3e7827c707fd77, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:05.406567 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce0abc-1311-4c83-b389-bfd122da8fba admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.406736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce0abc-1311-4c83-b389-bfd122da8fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.407009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce0abc-1311-4c83-b389-bfd122da8fba admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.407688 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce0abc-1311-4c83-b389-bfd122da8fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:05.409166 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0ca25-a156-4d11-9716-02d6fd9e3ac8 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:05.409606 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce0abc-1311-4c83-b389-bfd122da8fba admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:05.422831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 961/1964] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:05 2022] PUT /identity/v3/projects/64ce5a253da0446eb63617480a8f6a72/users/671dcda09f1d4c768b3e7827c707fd77/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:05.434800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15e2ed-dd7f-42dd-9f60-c70d68ef08a0 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.435085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15e2ed-dd7f-42dd-9f60-c70d68ef08a0 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.435361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15e2ed-dd7f-42dd-9f60-c70d68ef08a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.436763 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1004/1965] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:05 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:05.440500 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce0abc-1311-4c83-b389-bfd122da8fba admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:05.462052 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-6d15e2ed-dd7f-42dd-9f60-c70d68ef08a0 None None] MFA Rules not processed for user `671dcda09f1d4c768b3e7827c707fd77`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:05.463365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-6d15e2ed-dd7f-42dd-9f60-c70d68ef08a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:05.499919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce0abc-1311-4c83-b389-bfd122da8fba admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:05.504753 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7085c9f-78dd-4b35-bb53-8b2da88e7b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:05.505638 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7085c9f-78dd-4b35-bb53-8b2da88e7b59 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.505915 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7085c9f-78dd-4b35-bb53-8b2da88e7b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.506187 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7085c9f-78dd-4b35-bb53-8b2da88e7b59 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.506875 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7085c9f-78dd-4b35-bb53-8b2da88e7b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:05.508834 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7085c9f-78dd-4b35-bb53-8b2da88e7b59 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:05.526009 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 962/1966] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:05.531390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1005/1967] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:05 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:05.532651 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15e2ed-dd7f-42dd-9f60-c70d68ef08a0 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:05.532829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7085c9f-78dd-4b35-bb53-8b2da88e7b59 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:05.542781 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7085c9f-78dd-4b35-bb53-8b2da88e7b59 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:05.543470 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15e2ed-dd7f-42dd-9f60-c70d68ef08a0 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:05.547634 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea6006-5b12-470c-879d-fd75ea34f292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:05.548207 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d069d-a435-4d24-8248-424fea6d9542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:05.548353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea6006-5b12-470c-879d-fd75ea34f292 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.548574 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea6006-5b12-470c-879d-fd75ea34f292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.548832 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d069d-a435-4d24-8248-424fea6d9542 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.548937 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea6006-5b12-470c-879d-fd75ea34f292 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.549117 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d069d-a435-4d24-8248-424fea6d9542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.549395 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d069d-a435-4d24-8248-424fea6d9542 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.549540 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea6006-5b12-470c-879d-fd75ea34f292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:05.550075 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d069d-a435-4d24-8248-424fea6d9542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:05.551091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea6006-5b12-470c-879d-fd75ea34f292 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:05.552039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d069d-a435-4d24-8248-424fea6d9542 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:05.561414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1006/1968] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:05.565267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea6006-5b12-470c-879d-fd75ea34f292 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:05.575601 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea6006-5b12-470c-879d-fd75ea34f292 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:05.582556 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 963/1969] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:05 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:05.582697 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f978b02-1ce9-4e2e-8def-fef660da7352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:05.582697 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f978b02-1ce9-4e2e-8def-fef660da7352 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.582697 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f978b02-1ce9-4e2e-8def-fef660da7352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.582697 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f978b02-1ce9-4e2e-8def-fef660da7352 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.583062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f978b02-1ce9-4e2e-8def-fef660da7352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:05.583583 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d069d-a435-4d24-8248-424fea6d9542 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:05.583769 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f978b02-1ce9-4e2e-8def-fef660da7352 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:05.594908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1007/1970] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:05.599565 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f978b02-1ce9-4e2e-8def-fef660da7352 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:05.615203 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f978b02-1ce9-4e2e-8def-fef660da7352 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:05.653176 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d069d-a435-4d24-8248-424fea6d9542 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:05.658106 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9102ba9-ddbc-405a-9f58-fcee2ac1c9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:05.658916 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9102ba9-ddbc-405a-9f58-fcee2ac1c9bf admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.659201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9102ba9-ddbc-405a-9f58-fcee2ac1c9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.659475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9102ba9-ddbc-405a-9f58-fcee2ac1c9bf admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.660310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9102ba9-ddbc-405a-9f58-fcee2ac1c9bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:05.663057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9102ba9-ddbc-405a-9f58-fcee2ac1c9bf admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:05.674079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdb0ab-8f60-413f-a9fe-ad0a24157822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:05.674994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdb0ab-8f60-413f-a9fe-ad0a24157822 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.675308 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdb0ab-8f60-413f-a9fe-ad0a24157822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.675775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdb0ab-8f60-413f-a9fe-ad0a24157822 admin admin] PATH_INFO: `/v3/projects/4579a8f2f6454f889efc87d1666474df/users/42b928cdf5ef407099de426d5d37a773/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.685600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 964/1971] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:05 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:05.689105 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9102ba9-ddbc-405a-9f58-fcee2ac1c9bf admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:05.692951 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cdb0ab-8f60-413f-a9fe-ad0a24157822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4579a8f2f6454f889efc87d1666474df, user_id=42b928cdf5ef407099de426d5d37a773, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:05.696794 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cdb0ab-8f60-413f-a9fe-ad0a24157822 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:05.700356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9102ba9-ddbc-405a-9f58-fcee2ac1c9bf admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:05.706057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9c5e5-d7ea-479b-b738-d9a41812fd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:05.706760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9c5e5-d7ea-479b-b738-d9a41812fd09 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.707029 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9c5e5-d7ea-479b-b738-d9a41812fd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.707276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9c5e5-d7ea-479b-b738-d9a41812fd09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.708046 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9c5e5-d7ea-479b-b738-d9a41812fd09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:05.709674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9c5e5-d7ea-479b-b738-d9a41812fd09 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:05.718609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1008/1972] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:05 2022] PUT /identity/v3/projects/4579a8f2f6454f889efc87d1666474df/users/42b928cdf5ef407099de426d5d37a773/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:05.727405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 965/1973] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:05.728538 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdb0ab-8f60-413f-a9fe-ad0a24157822 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:05.728800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca365d-dd17-4407-ad42-77035fb18482 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.729349 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca365d-dd17-4407-ad42-77035fb18482 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.730248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca365d-dd17-4407-ad42-77035fb18482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.760710 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-65ca365d-dd17-4407-ad42-77035fb18482 None None] MFA Rules not processed for user `42b928cdf5ef407099de426d5d37a773`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:05.761969 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-65ca365d-dd17-4407-ad42-77035fb18482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:05.807290 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdb0ab-8f60-413f-a9fe-ad0a24157822 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:05.813012 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7a9ec-573b-46f0-9aeb-a930ec75d265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:05.813684 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7a9ec-573b-46f0-9aeb-a930ec75d265 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.813963 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7a9ec-573b-46f0-9aeb-a930ec75d265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.814236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7a9ec-573b-46f0-9aeb-a930ec75d265 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.815098 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7a9ec-573b-46f0-9aeb-a930ec75d265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:05.816562 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7a9ec-573b-46f0-9aeb-a930ec75d265 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:05.827870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1009/1974] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:05.831692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7a9ec-573b-46f0-9aeb-a930ec75d265 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:05.832255 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 966/1975] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:05.844026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca365d-dd17-4407-ad42-77035fb18482 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:05.845228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7a9ec-573b-46f0-9aeb-a930ec75d265 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:05.845644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-65ca365d-dd17-4407-ad42-77035fb18482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:05.850455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649619d8-3c43-46ac-a1b3-42721d754e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:05.851357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649619d8-3c43-46ac-a1b3-42721d754e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.851760 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649619d8-3c43-46ac-a1b3-42721d754e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.852038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649619d8-3c43-46ac-a1b3-42721d754e4c admin admin] PATH_INFO: `/v3/projects/1f1acb28d1bd492dacf3bc14e9027124/users/c4418f8a7497436c97d5985649eece28/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.870725 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649619d8-3c43-46ac-a1b3-42721d754e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1acb28d1bd492dacf3bc14e9027124, user_id=c4418f8a7497436c97d5985649eece28, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:05.873549 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649619d8-3c43-46ac-a1b3-42721d754e4c admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:05.887860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1010/1976] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:05 2022] PUT /identity/v3/projects/1f1acb28d1bd492dacf3bc14e9027124/users/c4418f8a7497436c97d5985649eece28/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:05.898794 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d099e6-6485-4350-84fb-0067e385d775 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.899298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d099e6-6485-4350-84fb-0067e385d775 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.899608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d099e6-6485-4350-84fb-0067e385d775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:05.910379 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca365d-dd17-4407-ad42-77035fb18482 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:05.928544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f0d099e6-6485-4350-84fb-0067e385d775 None None] MFA Rules not processed for user `c4418f8a7497436c97d5985649eece28`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:05.929752 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f0d099e6-6485-4350-84fb-0067e385d775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:05.960379 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cb070-2d72-4c7d-834d-e318e60f67a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:05.961127 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cb070-2d72-4c7d-834d-e318e60f67a7 service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:05.961408 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cb070-2d72-4c7d-834d-e318e60f67a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:05.961685 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cb070-2d72-4c7d-834d-e318e60f67a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:06.002796 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1011/1977] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:06.007437 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d099e6-6485-4350-84fb-0067e385d775 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:06.029859 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cb070-2d72-4c7d-834d-e318e60f67a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:06.031283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cb070-2d72-4c7d-834d-e318e60f67a7 service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:06.040066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 967/1978] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:06.066682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d099e6-6485-4350-84fb-0067e385d775 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:06.071127 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940ea84-f980-4c67-ae60-6e38fd0a71c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:06.071771 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940ea84-f980-4c67-ae60-6e38fd0a71c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:06.072047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940ea84-f980-4c67-ae60-6e38fd0a71c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:06.072346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940ea84-f980-4c67-ae60-6e38fd0a71c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:06.073018 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940ea84-f980-4c67-ae60-6e38fd0a71c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:06.075424 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940ea84-f980-4c67-ae60-6e38fd0a71c8 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:06.099949 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1012/1979] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:06 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:06.104295 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cb070-2d72-4c7d-834d-e318e60f67a7 service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:06.114744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cb070-2d72-4c7d-834d-e318e60f67a7 service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:06.178611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c90e31-9cdf-45f8-b7ab-9b222c9a173b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:06.179076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c90e31-9cdf-45f8-b7ab-9b222c9a173b admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:06.179425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c90e31-9cdf-45f8-b7ab-9b222c9a173b admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:06.179848 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c90e31-9cdf-45f8-b7ab-9b222c9a173b admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:06.180754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c90e31-9cdf-45f8-b7ab-9b222c9a173b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:06.187287 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c90e31-9cdf-45f8-b7ab-9b222c9a173b admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:06.211520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 968/1980] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:06 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:06.215555 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940ea84-f980-4c67-ae60-6e38fd0a71c8 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:06.225787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940ea84-f980-4c67-ae60-6e38fd0a71c8 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:06.232007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7ef52-e6ce-4ff2-b0a2-4226df2e7bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:06.232698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7ef52-e6ce-4ff2-b0a2-4226df2e7bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:06.232982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7ef52-e6ce-4ff2-b0a2-4226df2e7bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:06.233256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7ef52-e6ce-4ff2-b0a2-4226df2e7bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:06.233989 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7ef52-e6ce-4ff2-b0a2-4226df2e7bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:06.235761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7ef52-e6ce-4ff2-b0a2-4226df2e7bd4 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:06.253958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1013/1981] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:06.257881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c90e31-9cdf-45f8-b7ab-9b222c9a173b admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:06.269323 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c90e31-9cdf-45f8-b7ab-9b222c9a173b admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:06.274676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c46c2b-3da9-457f-a8ac-1b2c77e9d1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:06.275939 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c46c2b-3da9-457f-a8ac-1b2c77e9d1ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:06.276476 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c46c2b-3da9-457f-a8ac-1b2c77e9d1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:06.276841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c46c2b-3da9-457f-a8ac-1b2c77e9d1ba admin admin] PATH_INFO: `/v3/projects/6e413adab14b45e59271a0eaf52d919b/users/077227635e9d45ccb75e2f5b9afabb3d/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:06.296928 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c46c2b-3da9-457f-a8ac-1b2c77e9d1ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e413adab14b45e59271a0eaf52d919b, user_id=077227635e9d45ccb75e2f5b9afabb3d, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:06.299934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c46c2b-3da9-457f-a8ac-1b2c77e9d1ba admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:06.318439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 969/1982] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:06 2022] PUT /identity/v3/projects/6e413adab14b45e59271a0eaf52d919b/users/077227635e9d45ccb75e2f5b9afabb3d/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:06.320034 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7ef52-e6ce-4ff2-b0a2-4226df2e7bd4 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:06.334580 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7ef52-e6ce-4ff2-b0a2-4226df2e7bd4 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:06.435448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf0fa8-af0e-4d29-824d-2d5bc6998c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:06.436212 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf0fa8-af0e-4d29-824d-2d5bc6998c72 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:06.436501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf0fa8-af0e-4d29-824d-2d5bc6998c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:06.436854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf0fa8-af0e-4d29-824d-2d5bc6998c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:06.437612 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf0fa8-af0e-4d29-824d-2d5bc6998c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:06.439255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf0fa8-af0e-4d29-824d-2d5bc6998c72 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:06.450363 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1014/1983] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:06.454327 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c46c2b-3da9-457f-a8ac-1b2c77e9d1ba admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:06.464926 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c46c2b-3da9-457f-a8ac-1b2c77e9d1ba admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:06.472323 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df91fc4-a9d7-431d-b9ec-ff4aa67e12d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:06.473337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df91fc4-a9d7-431d-b9ec-ff4aa67e12d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:06.478213 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df91fc4-a9d7-431d-b9ec-ff4aa67e12d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:06.478609 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df91fc4-a9d7-431d-b9ec-ff4aa67e12d8 admin admin] PATH_INFO: `/v3/projects/6e413adab14b45e59271a0eaf52d919b/users/077227635e9d45ccb75e2f5b9afabb3d/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:06.483557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df91fc4-a9d7-431d-b9ec-ff4aa67e12d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e413adab14b45e59271a0eaf52d919b, user_id=077227635e9d45ccb75e2f5b9afabb3d, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:06.486993 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df91fc4-a9d7-431d-b9ec-ff4aa67e12d8 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:06.504198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 970/1984] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:06 2022] PUT /identity/v3/projects/6e413adab14b45e59271a0eaf52d919b/users/077227635e9d45ccb75e2f5b9afabb3d/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:06.516000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbd4e7-0579-4331-887c-fdfd60dc50a1 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:06.516389 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbd4e7-0579-4331-887c-fdfd60dc50a1 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:06.516800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbd4e7-0579-4331-887c-fdfd60dc50a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:06.545413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-27bbd4e7-0579-4331-887c-fdfd60dc50a1 None None] MFA Rules not processed for user `077227635e9d45ccb75e2f5b9afabb3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:06.546725 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-27bbd4e7-0579-4331-887c-fdfd60dc50a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:06.612005 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1015/1985] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:06.623455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df91fc4-a9d7-431d-b9ec-ff4aa67e12d8 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:06.625189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0df91fc4-a9d7-431d-b9ec-ff4aa67e12d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:06.678750 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df91fc4-a9d7-431d-b9ec-ff4aa67e12d8 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:06.682444 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a3215-da29-4c28-930b-1b7a8b79c23d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:06.683596 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a3215-da29-4c28-930b-1b7a8b79c23d service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:06.683873 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a3215-da29-4c28-930b-1b7a8b79c23d service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:06.684144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a3215-da29-4c28-930b-1b7a8b79c23d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:06.736082 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a3215-da29-4c28-930b-1b7a8b79c23d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:06.737526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a3215-da29-4c28-930b-1b7a8b79c23d service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:06.746587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 971/1986] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:10.309517 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbd4e7-0579-4331-887c-fdfd60dc50a1 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:10.318921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbd4e7-0579-4331-887c-fdfd60dc50a1 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:10.322410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12592de6-5fba-435f-84c5-d1889ef2b4d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:10.323543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12592de6-5fba-435f-84c5-d1889ef2b4d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:10.324003 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12592de6-5fba-435f-84c5-d1889ef2b4d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:10.324483 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12592de6-5fba-435f-84c5-d1889ef2b4d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:10.377833 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12592de6-5fba-435f-84c5-d1889ef2b4d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:10.379240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12592de6-5fba-435f-84c5-d1889ef2b4d1 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:10.388979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1016/1987] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:11.427851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a3215-da29-4c28-930b-1b7a8b79c23d service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:11.429468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ae4a3215-da29-4c28-930b-1b7a8b79c23d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:11.493351 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a3215-da29-4c28-930b-1b7a8b79c23d service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:11.497830 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3d1b0-86cf-48b0-bf9c-156423677fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:11.498690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3d1b0-86cf-48b0-bf9c-156423677fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:11.498973 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3d1b0-86cf-48b0-bf9c-156423677fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:11.499244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3d1b0-86cf-48b0-bf9c-156423677fb4 admin admin] PATH_INFO: `/v3/users/e2218b6609f344dc94f91247e8504e85` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:11.500447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3d1b0-86cf-48b0-bf9c-156423677fb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2218b6609f344dc94f91247e8504e85)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:11.502347 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3d1b0-86cf-48b0-bf9c-156423677fb4 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:11.546260 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-87f3d1b0-86cf-48b0-bf9c-156423677fb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2218b6609f344dc94f91247e8504e85'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:11.546831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-87f3d1b0-86cf-48b0-bf9c-156423677fb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2218b6609f344dc94f91247e8504e85'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:11.557921 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-87f3d1b0-86cf-48b0-bf9c-156423677fb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2218b6609f344dc94f91247e8504e85'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:11.564630 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-87f3d1b0-86cf-48b0-bf9c-156423677fb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2218b6609f344dc94f91247e8504e85'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:11.565248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-87f3d1b0-86cf-48b0-bf9c-156423677fb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2218b6609f344dc94f91247e8504e85'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:11.577381 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 972/1988] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:11 2022] DELETE /identity/v3/users/e2218b6609f344dc94f91247e8504e85 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:11.740349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12592de6-5fba-435f-84c5-d1889ef2b4d1 service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:11.752816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12592de6-5fba-435f-84c5-d1889ef2b4d1 service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:11.810124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdc59f-d10c-402d-8632-051adf4e55d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:11.810912 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdc59f-d10c-402d-8632-051adf4e55d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:11.811186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdc59f-d10c-402d-8632-051adf4e55d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:11.811454 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdc59f-d10c-402d-8632-051adf4e55d9 admin admin] PATH_INFO: `/v3/projects/854eb7b7a9a44ca283e9c95ce935624d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:11.812654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdc59f-d10c-402d-8632-051adf4e55d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=854eb7b7a9a44ca283e9c95ce935624d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:11.814534 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdc59f-d10c-402d-8632-051adf4e55d9 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:11.858300 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-45cdc59f-d10c-402d-8632-051adf4e55d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '854eb7b7a9a44ca283e9c95ce935624d', 'request_id': 'req-45cdc59f-d10c-402d-8632-051adf4e55d9'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:11.865055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-45cdc59f-d10c-402d-8632-051adf4e55d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '854eb7b7a9a44ca283e9c95ce935624d', 'request_id': 'req-45cdc59f-d10c-402d-8632-051adf4e55d9'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:11.870765 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-45cdc59f-d10c-402d-8632-051adf4e55d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '854eb7b7a9a44ca283e9c95ce935624d', 'request_id': 'req-45cdc59f-d10c-402d-8632-051adf4e55d9'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:11.881133 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-45cdc59f-d10c-402d-8632-051adf4e55d9 admin admin] The token cache is being invalidate because project 854eb7b7a9a44ca283e9c95ce935624d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:11.881416 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-45cdc59f-d10c-402d-8632-051adf4e55d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:11.882054 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-45cdc59f-d10c-402d-8632-051adf4e55d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:11.883675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1017/1989] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:11 2022] DELETE /identity/v3/projects/854eb7b7a9a44ca283e9c95ce935624d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:11.889211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd156648-07e4-4063-8719-ddb1d67302d9 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:11.889502 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd156648-07e4-4063-8719-ddb1d67302d9 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:11.889782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd156648-07e4-4063-8719-ddb1d67302d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:11.909407 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-bd156648-07e4-4063-8719-ddb1d67302d9 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:11.910619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-bd156648-07e4-4063-8719-ddb1d67302d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:11.967148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 973/1990] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:11.975175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b15313-07e1-4788-92cb-39ef2ddfbce3 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:11.975466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b15313-07e1-4788-92cb-39ef2ddfbce3 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:11.975745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b15313-07e1-4788-92cb-39ef2ddfbce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:11.993821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-b7b15313-07e1-4788-92cb-39ef2ddfbce3 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:11.995639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b7b15313-07e1-4788-92cb-39ef2ddfbce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:12.003622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1018/1991] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:12.007846 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd156648-07e4-4063-8719-ddb1d67302d9 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:12.017251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd156648-07e4-4063-8719-ddb1d67302d9 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:12.021789 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cec538-e1d1-4c09-a7ce-057954d0548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:12.022427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cec538-e1d1-4c09-a7ce-057954d0548a admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:12.022963 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cec538-e1d1-4c09-a7ce-057954d0548a admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:12.023233 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cec538-e1d1-4c09-a7ce-057954d0548a admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:12.023939 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cec538-e1d1-4c09-a7ce-057954d0548a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:12.024283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cec538-e1d1-4c09-a7ce-057954d0548a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:12.025855 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cec538-e1d1-4c09-a7ce-057954d0548a admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:12.037659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 974/1992] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:12.041766 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b15313-07e1-4788-92cb-39ef2ddfbce3 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:12.051174 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b15313-07e1-4788-92cb-39ef2ddfbce3 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:12.055800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a9228-805e-410e-9642-803a4942d4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:12.056466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a9228-805e-410e-9642-803a4942d4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:12.056750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a9228-805e-410e-9642-803a4942d4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:12.057028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a9228-805e-410e-9642-803a4942d4a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:12.057716 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a9228-805e-410e-9642-803a4942d4a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:12.059571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a9228-805e-410e-9642-803a4942d4a8 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:12.084086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1019/1993] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:12 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:12.088042 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cec538-e1d1-4c09-a7ce-057954d0548a admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:12.098226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cec538-e1d1-4c09-a7ce-057954d0548a admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:12.151855 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d24aa9-ed48-4a1e-96c9-c64c04d5fde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:12.152534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d24aa9-ed48-4a1e-96c9-c64c04d5fde5 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:12.152814 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d24aa9-ed48-4a1e-96c9-c64c04d5fde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:12.153085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d24aa9-ed48-4a1e-96c9-c64c04d5fde5 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:12.153760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d24aa9-ed48-4a1e-96c9-c64c04d5fde5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:12.155637 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d24aa9-ed48-4a1e-96c9-c64c04d5fde5 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:12.174615 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 975/1994] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:12 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:12.178650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a9228-805e-410e-9642-803a4942d4a8 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:12.189346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a9228-805e-410e-9642-803a4942d4a8 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:12.194421 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b319d-62af-4963-901c-18534be59c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:12.195069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b319d-62af-4963-901c-18534be59c9d admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:12.195349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b319d-62af-4963-901c-18534be59c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:12.195618 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b319d-62af-4963-901c-18534be59c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:12.196374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b319d-62af-4963-901c-18534be59c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:12.197964 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b319d-62af-4963-901c-18534be59c9d admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:12.208467 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1020/1995] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:12.212201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d24aa9-ed48-4a1e-96c9-c64c04d5fde5 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:12.222056 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d24aa9-ed48-4a1e-96c9-c64c04d5fde5 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:12.226619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395a0e1-78dd-4b93-9d06-4bb22f6fa5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:12.227258 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395a0e1-78dd-4b93-9d06-4bb22f6fa5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:12.227538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395a0e1-78dd-4b93-9d06-4bb22f6fa5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:12.227811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395a0e1-78dd-4b93-9d06-4bb22f6fa5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:12.228554 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395a0e1-78dd-4b93-9d06-4bb22f6fa5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:12.230624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395a0e1-78dd-4b93-9d06-4bb22f6fa5c0 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:12.240538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 976/1996] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:12.244583 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b319d-62af-4963-901c-18534be59c9d admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:12.254582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b319d-62af-4963-901c-18534be59c9d admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:12.259873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fb159-7373-4118-b97b-a9bb39dad8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:12.260803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fb159-7373-4118-b97b-a9bb39dad8ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:12.261085 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fb159-7373-4118-b97b-a9bb39dad8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:12.261360 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fb159-7373-4118-b97b-a9bb39dad8ab admin admin] PATH_INFO: `/v3/projects/ee307260985749829b274fd68e016ec6/users/6241c515e5e64b37b908268f8620b7ab/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:12.276353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fb159-7373-4118-b97b-a9bb39dad8ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee307260985749829b274fd68e016ec6, user_id=6241c515e5e64b37b908268f8620b7ab, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:12.279007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fb159-7373-4118-b97b-a9bb39dad8ab admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:12.293026 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1021/1997] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:12 2022] PUT /identity/v3/projects/ee307260985749829b274fd68e016ec6/users/6241c515e5e64b37b908268f8620b7ab/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:12.302673 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccf42a-e818-4472-a9ff-dba2bf981332 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:12.302967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccf42a-e818-4472-a9ff-dba2bf981332 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:12.303248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccf42a-e818-4472-a9ff-dba2bf981332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:12.329976 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-95ccf42a-e818-4472-a9ff-dba2bf981332 None None] MFA Rules not processed for user `6241c515e5e64b37b908268f8620b7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:12.331186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-95ccf42a-e818-4472-a9ff-dba2bf981332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:12.394775 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 977/1998] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:12.399684 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fb159-7373-4118-b97b-a9bb39dad8ab admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:12.458833 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fb159-7373-4118-b97b-a9bb39dad8ab admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:12.463397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cfdd4-6763-4fd8-90f2-d8988e5b06c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:12.464070 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cfdd4-6763-4fd8-90f2-d8988e5b06c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:12.464377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cfdd4-6763-4fd8-90f2-d8988e5b06c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:12.464670 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cfdd4-6763-4fd8-90f2-d8988e5b06c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:12.465331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63cfdd4-6763-4fd8-90f2-d8988e5b06c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:12.467211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63cfdd4-6763-4fd8-90f2-d8988e5b06c0 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:12.492101 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1022/1999] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:12 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:12.496839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccf42a-e818-4472-a9ff-dba2bf981332 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:12.507338 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccf42a-e818-4472-a9ff-dba2bf981332 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:12.561960 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a88ef-5229-42d8-801e-4e7ec07ad784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:12.562615 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a88ef-5229-42d8-801e-4e7ec07ad784 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:12.562898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a88ef-5229-42d8-801e-4e7ec07ad784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:12.563175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a88ef-5229-42d8-801e-4e7ec07ad784 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:12.563861 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a88ef-5229-42d8-801e-4e7ec07ad784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:12.565797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a88ef-5229-42d8-801e-4e7ec07ad784 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:12.584682 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 978/2000] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:12 2022] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:12.589271 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cfdd4-6763-4fd8-90f2-d8988e5b06c0 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:12.599801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cfdd4-6763-4fd8-90f2-d8988e5b06c0 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:12.605014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947a1e2-ce34-4ff1-8367-0e7e2bc9bdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:12.605666 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947a1e2-ce34-4ff1-8367-0e7e2bc9bdc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:12.605953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947a1e2-ce34-4ff1-8367-0e7e2bc9bdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:12.606232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947a1e2-ce34-4ff1-8367-0e7e2bc9bdc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:12.607006 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947a1e2-ce34-4ff1-8367-0e7e2bc9bdc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:12.608688 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947a1e2-ce34-4ff1-8367-0e7e2bc9bdc4 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:12.618921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1023/2001] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:12.622940 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a88ef-5229-42d8-801e-4e7ec07ad784 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:12.632536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a88ef-5229-42d8-801e-4e7ec07ad784 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:12.637194 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78fcbc-3d78-4385-89dd-46dda3217ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:12.638059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78fcbc-3d78-4385-89dd-46dda3217ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:12.638341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78fcbc-3d78-4385-89dd-46dda3217ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:12.638615 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78fcbc-3d78-4385-89dd-46dda3217ce6 admin admin] PATH_INFO: `/v3/projects/14c64ebeac374914b1459ce1b7da7bab/users/2a5c05643e944ff4b99f9a4e669b6ae8/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:12.653267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78fcbc-3d78-4385-89dd-46dda3217ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c64ebeac374914b1459ce1b7da7bab, user_id=2a5c05643e944ff4b99f9a4e669b6ae8, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:12.655886 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78fcbc-3d78-4385-89dd-46dda3217ce6 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:12.668953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 979/2002] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:12 2022] PUT /identity/v3/projects/14c64ebeac374914b1459ce1b7da7bab/users/2a5c05643e944ff4b99f9a4e669b6ae8/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:12.672795 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947a1e2-ce34-4ff1-8367-0e7e2bc9bdc4 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:12.682497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947a1e2-ce34-4ff1-8367-0e7e2bc9bdc4 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:12.736784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad15e3-53c4-4da1-9032-c8038b5fb903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:12.737459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad15e3-53c4-4da1-9032-c8038b5fb903 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:12.737735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad15e3-53c4-4da1-9032-c8038b5fb903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:12.738004 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad15e3-53c4-4da1-9032-c8038b5fb903 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:12.738728 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad15e3-53c4-4da1-9032-c8038b5fb903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:12.740422 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad15e3-53c4-4da1-9032-c8038b5fb903 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:12.750321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1024/2003] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:12.754322 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78fcbc-3d78-4385-89dd-46dda3217ce6 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:12.764331 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78fcbc-3d78-4385-89dd-46dda3217ce6 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:12.768995 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190fdf8-90dc-45f3-aa16-18a6ca6356cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:12.769870 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190fdf8-90dc-45f3-aa16-18a6ca6356cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:12.770148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190fdf8-90dc-45f3-aa16-18a6ca6356cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:12.770420 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190fdf8-90dc-45f3-aa16-18a6ca6356cf admin admin] PATH_INFO: `/v3/projects/14c64ebeac374914b1459ce1b7da7bab/users/2a5c05643e944ff4b99f9a4e669b6ae8/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:12.772451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190fdf8-90dc-45f3-aa16-18a6ca6356cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c64ebeac374914b1459ce1b7da7bab, user_id=2a5c05643e944ff4b99f9a4e669b6ae8, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:12.775349 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190fdf8-90dc-45f3-aa16-18a6ca6356cf admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:12.786515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 980/2004] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:12 2022] PUT /identity/v3/projects/14c64ebeac374914b1459ce1b7da7bab/users/2a5c05643e944ff4b99f9a4e669b6ae8/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:12.797893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad41aab-a4a4-45fa-aecc-b8f850d83693 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:12.798184 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad41aab-a4a4-45fa-aecc-b8f850d83693 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:12.798461 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad41aab-a4a4-45fa-aecc-b8f850d83693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:12.832717 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-0ad41aab-a4a4-45fa-aecc-b8f850d83693 None None] MFA Rules not processed for user `2a5c05643e944ff4b99f9a4e669b6ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:12.833931 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-0ad41aab-a4a4-45fa-aecc-b8f850d83693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:12.900008 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1025/2005] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:12.912095 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190fdf8-90dc-45f3-aa16-18a6ca6356cf admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:12.913971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-9190fdf8-90dc-45f3-aa16-18a6ca6356cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:12.977497 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190fdf8-90dc-45f3-aa16-18a6ca6356cf admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:12.982090 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c73de7-f127-4c1c-98c6-c6e882145722 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:12.982759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c73de7-f127-4c1c-98c6-c6e882145722 service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:12.983041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c73de7-f127-4c1c-98c6-c6e882145722 service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:12.983318 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c73de7-f127-4c1c-98c6-c6e882145722 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:12.993756 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c73de7-f127-4c1c-98c6-c6e882145722 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:12.995208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c73de7-f127-4c1c-98c6-c6e882145722 service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:13.005047 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 981/2006] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:13.034397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad41aab-a4a4-45fa-aecc-b8f850d83693 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:13.094711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad41aab-a4a4-45fa-aecc-b8f850d83693 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:13.099592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb35911-a8a4-4490-9f1f-52bf826992c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:13.100494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35911-a8a4-4490-9f1f-52bf826992c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:13.100769 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35911-a8a4-4490-9f1f-52bf826992c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:13.101038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35911-a8a4-4490-9f1f-52bf826992c0 admin admin] PATH_INFO: `/v3/users/6241c515e5e64b37b908268f8620b7ab` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:13.102267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb35911-a8a4-4490-9f1f-52bf826992c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6241c515e5e64b37b908268f8620b7ab)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:13.104862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb35911-a8a4-4490-9f1f-52bf826992c0 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:13.151513 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-3fb35911-a8a4-4490-9f1f-52bf826992c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6241c515e5e64b37b908268f8620b7ab'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:13.157096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c73de7-f127-4c1c-98c6-c6e882145722 service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:13.158736 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-c7c73de7-f127-4c1c-98c6-c6e882145722 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:13.163089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-3fb35911-a8a4-4490-9f1f-52bf826992c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6241c515e5e64b37b908268f8620b7ab'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:13.170439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-3fb35911-a8a4-4490-9f1f-52bf826992c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6241c515e5e64b37b908268f8620b7ab'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:13.170661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c73de7-f127-4c1c-98c6-c6e882145722 service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:13.171219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-3fb35911-a8a4-4490-9f1f-52bf826992c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6241c515e5e64b37b908268f8620b7ab'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:13.174533 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699ebc3-b5ef-49e2-aefa-b05d2fba5a0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:13.175168 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699ebc3-b5ef-49e2-aefa-b05d2fba5a0b service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:13.175446 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699ebc3-b5ef-49e2-aefa-b05d2fba5a0b service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:13.175812 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699ebc3-b5ef-49e2-aefa-b05d2fba5a0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:13.177919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8699ebc3-b5ef-49e2-aefa-b05d2fba5a0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:13.178761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-3fb35911-a8a4-4490-9f1f-52bf826992c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6241c515e5e64b37b908268f8620b7ab'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:13.185141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1026/2007] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:13 2022] DELETE /identity/v3/users/6241c515e5e64b37b908268f8620b7ab => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:13.189673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd3aab-d145-4bb4-9e68-2869b9c2e256 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:13.190020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd3aab-d145-4bb4-9e68-2869b9c2e256 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:13.190396 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd3aab-d145-4bb4-9e68-2869b9c2e256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:13.207888 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-44dd3aab-d145-4bb4-9e68-2869b9c2e256 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:13.209202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-44dd3aab-d145-4bb4-9e68-2869b9c2e256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:13.242393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699ebc3-b5ef-49e2-aefa-b05d2fba5a0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:13.243814 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699ebc3-b5ef-49e2-aefa-b05d2fba5a0b service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:13.254939 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 982/2008] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:13.268871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1027/2009] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:13.279855 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699ebc3-b5ef-49e2-aefa-b05d2fba5a0b service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:13.281625 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8699ebc3-b5ef-49e2-aefa-b05d2fba5a0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:13.341108 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699ebc3-b5ef-49e2-aefa-b05d2fba5a0b service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:13.391992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133314c-3089-4ccf-87b4-8498ff0d9800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:13.392664 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133314c-3089-4ccf-87b4-8498ff0d9800 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:13.392951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133314c-3089-4ccf-87b4-8498ff0d9800 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:13.393222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133314c-3089-4ccf-87b4-8498ff0d9800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:13.403847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133314c-3089-4ccf-87b4-8498ff0d9800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:13.405302 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133314c-3089-4ccf-87b4-8498ff0d9800 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:13.414884 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 983/2010] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:13.737898 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd3aab-d145-4bb4-9e68-2869b9c2e256 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:13.739320 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-44dd3aab-d145-4bb4-9e68-2869b9c2e256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:13.751267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd3aab-d145-4bb4-9e68-2869b9c2e256 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:13.758040 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565410d8-d661-4bf7-856e-b9046850ea66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:13.758900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565410d8-d661-4bf7-856e-b9046850ea66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:13.759180 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565410d8-d661-4bf7-856e-b9046850ea66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:13.759697 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565410d8-d661-4bf7-856e-b9046850ea66 admin admin] PATH_INFO: `/v3/projects/ee307260985749829b274fd68e016ec6` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:13.761166 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565410d8-d661-4bf7-856e-b9046850ea66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee307260985749829b274fd68e016ec6)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:13.763061 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565410d8-d661-4bf7-856e-b9046850ea66 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:13.813541 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-565410d8-d661-4bf7-856e-b9046850ea66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee307260985749829b274fd68e016ec6', 'request_id': 'req-565410d8-d661-4bf7-856e-b9046850ea66'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:13.821285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-565410d8-d661-4bf7-856e-b9046850ea66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee307260985749829b274fd68e016ec6', 'request_id': 'req-565410d8-d661-4bf7-856e-b9046850ea66'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:13.828449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-565410d8-d661-4bf7-856e-b9046850ea66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee307260985749829b274fd68e016ec6', 'request_id': 'req-565410d8-d661-4bf7-856e-b9046850ea66'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:13.842837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-565410d8-d661-4bf7-856e-b9046850ea66 admin admin] The token cache is being invalidate because project ee307260985749829b274fd68e016ec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:13.843126 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-565410d8-d661-4bf7-856e-b9046850ea66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:13.843770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-565410d8-d661-4bf7-856e-b9046850ea66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:13.845591 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1028/2011] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:13 2022] DELETE /identity/v3/projects/ee307260985749829b274fd68e016ec6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:13.849454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133314c-3089-4ccf-87b4-8498ff0d9800 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:13.860699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133314c-3089-4ccf-87b4-8498ff0d9800 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:13.928796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19121556-40e9-4900-ab2d-8bc3b26ad9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:13.929592 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19121556-40e9-4900-ab2d-8bc3b26ad9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:13.929870 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19121556-40e9-4900-ab2d-8bc3b26ad9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:13.930142 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19121556-40e9-4900-ab2d-8bc3b26ad9e3 admin admin] PATH_INFO: `/v3/users/2a5c05643e944ff4b99f9a4e669b6ae8` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:13.931346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19121556-40e9-4900-ab2d-8bc3b26ad9e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a5c05643e944ff4b99f9a4e669b6ae8)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:13.933315 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19121556-40e9-4900-ab2d-8bc3b26ad9e3 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:13.987288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-19121556-40e9-4900-ab2d-8bc3b26ad9e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a5c05643e944ff4b99f9a4e669b6ae8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:13.987964 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-19121556-40e9-4900-ab2d-8bc3b26ad9e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a5c05643e944ff4b99f9a4e669b6ae8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:14.003269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-19121556-40e9-4900-ab2d-8bc3b26ad9e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a5c05643e944ff4b99f9a4e669b6ae8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:14.011583 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-19121556-40e9-4900-ab2d-8bc3b26ad9e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a5c05643e944ff4b99f9a4e669b6ae8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:14.012245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-19121556-40e9-4900-ab2d-8bc3b26ad9e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a5c05643e944ff4b99f9a4e669b6ae8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:14.024716 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 984/2012] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:13 2022] DELETE /identity/v3/users/2a5c05643e944ff4b99f9a4e669b6ae8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:14.289369 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565410d8-d661-4bf7-856e-b9046850ea66 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:14.290809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-565410d8-d661-4bf7-856e-b9046850ea66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:14.304037 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565410d8-d661-4bf7-856e-b9046850ea66 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:14.360519 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958047c-24c4-4fd2-a852-8b783ac7816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:14.361376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958047c-24c4-4fd2-a852-8b783ac7816d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:14.361661 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958047c-24c4-4fd2-a852-8b783ac7816d admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:14.361990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958047c-24c4-4fd2-a852-8b783ac7816d admin admin] PATH_INFO: `/v3/projects/14c64ebeac374914b1459ce1b7da7bab` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:14.363165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958047c-24c4-4fd2-a852-8b783ac7816d admin admin] RBAC: Authorizing `identity:delete_project(project_id=14c64ebeac374914b1459ce1b7da7bab)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:14.365155 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958047c-24c4-4fd2-a852-8b783ac7816d admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:14.420765 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-5958047c-24c4-4fd2-a852-8b783ac7816d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14c64ebeac374914b1459ce1b7da7bab', 'request_id': 'req-5958047c-24c4-4fd2-a852-8b783ac7816d'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:14.428997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-5958047c-24c4-4fd2-a852-8b783ac7816d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14c64ebeac374914b1459ce1b7da7bab', 'request_id': 'req-5958047c-24c4-4fd2-a852-8b783ac7816d'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:14.434363 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-5958047c-24c4-4fd2-a852-8b783ac7816d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14c64ebeac374914b1459ce1b7da7bab', 'request_id': 'req-5958047c-24c4-4fd2-a852-8b783ac7816d'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:14.445271 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-5958047c-24c4-4fd2-a852-8b783ac7816d admin admin] The token cache is being invalidate because project 14c64ebeac374914b1459ce1b7da7bab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:14.445552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-5958047c-24c4-4fd2-a852-8b783ac7816d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:14.446234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-5958047c-24c4-4fd2-a852-8b783ac7816d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:14.447815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1029/2013] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:14 2022] DELETE /identity/v3/projects/14c64ebeac374914b1459ce1b7da7bab => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:14.453134 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a204cf-58a4-444f-b11b-989592131769 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:14.453319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a204cf-58a4-444f-b11b-989592131769 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:14.453594 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a204cf-58a4-444f-b11b-989592131769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:14.471329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-43a204cf-58a4-444f-b11b-989592131769 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:14.472557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-43a204cf-58a4-444f-b11b-989592131769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:14.531913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 985/2014] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:14.539936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa98b5-94f0-46d1-b678-22ccacf947b2 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:14.540256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa98b5-94f0-46d1-b678-22ccacf947b2 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:14.540540 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa98b5-94f0-46d1-b678-22ccacf947b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:14.558874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-cafa98b5-94f0-46d1-b678-22ccacf947b2 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:14.560060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cafa98b5-94f0-46d1-b678-22ccacf947b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:14.568252 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1030/2015] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:14.573288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a204cf-58a4-444f-b11b-989592131769 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:14.582933 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a204cf-58a4-444f-b11b-989592131769 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:14.588157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c79cb-bfd5-47ee-8452-acd19c33c685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:14.589670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c79cb-bfd5-47ee-8452-acd19c33c685 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:14.590041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c79cb-bfd5-47ee-8452-acd19c33c685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:14.590321 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c79cb-bfd5-47ee-8452-acd19c33c685 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:14.591119 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c79cb-bfd5-47ee-8452-acd19c33c685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:14.591626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c79cb-bfd5-47ee-8452-acd19c33c685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:14.593359 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c79cb-bfd5-47ee-8452-acd19c33c685 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:14.606134 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 986/2016] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:14.616077 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa98b5-94f0-46d1-b678-22ccacf947b2 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:14.628150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa98b5-94f0-46d1-b678-22ccacf947b2 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:14.633363 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eabc5e-bafb-4d87-98ee-1b96de2980b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:14.634018 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eabc5e-bafb-4d87-98ee-1b96de2980b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:14.634296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eabc5e-bafb-4d87-98ee-1b96de2980b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:14.634569 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eabc5e-bafb-4d87-98ee-1b96de2980b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:14.635258 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eabc5e-bafb-4d87-98ee-1b96de2980b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:14.637677 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eabc5e-bafb-4d87-98ee-1b96de2980b0 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:14.671959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1031/2017] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:14 2022] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:14.676334 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c79cb-bfd5-47ee-8452-acd19c33c685 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:14.689097 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c79cb-bfd5-47ee-8452-acd19c33c685 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:14.746922 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3dee8-ff55-4fd3-afa9-37df717ed47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:14.747053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3dee8-ff55-4fd3-afa9-37df717ed47c admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:14.747274 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3dee8-ff55-4fd3-afa9-37df717ed47c admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:14.747546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3dee8-ff55-4fd3-afa9-37df717ed47c admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:14.748922 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3dee8-ff55-4fd3-afa9-37df717ed47c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:14.750849 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3dee8-ff55-4fd3-afa9-37df717ed47c admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:14.773829 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 987/2018] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:14 2022] POST /identity/v3/users => generated 305 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:14.775258 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eabc5e-bafb-4d87-98ee-1b96de2980b0 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:14.785546 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eabc5e-bafb-4d87-98ee-1b96de2980b0 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:14.790223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8ec26-b764-4620-be6c-8a4286aa51fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:14.790971 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8ec26-b764-4620-be6c-8a4286aa51fa admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:14.791319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8ec26-b764-4620-be6c-8a4286aa51fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:14.792304 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8ec26-b764-4620-be6c-8a4286aa51fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:14.793158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8ec26-b764-4620-be6c-8a4286aa51fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:14.794795 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8ec26-b764-4620-be6c-8a4286aa51fa admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:14.808902 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1032/2019] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:14.810410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3dee8-ff55-4fd3-afa9-37df717ed47c admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:14.820601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3dee8-ff55-4fd3-afa9-37df717ed47c admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:14.825187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a645e3-385c-467e-928a-f2a471cd3af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:14.825826 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a645e3-385c-467e-928a-f2a471cd3af8 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:14.826102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a645e3-385c-467e-928a-f2a471cd3af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:14.826371 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a645e3-385c-467e-928a-f2a471cd3af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:14.827105 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a645e3-385c-467e-928a-f2a471cd3af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:14.828820 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a645e3-385c-467e-928a-f2a471cd3af8 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:14.838275 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 988/2020] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:14.842429 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8ec26-b764-4620-be6c-8a4286aa51fa admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:14.851970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8ec26-b764-4620-be6c-8a4286aa51fa admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:14.857077 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757476e-424d-4935-9b8b-cb3ff33d5d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:14.857936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757476e-424d-4935-9b8b-cb3ff33d5d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:14.858205 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757476e-424d-4935-9b8b-cb3ff33d5d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:14.858472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757476e-424d-4935-9b8b-cb3ff33d5d33 admin admin] PATH_INFO: `/v3/projects/d9b180629017459e9bd16a710d73bf82/users/bf00650226084105b78fe6a90a7bcb46/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:14.873919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757476e-424d-4935-9b8b-cb3ff33d5d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b180629017459e9bd16a710d73bf82, user_id=bf00650226084105b78fe6a90a7bcb46, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:14.876549 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757476e-424d-4935-9b8b-cb3ff33d5d33 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:14.888652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1033/2021] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:14 2022] PUT /identity/v3/projects/d9b180629017459e9bd16a710d73bf82/users/bf00650226084105b78fe6a90a7bcb46/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:14.900513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6b5b4-e545-4edf-9054-2359cf96120b None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:14.901578 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6b5b4-e545-4edf-9054-2359cf96120b None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:14.901750 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6b5b4-e545-4edf-9054-2359cf96120b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:14.928859 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-dfb6b5b4-e545-4edf-9054-2359cf96120b None None] MFA Rules not processed for user `bf00650226084105b78fe6a90a7bcb46`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:14.930098 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-dfb6b5b4-e545-4edf-9054-2359cf96120b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:15.001362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 989/2022] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:14 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:15.005756 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757476e-424d-4935-9b8b-cb3ff33d5d33 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:15.068720 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757476e-424d-4935-9b8b-cb3ff33d5d33 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:15.073830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d31a8-1113-486b-ad3e-38ac7f84abea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:15.074475 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d31a8-1113-486b-ad3e-38ac7f84abea admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:15.074749 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d31a8-1113-486b-ad3e-38ac7f84abea admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:15.075020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d31a8-1113-486b-ad3e-38ac7f84abea admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:15.075692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d31a8-1113-486b-ad3e-38ac7f84abea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:15.077618 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d31a8-1113-486b-ad3e-38ac7f84abea admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:15.101317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1034/2023] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:15 2022] POST /identity/v3/projects => generated 409 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:15.105390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6b5b4-e545-4edf-9054-2359cf96120b None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:15.115977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6b5b4-e545-4edf-9054-2359cf96120b None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:15.169000 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51606995-90bf-44c5-b84e-c1a4222ce933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:15.169649 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606995-90bf-44c5-b84e-c1a4222ce933 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:15.169932 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606995-90bf-44c5-b84e-c1a4222ce933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:15.170207 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606995-90bf-44c5-b84e-c1a4222ce933 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:15.170878 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51606995-90bf-44c5-b84e-c1a4222ce933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:15.172803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51606995-90bf-44c5-b84e-c1a4222ce933 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:15.192111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 990/2024] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:15 2022] POST /identity/v3/users => generated 311 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:15.196006 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d31a8-1113-486b-ad3e-38ac7f84abea admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:15.206621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d31a8-1113-486b-ad3e-38ac7f84abea admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:15.211731 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05a4b8-45a9-415c-baeb-621a7ee06ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:15.212504 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05a4b8-45a9-415c-baeb-621a7ee06ead admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:15.212787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05a4b8-45a9-415c-baeb-621a7ee06ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:15.213061 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05a4b8-45a9-415c-baeb-621a7ee06ead admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:15.213806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05a4b8-45a9-415c-baeb-621a7ee06ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:15.215374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05a4b8-45a9-415c-baeb-621a7ee06ead admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:15.225565 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1035/2025] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:15.230032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51606995-90bf-44c5-b84e-c1a4222ce933 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:15.239631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51606995-90bf-44c5-b84e-c1a4222ce933 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:15.244187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d547b1-a898-4400-8c2a-dfb40decb82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:15.245598 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d547b1-a898-4400-8c2a-dfb40decb82b admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:15.245872 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d547b1-a898-4400-8c2a-dfb40decb82b admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:15.246146 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d547b1-a898-4400-8c2a-dfb40decb82b admin admin] PATH_INFO: `/v3/projects/accb4e54536a4a26a07cc88aaeaabeb6/users/cb53a9b18efa42fc8ca1b99bc3230498/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:15.260127 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d547b1-a898-4400-8c2a-dfb40decb82b admin admin] RBAC: Authorizing `identity:create_grant(project_id=accb4e54536a4a26a07cc88aaeaabeb6, user_id=cb53a9b18efa42fc8ca1b99bc3230498, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:15.262714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d547b1-a898-4400-8c2a-dfb40decb82b admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:15.276031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 991/2026] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:15 2022] PUT /identity/v3/projects/accb4e54536a4a26a07cc88aaeaabeb6/users/cb53a9b18efa42fc8ca1b99bc3230498/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:15.279858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05a4b8-45a9-415c-baeb-621a7ee06ead admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:15.289488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05a4b8-45a9-415c-baeb-621a7ee06ead admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:15.347326 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8d87a-7428-420c-a937-3cfb5be3f56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:15.347966 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8d87a-7428-420c-a937-3cfb5be3f56d admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:15.348289 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8d87a-7428-420c-a937-3cfb5be3f56d admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:15.348548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8d87a-7428-420c-a937-3cfb5be3f56d admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:15.349301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8d87a-7428-420c-a937-3cfb5be3f56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:15.350933 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8d87a-7428-420c-a937-3cfb5be3f56d admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:15.360613 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1036/2027] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:15.364704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d547b1-a898-4400-8c2a-dfb40decb82b admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:15.374907 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d547b1-a898-4400-8c2a-dfb40decb82b admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:15.381144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ae20f-ab5b-46d9-ab7a-1463ae2673ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:15.382026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ae20f-ab5b-46d9-ab7a-1463ae2673ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:15.382304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ae20f-ab5b-46d9-ab7a-1463ae2673ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:15.383046 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ae20f-ab5b-46d9-ab7a-1463ae2673ac admin admin] PATH_INFO: `/v3/projects/accb4e54536a4a26a07cc88aaeaabeb6/users/cb53a9b18efa42fc8ca1b99bc3230498/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:15.385163 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ae20f-ab5b-46d9-ab7a-1463ae2673ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=accb4e54536a4a26a07cc88aaeaabeb6, user_id=cb53a9b18efa42fc8ca1b99bc3230498, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:15.388267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ae20f-ab5b-46d9-ab7a-1463ae2673ac admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:15.398959 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 992/2028] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:15 2022] PUT /identity/v3/projects/accb4e54536a4a26a07cc88aaeaabeb6/users/cb53a9b18efa42fc8ca1b99bc3230498/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:15.409642 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095214c6-db18-4221-ac97-c98d64459163 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:15.409937 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095214c6-db18-4221-ac97-c98d64459163 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:15.410220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095214c6-db18-4221-ac97-c98d64459163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:15.436592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-095214c6-db18-4221-ac97-c98d64459163 None None] MFA Rules not processed for user `cb53a9b18efa42fc8ca1b99bc3230498`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:15.437778 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-095214c6-db18-4221-ac97-c98d64459163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:15.502679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1037/2029] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:15 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:15.517105 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ae20f-ab5b-46d9-ab7a-1463ae2673ac admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:15.518818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8a5ae20f-ab5b-46d9-ab7a-1463ae2673ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:15.573415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ae20f-ab5b-46d9-ab7a-1463ae2673ac admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:15.577091 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300b9fb-3ce9-4c9a-8579-5928ab23fdc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:15.577719 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300b9fb-3ce9-4c9a-8579-5928ab23fdc8 service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:15.578000 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300b9fb-3ce9-4c9a-8579-5928ab23fdc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:15.578275 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300b9fb-3ce9-4c9a-8579-5928ab23fdc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:15.588445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300b9fb-3ce9-4c9a-8579-5928ab23fdc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:15.591033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300b9fb-3ce9-4c9a-8579-5928ab23fdc8 service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:15.602440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 993/2030] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:15 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:15.751379 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095214c6-db18-4221-ac97-c98d64459163 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:15.760525 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095214c6-db18-4221-ac97-c98d64459163 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:15.764139 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936b84d-8367-4cff-8917-c16427ae595c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:15.764736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936b84d-8367-4cff-8917-c16427ae595c service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:15.765014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936b84d-8367-4cff-8917-c16427ae595c service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:15.765285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936b84d-8367-4cff-8917-c16427ae595c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:15.824379 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936b84d-8367-4cff-8917-c16427ae595c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:15.825808 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936b84d-8367-4cff-8917-c16427ae595c service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:15.835002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1038/2031] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:15 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:23.401851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300b9fb-3ce9-4c9a-8579-5928ab23fdc8 service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:23.403241 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8300b9fb-3ce9-4c9a-8579-5928ab23fdc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:23.465942 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300b9fb-3ce9-4c9a-8579-5928ab23fdc8 service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:23.470512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d389b0-9f33-4eb8-aa10-fd0dad043670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:23.471377 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d389b0-9f33-4eb8-aa10-fd0dad043670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:23.471677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d389b0-9f33-4eb8-aa10-fd0dad043670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:23.471953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d389b0-9f33-4eb8-aa10-fd0dad043670 admin admin] PATH_INFO: `/v3/users/671dcda09f1d4c768b3e7827c707fd77` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:23.473167 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d389b0-9f33-4eb8-aa10-fd0dad043670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=671dcda09f1d4c768b3e7827c707fd77)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:23.475079 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d389b0-9f33-4eb8-aa10-fd0dad043670 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:23.518108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936b84d-8367-4cff-8917-c16427ae595c service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:23.519728 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b936b84d-8367-4cff-8917-c16427ae595c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:23.525223 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-e3d389b0-9f33-4eb8-aa10-fd0dad043670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '671dcda09f1d4c768b3e7827c707fd77'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:23.526434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-e3d389b0-9f33-4eb8-aa10-fd0dad043670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '671dcda09f1d4c768b3e7827c707fd77'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:23.534374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936b84d-8367-4cff-8917-c16427ae595c service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:23.538410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-e3d389b0-9f33-4eb8-aa10-fd0dad043670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '671dcda09f1d4c768b3e7827c707fd77'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:23.539286 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042de037-00d4-46f9-a97c-3e50e11006db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:23.540271 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042de037-00d4-46f9-a97c-3e50e11006db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:23.540710 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042de037-00d4-46f9-a97c-3e50e11006db admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:23.541119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042de037-00d4-46f9-a97c-3e50e11006db admin admin] PATH_INFO: `/v3/users/628a41b3df594a6eb1c63dc71d5aa9aa` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:23.542513 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042de037-00d4-46f9-a97c-3e50e11006db admin admin] RBAC: Authorizing `identity:delete_user(user_id=628a41b3df594a6eb1c63dc71d5aa9aa)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:23.544676 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042de037-00d4-46f9-a97c-3e50e11006db admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:23.548109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-e3d389b0-9f33-4eb8-aa10-fd0dad043670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '671dcda09f1d4c768b3e7827c707fd77'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:23.548840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-e3d389b0-9f33-4eb8-aa10-fd0dad043670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '671dcda09f1d4c768b3e7827c707fd77'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:23.562709 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 994/2032] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:23 2022] DELETE /identity/v3/users/671dcda09f1d4c768b3e7827c707fd77 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:23.567310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbbbdf-2cf9-4b26-b3c2-9ccb77c6b95d None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:23.567428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbbbdf-2cf9-4b26-b3c2-9ccb77c6b95d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:23.567634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbbbdf-2cf9-4b26-b3c2-9ccb77c6b95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:23.586393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-bbdbbbdf-2cf9-4b26-b3c2-9ccb77c6b95d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:23.587879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-bbdbbbdf-2cf9-4b26-b3c2-9ccb77c6b95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:23.604981 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-042de037-00d4-46f9-a97c-3e50e11006db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '628a41b3df594a6eb1c63dc71d5aa9aa'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:23.617214 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-042de037-00d4-46f9-a97c-3e50e11006db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '628a41b3df594a6eb1c63dc71d5aa9aa'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:23.625062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-042de037-00d4-46f9-a97c-3e50e11006db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '628a41b3df594a6eb1c63dc71d5aa9aa'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:23.625837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-042de037-00d4-46f9-a97c-3e50e11006db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '628a41b3df594a6eb1c63dc71d5aa9aa'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:23.635464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-042de037-00d4-46f9-a97c-3e50e11006db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '628a41b3df594a6eb1c63dc71d5aa9aa'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:23.642269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1039/2033] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:23 2022] DELETE /identity/v3/users/628a41b3df594a6eb1c63dc71d5aa9aa => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:23.646646 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068180de-1f20-4332-ab4b-31dd5a6de77b None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:23.646992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068180de-1f20-4332-ab4b-31dd5a6de77b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:23.647349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068180de-1f20-4332-ab4b-31dd5a6de77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:23.657468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 995/2034] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:23.665200 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbbbdf-2cf9-4b26-b3c2-9ccb77c6b95d None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:23.666306 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-068180de-1f20-4332-ab4b-31dd5a6de77b None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:23.666683 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-bbdbbbdf-2cf9-4b26-b3c2-9ccb77c6b95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:23.667615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-068180de-1f20-4332-ab4b-31dd5a6de77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:23.725616 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbbbdf-2cf9-4b26-b3c2-9ccb77c6b95d None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:23.735236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1040/2035] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:23.741215 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068180de-1f20-4332-ab4b-31dd5a6de77b None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:23.803374 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63122f4-44e0-40c1-b459-33e4fc7c13fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:23.803896 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068180de-1f20-4332-ab4b-31dd5a6de77b None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:23.804235 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63122f4-44e0-40c1-b459-33e4fc7c13fe service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:23.804588 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63122f4-44e0-40c1-b459-33e4fc7c13fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:23.804952 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63122f4-44e0-40c1-b459-33e4fc7c13fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:23.809678 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8005a1-a60c-4b26-a0ef-69fb007edd85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:23.810526 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8005a1-a60c-4b26-a0ef-69fb007edd85 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:23.811010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8005a1-a60c-4b26-a0ef-69fb007edd85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:23.811424 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8005a1-a60c-4b26-a0ef-69fb007edd85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:23.818091 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63122f4-44e0-40c1-b459-33e4fc7c13fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:23.819826 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63122f4-44e0-40c1-b459-33e4fc7c13fe service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:23.822171 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8005a1-a60c-4b26-a0ef-69fb007edd85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:23.823807 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8005a1-a60c-4b26-a0ef-69fb007edd85 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:23.832574 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 996/2036] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:23.834196 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1041/2037] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:24.301122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63122f4-44e0-40c1-b459-33e4fc7c13fe service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:24.302987 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-f63122f4-44e0-40c1-b459-33e4fc7c13fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:24.307077 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8005a1-a60c-4b26-a0ef-69fb007edd85 service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:24.308505 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ef8005a1-a60c-4b26-a0ef-69fb007edd85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:24.318950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63122f4-44e0-40c1-b459-33e4fc7c13fe service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:24.326154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a8d64-7a43-4508-b87f-40a4e47f2a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:24.327840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a8d64-7a43-4508-b87f-40a4e47f2a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:24.328122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a8d64-7a43-4508-b87f-40a4e47f2a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:24.328430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a8d64-7a43-4508-b87f-40a4e47f2a49 admin admin] PATH_INFO: `/v3/projects/8dd585bf26b2480ca4ed8c0c0f8b0293` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:24.330007 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a8d64-7a43-4508-b87f-40a4e47f2a49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd585bf26b2480ca4ed8c0c0f8b0293)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:24.332555 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a8d64-7a43-4508-b87f-40a4e47f2a49 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:24.333681 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8005a1-a60c-4b26-a0ef-69fb007edd85 service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:24.339548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6256149-a45e-42dc-a6ca-b707be7a26ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:24.340539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6256149-a45e-42dc-a6ca-b707be7a26ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:24.340722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6256149-a45e-42dc-a6ca-b707be7a26ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:24.340993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6256149-a45e-42dc-a6ca-b707be7a26ff admin admin] PATH_INFO: `/v3/projects/64ce5a253da0446eb63617480a8f6a72` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:24.342220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6256149-a45e-42dc-a6ca-b707be7a26ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ce5a253da0446eb63617480a8f6a72)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:24.344106 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6256149-a45e-42dc-a6ca-b707be7a26ff admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:24.383745 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-8e8a8d64-7a43-4508-b87f-40a4e47f2a49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd585bf26b2480ca4ed8c0c0f8b0293', 'request_id': 'req-8e8a8d64-7a43-4508-b87f-40a4e47f2a49'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.390455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-8e8a8d64-7a43-4508-b87f-40a4e47f2a49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd585bf26b2480ca4ed8c0c0f8b0293', 'request_id': 'req-8e8a8d64-7a43-4508-b87f-40a4e47f2a49'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.394613 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a6256149-a45e-42dc-a6ca-b707be7a26ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ce5a253da0446eb63617480a8f6a72', 'request_id': 'req-a6256149-a45e-42dc-a6ca-b707be7a26ff'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.396875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-8e8a8d64-7a43-4508-b87f-40a4e47f2a49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd585bf26b2480ca4ed8c0c0f8b0293', 'request_id': 'req-8e8a8d64-7a43-4508-b87f-40a4e47f2a49'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.403066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a6256149-a45e-42dc-a6ca-b707be7a26ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ce5a253da0446eb63617480a8f6a72', 'request_id': 'req-a6256149-a45e-42dc-a6ca-b707be7a26ff'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.408830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a6256149-a45e-42dc-a6ca-b707be7a26ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ce5a253da0446eb63617480a8f6a72', 'request_id': 'req-a6256149-a45e-42dc-a6ca-b707be7a26ff'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.410110 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-8e8a8d64-7a43-4508-b87f-40a4e47f2a49 admin admin] The token cache is being invalidate because project 8dd585bf26b2480ca4ed8c0c0f8b0293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:24.410553 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-8e8a8d64-7a43-4508-b87f-40a4e47f2a49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.411098 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-8e8a8d64-7a43-4508-b87f-40a4e47f2a49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.412694 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 997/2038] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:24 2022] DELETE /identity/v3/projects/8dd585bf26b2480ca4ed8c0c0f8b0293 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:24.417999 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd06103-0ea6-431d-a83b-bb81ef94a12e None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:24.418284 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd06103-0ea6-431d-a83b-bb81ef94a12e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:24.418572 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd06103-0ea6-431d-a83b-bb81ef94a12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:24.420565 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a6256149-a45e-42dc-a6ca-b707be7a26ff admin admin] The token cache is being invalidate because project 64ce5a253da0446eb63617480a8f6a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:24.420683 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a6256149-a45e-42dc-a6ca-b707be7a26ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.421406 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a6256149-a45e-42dc-a6ca-b707be7a26ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.422972 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1042/2039] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:24 2022] DELETE /identity/v3/projects/64ce5a253da0446eb63617480a8f6a72 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:24.426679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6256149-a45e-42dc-a6ca-b707be7a26ff admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:24.427986 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a6256149-a45e-42dc-a6ca-b707be7a26ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:24.437064 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-7cd06103-0ea6-431d-a83b-bb81ef94a12e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:24.438215 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-7cd06103-0ea6-431d-a83b-bb81ef94a12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:24.491303 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6256149-a45e-42dc-a6ca-b707be7a26ff admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:24.495047 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 998/2040] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:24.496014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231389c-5e3d-4934-896f-0188d5066901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:24.496911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231389c-5e3d-4934-896f-0188d5066901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:24.497181 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231389c-5e3d-4934-896f-0188d5066901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:24.497447 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231389c-5e3d-4934-896f-0188d5066901 admin admin] PATH_INFO: `/v3/users/c4418f8a7497436c97d5985649eece28` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:24.498636 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231389c-5e3d-4934-896f-0188d5066901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4418f8a7497436c97d5985649eece28)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:24.500581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231389c-5e3d-4934-896f-0188d5066901 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:24.502594 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975dabf-c66c-4f04-93d6-76080e7dcb28 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:24.502877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975dabf-c66c-4f04-93d6-76080e7dcb28 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:24.503151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975dabf-c66c-4f04-93d6-76080e7dcb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:24.521445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-a975dabf-c66c-4f04-93d6-76080e7dcb28 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:24.522881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a975dabf-c66c-4f04-93d6-76080e7dcb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:24.532099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 999/2041] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:24.536750 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975dabf-c66c-4f04-93d6-76080e7dcb28 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:24.545832 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975dabf-c66c-4f04-93d6-76080e7dcb28 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:24.548876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6231389c-5e3d-4934-896f-0188d5066901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4418f8a7497436c97d5985649eece28'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.550774 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d4340-d078-492e-ab21-82870efb1313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:24.551413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d4340-d078-492e-ab21-82870efb1313 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:24.551784 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d4340-d078-492e-ab21-82870efb1313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:24.551964 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d4340-d078-492e-ab21-82870efb1313 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:24.552714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d4340-d078-492e-ab21-82870efb1313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:24.553018 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d4340-d078-492e-ab21-82870efb1313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:24.554592 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d4340-d078-492e-ab21-82870efb1313 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:24.561006 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6231389c-5e3d-4934-896f-0188d5066901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4418f8a7497436c97d5985649eece28'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.566169 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1000/2042] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:01:24.567948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6231389c-5e3d-4934-896f-0188d5066901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4418f8a7497436c97d5985649eece28'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.568784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6231389c-5e3d-4934-896f-0188d5066901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4418f8a7497436c97d5985649eece28'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.570306 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d4340-d078-492e-ab21-82870efb1313 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:24.571928 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0d9d4340-d078-492e-ab21-82870efb1313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:24.578559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6231389c-5e3d-4934-896f-0188d5066901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4418f8a7497436c97d5985649eece28'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.584919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1043/2043] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:24 2022] DELETE /identity/v3/users/c4418f8a7497436c97d5985649eece28 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:24.585844 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d4340-d078-492e-ab21-82870efb1313 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:24.644305 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92137ba8-6e5c-46c2-ae8e-333591776e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:24.645089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92137ba8-6e5c-46c2-ae8e-333591776e41 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:24.645334 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92137ba8-6e5c-46c2-ae8e-333591776e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:24.645619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92137ba8-6e5c-46c2-ae8e-333591776e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:24.646283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92137ba8-6e5c-46c2-ae8e-333591776e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:24.648630 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92137ba8-6e5c-46c2-ae8e-333591776e41 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:24.677772 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1001/2044] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:24 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:24.679081 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231389c-5e3d-4934-896f-0188d5066901 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:24.690086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231389c-5e3d-4934-896f-0188d5066901 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:24.752076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03d70c-052f-4847-80b1-1ae28d5a3fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:24.752842 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03d70c-052f-4847-80b1-1ae28d5a3fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:24.753117 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03d70c-052f-4847-80b1-1ae28d5a3fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:24.753386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03d70c-052f-4847-80b1-1ae28d5a3fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:24.754074 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03d70c-052f-4847-80b1-1ae28d5a3fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:24.755981 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03d70c-052f-4847-80b1-1ae28d5a3fe6 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:24.776373 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1044/2045] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:24 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:24.780381 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92137ba8-6e5c-46c2-ae8e-333591776e41 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:24.791252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92137ba8-6e5c-46c2-ae8e-333591776e41 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:24.795967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fab0e-0426-490f-97cc-32ee5f596197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:24.796724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fab0e-0426-490f-97cc-32ee5f596197 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:24.797070 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fab0e-0426-490f-97cc-32ee5f596197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:24.797409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fab0e-0426-490f-97cc-32ee5f596197 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:24.798206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fab0e-0426-490f-97cc-32ee5f596197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:24.799853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fab0e-0426-490f-97cc-32ee5f596197 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:24.810313 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1002/2046] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:24.814261 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03d70c-052f-4847-80b1-1ae28d5a3fe6 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:24.825029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03d70c-052f-4847-80b1-1ae28d5a3fe6 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:24.829746 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbaa50-ba89-495a-89b1-a2c8f5f98285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:24.830403 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbaa50-ba89-495a-89b1-a2c8f5f98285 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:24.830677 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbaa50-ba89-495a-89b1-a2c8f5f98285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:24.830947 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbaa50-ba89-495a-89b1-a2c8f5f98285 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:24.831664 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbaa50-ba89-495a-89b1-a2c8f5f98285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:24.833312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbaa50-ba89-495a-89b1-a2c8f5f98285 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:24.843772 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1045/2047] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:24.847709 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fab0e-0426-490f-97cc-32ee5f596197 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:24.858555 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fab0e-0426-490f-97cc-32ee5f596197 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:24.865696 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbaa50-ba89-495a-89b1-a2c8f5f98285 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:24.867778 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-7cbbaa50-ba89-495a-89b1-a2c8f5f98285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:24.877916 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657aa984-062d-4f67-ad14-c90733bb40f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:24.878852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657aa984-062d-4f67-ad14-c90733bb40f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:24.879133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657aa984-062d-4f67-ad14-c90733bb40f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:24.879457 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657aa984-062d-4f67-ad14-c90733bb40f3 admin admin] PATH_INFO: `/v3/projects/36182fe0c2a742e185c252ab83d86b1b/users/46a3d0998b4e4637a9348a3f20223852/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:24.885564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbaa50-ba89-495a-89b1-a2c8f5f98285 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:24.890749 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e23676-f9e4-47f7-ad90-13bdce783e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:24.891750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e23676-f9e4-47f7-ad90-13bdce783e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:24.892126 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e23676-f9e4-47f7-ad90-13bdce783e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:24.892847 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e23676-f9e4-47f7-ad90-13bdce783e6a admin admin] PATH_INFO: `/v3/projects/1f1acb28d1bd492dacf3bc14e9027124` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:24.894259 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e23676-f9e4-47f7-ad90-13bdce783e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f1acb28d1bd492dacf3bc14e9027124)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:24.898937 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e23676-f9e4-47f7-ad90-13bdce783e6a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:24.917204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657aa984-062d-4f67-ad14-c90733bb40f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36182fe0c2a742e185c252ab83d86b1b, user_id=46a3d0998b4e4637a9348a3f20223852, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:24.919848 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657aa984-062d-4f67-ad14-c90733bb40f3 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:24.934985 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1003/2048] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:24 2022] PUT /identity/v3/projects/36182fe0c2a742e185c252ab83d86b1b/users/46a3d0998b4e4637a9348a3f20223852/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:24.946476 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a60659-54e9-4c46-9154-b08be86d243d None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:24.946946 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a60659-54e9-4c46-9154-b08be86d243d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:24.947278 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a60659-54e9-4c46-9154-b08be86d243d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:24.956016 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-56e23676-f9e4-47f7-ad90-13bdce783e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f1acb28d1bd492dacf3bc14e9027124', 'request_id': 'req-56e23676-f9e4-47f7-ad90-13bdce783e6a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.964242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-56e23676-f9e4-47f7-ad90-13bdce783e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f1acb28d1bd492dacf3bc14e9027124', 'request_id': 'req-56e23676-f9e4-47f7-ad90-13bdce783e6a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.971033 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-56e23676-f9e4-47f7-ad90-13bdce783e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f1acb28d1bd492dacf3bc14e9027124', 'request_id': 'req-56e23676-f9e4-47f7-ad90-13bdce783e6a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.975126 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-b3a60659-54e9-4c46-9154-b08be86d243d None None] MFA Rules not processed for user `46a3d0998b4e4637a9348a3f20223852`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:24.976402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b3a60659-54e9-4c46-9154-b08be86d243d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:24.983761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-56e23676-f9e4-47f7-ad90-13bdce783e6a admin admin] The token cache is being invalidate because project 1f1acb28d1bd492dacf3bc14e9027124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:24.984154 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-56e23676-f9e4-47f7-ad90-13bdce783e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.985239 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-56e23676-f9e4-47f7-ad90-13bdce783e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:24.988247 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1046/2049] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:24 2022] DELETE /identity/v3/projects/1f1acb28d1bd492dacf3bc14e9027124 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:24.997323 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e23676-f9e4-47f7-ad90-13bdce783e6a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:24.998754 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-56e23676-f9e4-47f7-ad90-13bdce783e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:25.047766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1004/2050] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:25.061833 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a60659-54e9-4c46-9154-b08be86d243d None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:25.063324 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b3a60659-54e9-4c46-9154-b08be86d243d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:25.072081 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e23676-f9e4-47f7-ad90-13bdce783e6a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:25.078012 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978739f-24b2-49c3-bbab-1bdca6e33f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:25.078894 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978739f-24b2-49c3-bbab-1bdca6e33f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:25.079173 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978739f-24b2-49c3-bbab-1bdca6e33f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:25.079446 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978739f-24b2-49c3-bbab-1bdca6e33f08 admin admin] PATH_INFO: `/v3/users/077227635e9d45ccb75e2f5b9afabb3d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:25.080950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978739f-24b2-49c3-bbab-1bdca6e33f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=077227635e9d45ccb75e2f5b9afabb3d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:25.082872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978739f-24b2-49c3-bbab-1bdca6e33f08 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:25.143247 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c978739f-24b2-49c3-bbab-1bdca6e33f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '077227635e9d45ccb75e2f5b9afabb3d'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:25.156098 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c978739f-24b2-49c3-bbab-1bdca6e33f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '077227635e9d45ccb75e2f5b9afabb3d'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:25.158190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a60659-54e9-4c46-9154-b08be86d243d None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:25.162226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07e64d-3800-49d8-aa98-9f0ae5f56fc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:25.162865 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07e64d-3800-49d8-aa98-9f0ae5f56fc0 service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:25.163153 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07e64d-3800-49d8-aa98-9f0ae5f56fc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:25.163404 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c978739f-24b2-49c3-bbab-1bdca6e33f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '077227635e9d45ccb75e2f5b9afabb3d'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:25.163531 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07e64d-3800-49d8-aa98-9f0ae5f56fc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:25.164117 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c978739f-24b2-49c3-bbab-1bdca6e33f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '077227635e9d45ccb75e2f5b9afabb3d'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:25.165568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-6c07e64d-3800-49d8-aa98-9f0ae5f56fc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:25.172400 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c978739f-24b2-49c3-bbab-1bdca6e33f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '077227635e9d45ccb75e2f5b9afabb3d'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:25.177302 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07e64d-3800-49d8-aa98-9f0ae5f56fc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:25.178729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07e64d-3800-49d8-aa98-9f0ae5f56fc0 service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:25.179122 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1047/2051] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:24 2022] DELETE /identity/v3/users/077227635e9d45ccb75e2f5b9afabb3d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:25.188712 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1005/2052] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:25.311020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978739f-24b2-49c3-bbab-1bdca6e33f08 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:25.312614 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c978739f-24b2-49c3-bbab-1bdca6e33f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:25.392377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978739f-24b2-49c3-bbab-1bdca6e33f08 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:25.398641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df1880-8043-4e1f-baf5-d9601b4bb520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:25.399523 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df1880-8043-4e1f-baf5-d9601b4bb520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:25.399805 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df1880-8043-4e1f-baf5-d9601b4bb520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:25.400080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df1880-8043-4e1f-baf5-d9601b4bb520 admin admin] PATH_INFO: `/v3/users/bf00650226084105b78fe6a90a7bcb46` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:25.402083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df1880-8043-4e1f-baf5-d9601b4bb520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf00650226084105b78fe6a90a7bcb46)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:25.404752 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df1880-8043-4e1f-baf5-d9601b4bb520 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:25.459371 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-d3df1880-8043-4e1f-baf5-d9601b4bb520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf00650226084105b78fe6a90a7bcb46'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:25.472643 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-d3df1880-8043-4e1f-baf5-d9601b4bb520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf00650226084105b78fe6a90a7bcb46'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:25.480412 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-d3df1880-8043-4e1f-baf5-d9601b4bb520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf00650226084105b78fe6a90a7bcb46'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:25.481838 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-d3df1880-8043-4e1f-baf5-d9601b4bb520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf00650226084105b78fe6a90a7bcb46'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:25.489471 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-d3df1880-8043-4e1f-baf5-d9601b4bb520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf00650226084105b78fe6a90a7bcb46'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:25.495778 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1048/2053] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:25 2022] DELETE /identity/v3/users/bf00650226084105b78fe6a90a7bcb46 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:25.500621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c6df3-e49a-4c52-8212-a15fdfc4074f None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:25.501097 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c6df3-e49a-4c52-8212-a15fdfc4074f None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:25.501257 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c6df3-e49a-4c52-8212-a15fdfc4074f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:25.523496 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-1a7c6df3-e49a-4c52-8212-a15fdfc4074f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:25.524586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-1a7c6df3-e49a-4c52-8212-a15fdfc4074f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:25.533934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df1880-8043-4e1f-baf5-d9601b4bb520 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:25.536264 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d3df1880-8043-4e1f-baf5-d9601b4bb520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:25.612333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df1880-8043-4e1f-baf5-d9601b4bb520 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:25.626654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ea200-1f00-4418-9519-a3a169dd8e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:25.627831 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ea200-1f00-4418-9519-a3a169dd8e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:25.628260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ea200-1f00-4418-9519-a3a169dd8e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:25.628605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ea200-1f00-4418-9519-a3a169dd8e20 admin admin] PATH_INFO: `/v3/projects/6e413adab14b45e59271a0eaf52d919b` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:25.629955 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ea200-1f00-4418-9519-a3a169dd8e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e413adab14b45e59271a0eaf52d919b)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:25.632067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ea200-1f00-4418-9519-a3a169dd8e20 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:25.645662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1006/2054] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:25.656812 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c6df3-e49a-4c52-8212-a15fdfc4074f None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:25.658234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-1a7c6df3-e49a-4c52-8212-a15fdfc4074f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:25.687651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6b1ea200-1f00-4418-9519-a3a169dd8e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e413adab14b45e59271a0eaf52d919b', 'request_id': 'req-6b1ea200-1f00-4418-9519-a3a169dd8e20'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:25.696443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6b1ea200-1f00-4418-9519-a3a169dd8e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e413adab14b45e59271a0eaf52d919b', 'request_id': 'req-6b1ea200-1f00-4418-9519-a3a169dd8e20'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:25.702520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6b1ea200-1f00-4418-9519-a3a169dd8e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e413adab14b45e59271a0eaf52d919b', 'request_id': 'req-6b1ea200-1f00-4418-9519-a3a169dd8e20'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:25.713888 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6b1ea200-1f00-4418-9519-a3a169dd8e20 admin admin] The token cache is being invalidate because project 6e413adab14b45e59271a0eaf52d919b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:25.714172 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6b1ea200-1f00-4418-9519-a3a169dd8e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:25.714813 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6b1ea200-1f00-4418-9519-a3a169dd8e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:25.716436 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1049/2055] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:25 2022] DELETE /identity/v3/projects/6e413adab14b45e59271a0eaf52d919b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:25.720720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c6df3-e49a-4c52-8212-a15fdfc4074f None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:25.720980 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbe0bf-0d90-4393-827b-1a4e42e64b28 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:25.721266 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbe0bf-0d90-4393-827b-1a4e42e64b28 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:25.721545 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbe0bf-0d90-4393-827b-1a4e42e64b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:25.739960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-cfdbe0bf-0d90-4393-827b-1a4e42e64b28 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:25.741189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cfdbe0bf-0d90-4393-827b-1a4e42e64b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:25.769674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405a5cb-665f-4513-860c-29eb6af1144d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:25.770317 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405a5cb-665f-4513-860c-29eb6af1144d service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:25.770593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405a5cb-665f-4513-860c-29eb6af1144d service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:25.770861 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405a5cb-665f-4513-860c-29eb6af1144d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:25.772908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0405a5cb-665f-4513-860c-29eb6af1144d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:25.799141 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1050/2056] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:25.806562 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c2b07-ab20-4260-a666-eb58346fb700 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:25.806847 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c2b07-ab20-4260-a666-eb58346fb700 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:25.807120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c2b07-ab20-4260-a666-eb58346fb700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:25.825239 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-a21c2b07-ab20-4260-a666-eb58346fb700 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:25.826421 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a21c2b07-ab20-4260-a666-eb58346fb700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:25.833429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405a5cb-665f-4513-860c-29eb6af1144d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:25.834283 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1051/2057] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:25.834853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405a5cb-665f-4513-860c-29eb6af1144d service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:25.838735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c2b07-ab20-4260-a666-eb58346fb700 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:25.845254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1007/2058] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:25.847448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c2b07-ab20-4260-a666-eb58346fb700 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:25.852148 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1c030-51d0-40a9-9545-4cb52aeafe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:25.852819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1c030-51d0-40a9-9545-4cb52aeafe5e admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:25.853098 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1c030-51d0-40a9-9545-4cb52aeafe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:25.853371 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1c030-51d0-40a9-9545-4cb52aeafe5e admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:25.854122 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1c030-51d0-40a9-9545-4cb52aeafe5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:25.854423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1c030-51d0-40a9-9545-4cb52aeafe5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:25.856000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1c030-51d0-40a9-9545-4cb52aeafe5e admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:25.867370 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1052/2059] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:01:25.871753 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405a5cb-665f-4513-860c-29eb6af1144d service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:25.881188 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405a5cb-665f-4513-860c-29eb6af1144d service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:25.887957 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331df33-005b-4acc-9749-6c3939d9c672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:25.888660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331df33-005b-4acc-9749-6c3939d9c672 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:25.888946 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331df33-005b-4acc-9749-6c3939d9c672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:25.889219 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331df33-005b-4acc-9749-6c3939d9c672 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:25.889924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331df33-005b-4acc-9749-6c3939d9c672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:25.891816 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331df33-005b-4acc-9749-6c3939d9c672 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:25.920661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1008/2060] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:25 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:25.921979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1c030-51d0-40a9-9545-4cb52aeafe5e admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:25.932456 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1c030-51d0-40a9-9545-4cb52aeafe5e admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:25.990631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba44f1-1ac6-4e85-a13d-1644e4bdf737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:25.991704 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba44f1-1ac6-4e85-a13d-1644e4bdf737 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:25.991940 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba44f1-1ac6-4e85-a13d-1644e4bdf737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:25.992208 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba44f1-1ac6-4e85-a13d-1644e4bdf737 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:25.992900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba44f1-1ac6-4e85-a13d-1644e4bdf737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:25.994809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba44f1-1ac6-4e85-a13d-1644e4bdf737 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:26.017055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1053/2061] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:25 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:26.021259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331df33-005b-4acc-9749-6c3939d9c672 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:26.032476 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331df33-005b-4acc-9749-6c3939d9c672 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:26.037160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2ce17-4751-4bf7-9107-1da01b20e885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:26.037817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2ce17-4751-4bf7-9107-1da01b20e885 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:26.038103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2ce17-4751-4bf7-9107-1da01b20e885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:26.038373 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2ce17-4751-4bf7-9107-1da01b20e885 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:26.039087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2ce17-4751-4bf7-9107-1da01b20e885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:26.040846 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2ce17-4751-4bf7-9107-1da01b20e885 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:26.052623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1009/2062] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:26.056644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba44f1-1ac6-4e85-a13d-1644e4bdf737 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:26.067046 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba44f1-1ac6-4e85-a13d-1644e4bdf737 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:26.071970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccd0cd-3d31-45a0-b925-594d9e018930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:26.072654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccd0cd-3d31-45a0-b925-594d9e018930 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:26.072937 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccd0cd-3d31-45a0-b925-594d9e018930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:26.073214 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccd0cd-3d31-45a0-b925-594d9e018930 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:26.073934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccd0cd-3d31-45a0-b925-594d9e018930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:26.075507 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccd0cd-3d31-45a0-b925-594d9e018930 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:26.088244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1054/2063] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:26.089385 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2ce17-4751-4bf7-9107-1da01b20e885 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:26.099370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2ce17-4751-4bf7-9107-1da01b20e885 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:26.104772 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579baf9-9183-48d3-bb45-546118267e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:26.105655 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579baf9-9183-48d3-bb45-546118267e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:26.105938 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579baf9-9183-48d3-bb45-546118267e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:26.106194 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579baf9-9183-48d3-bb45-546118267e46 admin admin] PATH_INFO: `/v3/projects/104740054c3a47ca8cc3cb262d975fd5/users/9d87a4de3fbf4cbb9e21523634007629/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:26.124402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccd0cd-3d31-45a0-b925-594d9e018930 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:26.126333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-7eccd0cd-3d31-45a0-b925-594d9e018930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:26.126914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579baf9-9183-48d3-bb45-546118267e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104740054c3a47ca8cc3cb262d975fd5, user_id=9d87a4de3fbf4cbb9e21523634007629, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:26.130512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579baf9-9183-48d3-bb45-546118267e46 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:26.151110 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1010/2064] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:26 2022] PUT /identity/v3/projects/104740054c3a47ca8cc3cb262d975fd5/users/9d87a4de3fbf4cbb9e21523634007629/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:26.153350 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3fb5c-5d37-43ec-be03-0bc74e0e232d None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:26.153772 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3fb5c-5d37-43ec-be03-0bc74e0e232d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:26.154186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3fb5c-5d37-43ec-be03-0bc74e0e232d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:26.155104 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccd0cd-3d31-45a0-b925-594d9e018930 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:26.172396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-fbc3fb5c-5d37-43ec-be03-0bc74e0e232d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:26.173710 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-fbc3fb5c-5d37-43ec-be03-0bc74e0e232d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:26.211662 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:26.212474 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:26.212753 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:26.213549 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a admin admin] PATH_INFO: `/v3/projects/d9b180629017459e9bd16a710d73bf82` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:26.214732 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b180629017459e9bd16a710d73bf82)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:26.216680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:26.231337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1011/2065] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:26.241040 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3fb5c-5d37-43ec-be03-0bc74e0e232d None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:26.242393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-fbc3fb5c-5d37-43ec-be03-0bc74e0e232d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:26.264478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b180629017459e9bd16a710d73bf82', 'request_id': 'req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:26.272109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b180629017459e9bd16a710d73bf82', 'request_id': 'req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:26.278460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b180629017459e9bd16a710d73bf82', 'request_id': 'req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:26.289453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a admin admin] The token cache is being invalidate because project d9b180629017459e9bd16a710d73bf82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:26.289736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:26.290389 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:26.292594 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1055/2066] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:26 2022] DELETE /identity/v3/projects/d9b180629017459e9bd16a710d73bf82 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:26.296369 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:26.297674 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:26.299333 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3fb5c-5d37-43ec-be03-0bc74e0e232d None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:26.345018 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3d3fc-207a-404c-8d54-17a7b777c839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:26.345655 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3d3fc-207a-404c-8d54-17a7b777c839 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:26.345937 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3d3fc-207a-404c-8d54-17a7b777c839 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:26.346209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3d3fc-207a-404c-8d54-17a7b777c839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:26.348334 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-99b3d3fc-207a-404c-8d54-17a7b777c839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:26.358667 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23fa47-7717-4fc6-98f7-e09af58d6d4a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:26.360614 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3d3fc-207a-404c-8d54-17a7b777c839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:26.362050 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3d3fc-207a-404c-8d54-17a7b777c839 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:26.363400 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621337e5-2665-4634-92d4-984074f9b699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:26.364316 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621337e5-2665-4634-92d4-984074f9b699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:26.364599 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621337e5-2665-4634-92d4-984074f9b699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:26.364871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621337e5-2665-4634-92d4-984074f9b699 admin admin] PATH_INFO: `/v3/users/cb53a9b18efa42fc8ca1b99bc3230498` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:26.366047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621337e5-2665-4634-92d4-984074f9b699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb53a9b18efa42fc8ca1b99bc3230498)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:26.367929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621337e5-2665-4634-92d4-984074f9b699 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:26.371274 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1012/2067] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:26.418075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-621337e5-2665-4634-92d4-984074f9b699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb53a9b18efa42fc8ca1b99bc3230498'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:26.430618 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-621337e5-2665-4634-92d4-984074f9b699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb53a9b18efa42fc8ca1b99bc3230498'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:26.438127 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-621337e5-2665-4634-92d4-984074f9b699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb53a9b18efa42fc8ca1b99bc3230498'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:26.438874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-621337e5-2665-4634-92d4-984074f9b699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb53a9b18efa42fc8ca1b99bc3230498'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:26.447050 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-621337e5-2665-4634-92d4-984074f9b699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb53a9b18efa42fc8ca1b99bc3230498'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:26.453853 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1056/2068] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:26 2022] DELETE /identity/v3/users/cb53a9b18efa42fc8ca1b99bc3230498 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:26.879096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3d3fc-207a-404c-8d54-17a7b777c839 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:26.890039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3d3fc-207a-404c-8d54-17a7b777c839 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:26.946318 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cbb47-f2a2-43c3-b12a-490143a2cc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:26.947208 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cbb47-f2a2-43c3-b12a-490143a2cc83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:26.948053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cbb47-f2a2-43c3-b12a-490143a2cc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:26.948366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cbb47-f2a2-43c3-b12a-490143a2cc83 admin admin] PATH_INFO: `/v3/projects/accb4e54536a4a26a07cc88aaeaabeb6` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:26.949548 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cbb47-f2a2-43c3-b12a-490143a2cc83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=accb4e54536a4a26a07cc88aaeaabeb6)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:26.951486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cbb47-f2a2-43c3-b12a-490143a2cc83 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:27.004849 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-7f2cbb47-f2a2-43c3-b12a-490143a2cc83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'accb4e54536a4a26a07cc88aaeaabeb6', 'request_id': 'req-7f2cbb47-f2a2-43c3-b12a-490143a2cc83'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:27.011034 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-7f2cbb47-f2a2-43c3-b12a-490143a2cc83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'accb4e54536a4a26a07cc88aaeaabeb6', 'request_id': 'req-7f2cbb47-f2a2-43c3-b12a-490143a2cc83'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:27.017212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-7f2cbb47-f2a2-43c3-b12a-490143a2cc83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'accb4e54536a4a26a07cc88aaeaabeb6', 'request_id': 'req-7f2cbb47-f2a2-43c3-b12a-490143a2cc83'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:27.033275 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-7f2cbb47-f2a2-43c3-b12a-490143a2cc83 admin admin] The token cache is being invalidate because project accb4e54536a4a26a07cc88aaeaabeb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:27.033667 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-7f2cbb47-f2a2-43c3-b12a-490143a2cc83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:27.034573 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-7f2cbb47-f2a2-43c3-b12a-490143a2cc83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:27.036341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1013/2069] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:26 2022] DELETE /identity/v3/projects/accb4e54536a4a26a07cc88aaeaabeb6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:27.041652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b86e48-015d-42cb-aee8-c5f93ce7a913 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:27.042135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b86e48-015d-42cb-aee8-c5f93ce7a913 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:27.042358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b86e48-015d-42cb-aee8-c5f93ce7a913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:27.061891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-75b86e48-015d-42cb-aee8-c5f93ce7a913 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:27.063093 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-75b86e48-015d-42cb-aee8-c5f93ce7a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:27.137482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1057/2070] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:27.144968 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd3120-d32a-4b9c-9f7d-c48b6f64cae5 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:27.145250 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd3120-d32a-4b9c-9f7d-c48b6f64cae5 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:27.145533 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd3120-d32a-4b9c-9f7d-c48b6f64cae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:27.169363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-1dbd3120-d32a-4b9c-9f7d-c48b6f64cae5 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:27.170604 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-1dbd3120-d32a-4b9c-9f7d-c48b6f64cae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:27.186557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1014/2071] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:27.190770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b86e48-015d-42cb-aee8-c5f93ce7a913 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:27.201621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b86e48-015d-42cb-aee8-c5f93ce7a913 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:27.208566 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d3813-fd5b-4403-a76e-f7178dea9006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:27.209357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d3813-fd5b-4403-a76e-f7178dea9006 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:27.209753 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d3813-fd5b-4403-a76e-f7178dea9006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:27.210071 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d3813-fd5b-4403-a76e-f7178dea9006 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:27.210895 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d3813-fd5b-4403-a76e-f7178dea9006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:27.211331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d3813-fd5b-4403-a76e-f7178dea9006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:27.213347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d3813-fd5b-4403-a76e-f7178dea9006 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:27.228431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1058/2072] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:27.233080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd3120-d32a-4b9c-9f7d-c48b6f64cae5 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:27.243362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd3120-d32a-4b9c-9f7d-c48b6f64cae5 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:27.249739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9242a4-c595-45c0-b9a6-1768b84ccead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:27.250613 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9242a4-c595-45c0-b9a6-1768b84ccead admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:27.251052 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9242a4-c595-45c0-b9a6-1768b84ccead admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:27.251878 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9242a4-c595-45c0-b9a6-1768b84ccead admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:27.252784 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9242a4-c595-45c0-b9a6-1768b84ccead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:27.255535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9242a4-c595-45c0-b9a6-1768b84ccead admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:27.285583 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1015/2073] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:27 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:27.289907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d3813-fd5b-4403-a76e-f7178dea9006 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:27.301324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d3813-fd5b-4403-a76e-f7178dea9006 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:27.362537 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c324755-cd11-4774-a25d-91d62fe86fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:27.363247 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c324755-cd11-4774-a25d-91d62fe86fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:27.363522 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c324755-cd11-4774-a25d-91d62fe86fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:27.363795 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c324755-cd11-4774-a25d-91d62fe86fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:27.364538 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c324755-cd11-4774-a25d-91d62fe86fd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:27.366480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c324755-cd11-4774-a25d-91d62fe86fd6 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:27.396283 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1059/2074] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:27 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:27.400146 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9242a4-c595-45c0-b9a6-1768b84ccead admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:27.411411 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9242a4-c595-45c0-b9a6-1768b84ccead admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:27.417888 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e289ab-0daf-4fef-8f38-fc6f6feadcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:27.419254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e289ab-0daf-4fef-8f38-fc6f6feadcf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:27.419702 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e289ab-0daf-4fef-8f38-fc6f6feadcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:27.420761 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e289ab-0daf-4fef-8f38-fc6f6feadcf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:27.421921 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e289ab-0daf-4fef-8f38-fc6f6feadcf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:27.423658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e289ab-0daf-4fef-8f38-fc6f6feadcf5 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:27.438059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1016/2075] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:27.442057 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c324755-cd11-4774-a25d-91d62fe86fd6 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:27.451869 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c324755-cd11-4774-a25d-91d62fe86fd6 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:27.456621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cec53-ea88-4d01-9961-79e24fdabe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:27.457276 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cec53-ea88-4d01-9961-79e24fdabe33 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:27.457900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cec53-ea88-4d01-9961-79e24fdabe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:27.457900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cec53-ea88-4d01-9961-79e24fdabe33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:27.458518 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cec53-ea88-4d01-9961-79e24fdabe33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:27.460083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cec53-ea88-4d01-9961-79e24fdabe33 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:27.473486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1060/2076] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:27.474725 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e289ab-0daf-4fef-8f38-fc6f6feadcf5 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:27.485848 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e289ab-0daf-4fef-8f38-fc6f6feadcf5 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:27.490618 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc518f1-116b-4ccb-95cd-58c562de52a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:27.491562 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc518f1-116b-4ccb-95cd-58c562de52a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:27.491905 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc518f1-116b-4ccb-95cd-58c562de52a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:27.492274 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc518f1-116b-4ccb-95cd-58c562de52a3 admin admin] PATH_INFO: `/v3/projects/b159669f17c941a698bf5a5bfeaaa6e6/users/86045efb4b514f3aa41d9dd422dfed58/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:27.507382 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc518f1-116b-4ccb-95cd-58c562de52a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b159669f17c941a698bf5a5bfeaaa6e6, user_id=86045efb4b514f3aa41d9dd422dfed58, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:27.510168 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc518f1-116b-4ccb-95cd-58c562de52a3 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:27.525090 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1017/2077] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:27 2022] PUT /identity/v3/projects/b159669f17c941a698bf5a5bfeaaa6e6/users/86045efb4b514f3aa41d9dd422dfed58/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:27.536764 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a65495-d8e6-4e9b-ade1-f0ba54fbbc75 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:27.537094 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a65495-d8e6-4e9b-ade1-f0ba54fbbc75 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:27.537372 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a65495-d8e6-4e9b-ade1-f0ba54fbbc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:27.566270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-30a65495-d8e6-4e9b-ade1-f0ba54fbbc75 None None] MFA Rules not processed for user `86045efb4b514f3aa41d9dd422dfed58`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:27.577645 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-30a65495-d8e6-4e9b-ade1-f0ba54fbbc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:27.670789 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1061/2078] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:27.674908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc518f1-116b-4ccb-95cd-58c562de52a3 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:27.763950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc518f1-116b-4ccb-95cd-58c562de52a3 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:27.771065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db16c1-f751-4a6c-a3a1-2d634114ec6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:27.771733 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db16c1-f751-4a6c-a3a1-2d634114ec6d admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:27.772010 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db16c1-f751-4a6c-a3a1-2d634114ec6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:27.773064 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db16c1-f751-4a6c-a3a1-2d634114ec6d admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:27.773834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db16c1-f751-4a6c-a3a1-2d634114ec6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:27.775942 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db16c1-f751-4a6c-a3a1-2d634114ec6d admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:27.815439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1018/2079] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:27 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:27.819536 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a65495-d8e6-4e9b-ade1-f0ba54fbbc75 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:27.831605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a65495-d8e6-4e9b-ade1-f0ba54fbbc75 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:27.896726 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1857b-6793-4f59-a7fe-19b6fbfd72c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:27.897743 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1857b-6793-4f59-a7fe-19b6fbfd72c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:27.898089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1857b-6793-4f59-a7fe-19b6fbfd72c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:27.898429 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1857b-6793-4f59-a7fe-19b6fbfd72c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:27.899339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1857b-6793-4f59-a7fe-19b6fbfd72c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:27.901376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1857b-6793-4f59-a7fe-19b6fbfd72c6 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:27.927880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1062/2080] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:27 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:27.929201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db16c1-f751-4a6c-a3a1-2d634114ec6d admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:27.940901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db16c1-f751-4a6c-a3a1-2d634114ec6d admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:27.946465 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f852638-cc5a-4d42-956c-8e3de29fe5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:27.947872 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f852638-cc5a-4d42-956c-8e3de29fe5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:27.948153 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f852638-cc5a-4d42-956c-8e3de29fe5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:27.948524 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f852638-cc5a-4d42-956c-8e3de29fe5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:27.949411 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f852638-cc5a-4d42-956c-8e3de29fe5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:27.950837 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f852638-cc5a-4d42-956c-8e3de29fe5c0 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:27.963287 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1019/2081] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:27.967542 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1857b-6793-4f59-a7fe-19b6fbfd72c6 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:27.977714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1857b-6793-4f59-a7fe-19b6fbfd72c6 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:27.983538 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f26ba1-80ea-4d7a-ab13-5e178398e3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:27.984462 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f26ba1-80ea-4d7a-ab13-5e178398e3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:27.984741 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f26ba1-80ea-4d7a-ab13-5e178398e3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:27.985013 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f26ba1-80ea-4d7a-ab13-5e178398e3f7 admin admin] PATH_INFO: `/v3/projects/1eea497880eb4b8f8940c04e027bf147/users/37fb8d28face49e9be1992ed73b37f4e/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:28.003520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f26ba1-80ea-4d7a-ab13-5e178398e3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eea497880eb4b8f8940c04e027bf147, user_id=37fb8d28face49e9be1992ed73b37f4e, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:28.006305 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f26ba1-80ea-4d7a-ab13-5e178398e3f7 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:28.021531 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1063/2082] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:27 2022] PUT /identity/v3/projects/1eea497880eb4b8f8940c04e027bf147/users/37fb8d28face49e9be1992ed73b37f4e/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:28.025774 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f852638-cc5a-4d42-956c-8e3de29fe5c0 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:28.036325 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f852638-cc5a-4d42-956c-8e3de29fe5c0 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:28.134936 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edd1a8-32cb-4695-87e7-5e68189f2224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:28.135643 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edd1a8-32cb-4695-87e7-5e68189f2224 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:28.135931 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edd1a8-32cb-4695-87e7-5e68189f2224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:28.136574 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edd1a8-32cb-4695-87e7-5e68189f2224 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:28.137890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edd1a8-32cb-4695-87e7-5e68189f2224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:28.140767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edd1a8-32cb-4695-87e7-5e68189f2224 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:28.152761 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1020/2083] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:28.157585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f26ba1-80ea-4d7a-ab13-5e178398e3f7 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:28.176397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f26ba1-80ea-4d7a-ab13-5e178398e3f7 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:28.190057 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cb602-723c-4f2f-b100-b1b09d2478e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:28.191274 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cb602-723c-4f2f-b100-b1b09d2478e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:28.191538 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cb602-723c-4f2f-b100-b1b09d2478e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:28.191801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cb602-723c-4f2f-b100-b1b09d2478e7 admin admin] PATH_INFO: `/v3/projects/1eea497880eb4b8f8940c04e027bf147/users/37fb8d28face49e9be1992ed73b37f4e/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:28.194213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cb602-723c-4f2f-b100-b1b09d2478e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eea497880eb4b8f8940c04e027bf147, user_id=37fb8d28face49e9be1992ed73b37f4e, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:28.198069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cb602-723c-4f2f-b100-b1b09d2478e7 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:28.218089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1064/2084] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:28 2022] PUT /identity/v3/projects/1eea497880eb4b8f8940c04e027bf147/users/37fb8d28face49e9be1992ed73b37f4e/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:28.231144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bc022-5de2-4c6d-8769-e3e15b7acb8d None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:28.231430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bc022-5de2-4c6d-8769-e3e15b7acb8d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:28.231707 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bc022-5de2-4c6d-8769-e3e15b7acb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:28.260355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-601bc022-5de2-4c6d-8769-e3e15b7acb8d None None] MFA Rules not processed for user `37fb8d28face49e9be1992ed73b37f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:28.261560 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-601bc022-5de2-4c6d-8769-e3e15b7acb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:28.330681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1021/2085] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:28.342506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cb602-723c-4f2f-b100-b1b09d2478e7 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:28.344286 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d63cb602-723c-4f2f-b100-b1b09d2478e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:28.412933 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cb602-723c-4f2f-b100-b1b09d2478e7 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:28.416702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400daf76-d820-49d9-a506-beb469f93ef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:28.417355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400daf76-d820-49d9-a506-beb469f93ef9 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:28.417635 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400daf76-d820-49d9-a506-beb469f93ef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:28.417916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400daf76-d820-49d9-a506-beb469f93ef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:28.427261 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400daf76-d820-49d9-a506-beb469f93ef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:28.428730 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400daf76-d820-49d9-a506-beb469f93ef9 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:28.439462 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1065/2086] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:28.876092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bc022-5de2-4c6d-8769-e3e15b7acb8d None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:28.976696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bc022-5de2-4c6d-8769-e3e15b7acb8d None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:28.998014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90f2d5-e115-485f-9c17-8f5de2f634be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:28.999694 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90f2d5-e115-485f-9c17-8f5de2f634be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:29.000463 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90f2d5-e115-485f-9c17-8f5de2f634be admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:29.000746 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90f2d5-e115-485f-9c17-8f5de2f634be admin admin] PATH_INFO: `/v3/users/86045efb4b514f3aa41d9dd422dfed58` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:29.002260 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90f2d5-e115-485f-9c17-8f5de2f634be admin admin] RBAC: Authorizing `identity:delete_user(user_id=86045efb4b514f3aa41d9dd422dfed58)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:29.004934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90f2d5-e115-485f-9c17-8f5de2f634be admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:29.066931 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-ef90f2d5-e115-485f-9c17-8f5de2f634be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86045efb4b514f3aa41d9dd422dfed58'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:29.067598 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-ef90f2d5-e115-485f-9c17-8f5de2f634be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86045efb4b514f3aa41d9dd422dfed58'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:29.080657 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-ef90f2d5-e115-485f-9c17-8f5de2f634be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86045efb4b514f3aa41d9dd422dfed58'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:29.090451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-ef90f2d5-e115-485f-9c17-8f5de2f634be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86045efb4b514f3aa41d9dd422dfed58'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:29.091607 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-ef90f2d5-e115-485f-9c17-8f5de2f634be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86045efb4b514f3aa41d9dd422dfed58'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:29.143611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1022/2087] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:28 2022] DELETE /identity/v3/users/86045efb4b514f3aa41d9dd422dfed58 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:29.145148 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7733047-4ac5-4adb-8188-7382e70675fb None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:29.145580 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7733047-4ac5-4adb-8188-7382e70675fb None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:29.145782 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7733047-4ac5-4adb-8188-7382e70675fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:29.169453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-d7733047-4ac5-4adb-8188-7382e70675fb None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:29.170733 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d7733047-4ac5-4adb-8188-7382e70675fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:29.258900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1066/2088] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:29.270091 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90f2d5-e115-485f-9c17-8f5de2f634be admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:29.272242 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ef90f2d5-e115-485f-9c17-8f5de2f634be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:29.421771 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90f2d5-e115-485f-9c17-8f5de2f634be admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:29.435023 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a171fae-3913-4cf5-a140-6b1a54b6cf5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:29.435703 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a171fae-3913-4cf5-a140-6b1a54b6cf5d service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:29.435986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a171fae-3913-4cf5-a140-6b1a54b6cf5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:29.436362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a171fae-3913-4cf5-a140-6b1a54b6cf5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:29.453908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a171fae-3913-4cf5-a140-6b1a54b6cf5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:29.456405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a171fae-3913-4cf5-a140-6b1a54b6cf5d service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:29.489800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1023/2089] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:29.987696 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7733047-4ac5-4adb-8188-7382e70675fb None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:29.989446 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d7733047-4ac5-4adb-8188-7382e70675fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:30.003041 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7733047-4ac5-4adb-8188-7382e70675fb None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.008877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2663c-921f-4a31-bfbd-e45742a97d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.010584 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2663c-921f-4a31-bfbd-e45742a97d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.011154 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2663c-921f-4a31-bfbd-e45742a97d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.011518 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2663c-921f-4a31-bfbd-e45742a97d2a admin admin] PATH_INFO: `/v3/projects/b159669f17c941a698bf5a5bfeaaa6e6` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.013457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2663c-921f-4a31-bfbd-e45742a97d2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b159669f17c941a698bf5a5bfeaaa6e6)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.017589 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2663c-921f-4a31-bfbd-e45742a97d2a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.084532 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-fbd2663c-921f-4a31-bfbd-e45742a97d2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b159669f17c941a698bf5a5bfeaaa6e6', 'request_id': 'req-fbd2663c-921f-4a31-bfbd-e45742a97d2a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:30.093211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-fbd2663c-921f-4a31-bfbd-e45742a97d2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b159669f17c941a698bf5a5bfeaaa6e6', 'request_id': 'req-fbd2663c-921f-4a31-bfbd-e45742a97d2a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:30.099618 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-fbd2663c-921f-4a31-bfbd-e45742a97d2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b159669f17c941a698bf5a5bfeaaa6e6', 'request_id': 'req-fbd2663c-921f-4a31-bfbd-e45742a97d2a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:30.111791 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-fbd2663c-921f-4a31-bfbd-e45742a97d2a admin admin] The token cache is being invalidate because project b159669f17c941a698bf5a5bfeaaa6e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:30.112343 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-fbd2663c-921f-4a31-bfbd-e45742a97d2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:30.116588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-fbd2663c-921f-4a31-bfbd-e45742a97d2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:30.118797 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1067/2090] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:29 2022] DELETE /identity/v3/projects/b159669f17c941a698bf5a5bfeaaa6e6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:30.122775 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a171fae-3913-4cf5-a140-6b1a54b6cf5d service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.137652 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a171fae-3913-4cf5-a140-6b1a54b6cf5d service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.211342 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df171a15-c742-4017-bd47-616e36146574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.212297 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df171a15-c742-4017-bd47-616e36146574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.212581 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df171a15-c742-4017-bd47-616e36146574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.213396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df171a15-c742-4017-bd47-616e36146574 admin admin] PATH_INFO: `/v3/users/37fb8d28face49e9be1992ed73b37f4e` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.214610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df171a15-c742-4017-bd47-616e36146574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37fb8d28face49e9be1992ed73b37f4e)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.216598 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df171a15-c742-4017-bd47-616e36146574 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:30.290066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-df171a15-c742-4017-bd47-616e36146574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37fb8d28face49e9be1992ed73b37f4e'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:30.292077 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-df171a15-c742-4017-bd47-616e36146574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37fb8d28face49e9be1992ed73b37f4e'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:30.318303 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-df171a15-c742-4017-bd47-616e36146574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37fb8d28face49e9be1992ed73b37f4e'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:30.329200 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-df171a15-c742-4017-bd47-616e36146574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37fb8d28face49e9be1992ed73b37f4e'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:30.329911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-df171a15-c742-4017-bd47-616e36146574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37fb8d28face49e9be1992ed73b37f4e'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:30.348494 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1024/2091] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:30 2022] DELETE /identity/v3/users/37fb8d28face49e9be1992ed73b37f4e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:30.789815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2663c-921f-4a31-bfbd-e45742a97d2a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:30.794130 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-fbd2663c-921f-4a31-bfbd-e45742a97d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:30.821214 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2663c-921f-4a31-bfbd-e45742a97d2a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:30.941149 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c90416-5904-4fb9-a1c6-6ba9d2fc0108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:30.942319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c90416-5904-4fb9-a1c6-6ba9d2fc0108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:30.942746 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c90416-5904-4fb9-a1c6-6ba9d2fc0108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:30.943202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c90416-5904-4fb9-a1c6-6ba9d2fc0108 admin admin] PATH_INFO: `/v3/projects/1eea497880eb4b8f8940c04e027bf147` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:30.944665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c90416-5904-4fb9-a1c6-6ba9d2fc0108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eea497880eb4b8f8940c04e027bf147)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:30.947352 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c90416-5904-4fb9-a1c6-6ba9d2fc0108 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.058771 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-27c90416-5904-4fb9-a1c6-6ba9d2fc0108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eea497880eb4b8f8940c04e027bf147', 'request_id': 'req-27c90416-5904-4fb9-a1c6-6ba9d2fc0108'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:31.091527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-27c90416-5904-4fb9-a1c6-6ba9d2fc0108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eea497880eb4b8f8940c04e027bf147', 'request_id': 'req-27c90416-5904-4fb9-a1c6-6ba9d2fc0108'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:31.100542 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-27c90416-5904-4fb9-a1c6-6ba9d2fc0108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eea497880eb4b8f8940c04e027bf147', 'request_id': 'req-27c90416-5904-4fb9-a1c6-6ba9d2fc0108'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:31.123839 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-27c90416-5904-4fb9-a1c6-6ba9d2fc0108 admin admin] The token cache is being invalidate because project 1eea497880eb4b8f8940c04e027bf147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:31.124380 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-27c90416-5904-4fb9-a1c6-6ba9d2fc0108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:31.125818 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-27c90416-5904-4fb9-a1c6-6ba9d2fc0108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:31.128530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1068/2092] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:30 2022] DELETE /identity/v3/projects/1eea497880eb4b8f8940c04e027bf147 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:31.133217 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92364e-db5e-401a-910e-8ab3757f7162 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.134314 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92364e-db5e-401a-910e-8ab3757f7162 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.135334 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92364e-db5e-401a-910e-8ab3757f7162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.189179 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-ce92364e-db5e-401a-910e-8ab3757f7162 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:31.190819 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ce92364e-db5e-401a-910e-8ab3757f7162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:31.296859 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1025/2093] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:31.308058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60497bda-bd44-4508-a647-0bd6e97dc2dd None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.308868 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60497bda-bd44-4508-a647-0bd6e97dc2dd None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.309151 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60497bda-bd44-4508-a647-0bd6e97dc2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.332624 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-60497bda-bd44-4508-a647-0bd6e97dc2dd None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:31.334373 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-60497bda-bd44-4508-a647-0bd6e97dc2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:31.348050 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1069/2094] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:31.352475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92364e-db5e-401a-910e-8ab3757f7162 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.365534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92364e-db5e-401a-910e-8ab3757f7162 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.371043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ab53a-3afa-4561-bfdd-619cd122ad17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.371958 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ab53a-3afa-4561-bfdd-619cd122ad17 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.372434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ab53a-3afa-4561-bfdd-619cd122ad17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.372971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ab53a-3afa-4561-bfdd-619cd122ad17 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.387412 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ab53a-3afa-4561-bfdd-619cd122ad17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:31.387983 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ab53a-3afa-4561-bfdd-619cd122ad17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.398204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ab53a-3afa-4561-bfdd-619cd122ad17 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.412967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1026/2095] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:01:31.417639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60497bda-bd44-4508-a647-0bd6e97dc2dd None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.428109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60497bda-bd44-4508-a647-0bd6e97dc2dd None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.437433 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f0af1-fe08-4e1e-9361-5806bd0e8bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.438110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f0af1-fe08-4e1e-9361-5806bd0e8bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.438387 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f0af1-fe08-4e1e-9361-5806bd0e8bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.438815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f0af1-fe08-4e1e-9361-5806bd0e8bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.439516 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f0af1-fe08-4e1e-9361-5806bd0e8bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.443153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f0af1-fe08-4e1e-9361-5806bd0e8bb3 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.513451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1070/2096] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:31 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:31.517781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ab53a-3afa-4561-bfdd-619cd122ad17 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.540979 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ab53a-3afa-4561-bfdd-619cd122ad17 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.549193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50705fd5-fb0e-4ec7-84df-cbe3cd7f1fb8 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.549918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50705fd5-fb0e-4ec7-84df-cbe3cd7f1fb8 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.550385 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50705fd5-fb0e-4ec7-84df-cbe3cd7f1fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.595279 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-50705fd5-fb0e-4ec7-84df-cbe3cd7f1fb8 None None] MFA Rules not processed for user `9d87a4de3fbf4cbb9e21523634007629`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:31.596789 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-50705fd5-fb0e-4ec7-84df-cbe3cd7f1fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:31.652860 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a32120-6874-40fe-952d-30af032d2ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.653636 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a32120-6874-40fe-952d-30af032d2ddd admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.653986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a32120-6874-40fe-952d-30af032d2ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.654325 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a32120-6874-40fe-952d-30af032d2ddd admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.655084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a32120-6874-40fe-952d-30af032d2ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.657190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a32120-6874-40fe-952d-30af032d2ddd admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.680372 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1027/2097] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:31 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:31.686612 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a32120-6874-40fe-952d-30af032d2ddd admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.694131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1071/2098] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:31.699040 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a32120-6874-40fe-952d-30af032d2ddd admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.699439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50705fd5-fb0e-4ec7-84df-cbe3cd7f1fb8 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.700867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-50705fd5-fb0e-4ec7-84df-cbe3cd7f1fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:31.704904 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724f58f-4921-4fa7-9875-1e935153433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.705892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724f58f-4921-4fa7-9875-1e935153433d admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.706180 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724f58f-4921-4fa7-9875-1e935153433d admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.706460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724f58f-4921-4fa7-9875-1e935153433d admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.707193 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724f58f-4921-4fa7-9875-1e935153433d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.709022 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724f58f-4921-4fa7-9875-1e935153433d admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.716449 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50705fd5-fb0e-4ec7-84df-cbe3cd7f1fb8 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.721127 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1028/2099] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:31.721362 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7c211-d746-40e5-add8-dbc774d52979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.722024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7c211-d746-40e5-add8-dbc774d52979 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.722303 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7c211-d746-40e5-add8-dbc774d52979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.722581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7c211-d746-40e5-add8-dbc774d52979 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.723268 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7c211-d746-40e5-add8-dbc774d52979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.725065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724f58f-4921-4fa7-9875-1e935153433d admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.725368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7c211-d746-40e5-add8-dbc774d52979 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.736898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724f58f-4921-4fa7-9875-1e935153433d admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.742160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887211e-12b0-41f9-ade2-39a381c16254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.742947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887211e-12b0-41f9-ade2-39a381c16254 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.743421 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887211e-12b0-41f9-ade2-39a381c16254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.743753 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887211e-12b0-41f9-ade2-39a381c16254 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.745378 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887211e-12b0-41f9-ade2-39a381c16254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.747227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887211e-12b0-41f9-ade2-39a381c16254 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.759846 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1072/2100] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:31 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:31.760016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1029/2101] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:31.761029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7c211-d746-40e5-add8-dbc774d52979 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.762432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887211e-12b0-41f9-ade2-39a381c16254 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.773652 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887211e-12b0-41f9-ade2-39a381c16254 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.831998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7c211-d746-40e5-add8-dbc774d52979 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.839059 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d51e3-697d-4492-9856-062c5aeb3e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.839761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d51e3-697d-4492-9856-062c5aeb3e64 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.840035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d51e3-697d-4492-9856-062c5aeb3e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.840515 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d51e3-697d-4492-9856-062c5aeb3e64 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.841370 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d51e3-697d-4492-9856-062c5aeb3e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.843354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d51e3-697d-4492-9856-062c5aeb3e64 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.845701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a0b76-4700-4c55-99ca-26b1f6dae058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.846627 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a0b76-4700-4c55-99ca-26b1f6dae058 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.846910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a0b76-4700-4c55-99ca-26b1f6dae058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.847189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a0b76-4700-4c55-99ca-26b1f6dae058 admin admin] PATH_INFO: `/v3/projects/f0a0817431534af8af0e991417947246/users/74a5347974cf44bd87aa6deef79740e5/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.864289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a0b76-4700-4c55-99ca-26b1f6dae058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a0817431534af8af0e991417947246, user_id=74a5347974cf44bd87aa6deef79740e5, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.867923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1073/2102] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:31 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:31.870036 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d51e3-697d-4492-9856-062c5aeb3e64 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.870977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a0b76-4700-4c55-99ca-26b1f6dae058 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.881601 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d51e3-697d-4492-9856-062c5aeb3e64 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.889549 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1030/2103] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:31 2022] PUT /identity/v3/projects/f0a0817431534af8af0e991417947246/users/74a5347974cf44bd87aa6deef79740e5/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:31.891140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3eaf4-0e39-40d9-a061-9cf0ecc9b6a9 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.891459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3eaf4-0e39-40d9-a061-9cf0ecc9b6a9 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.891732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3eaf4-0e39-40d9-a061-9cf0ecc9b6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.910275 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-91d3eaf4-0e39-40d9-a061-9cf0ecc9b6a9 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:31.911659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-91d3eaf4-0e39-40d9-a061-9cf0ecc9b6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:31.942906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e081e7-a6fc-475e-9377-ca923b6c59f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.943590 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e081e7-a6fc-475e-9377-ca923b6c59f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.943870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e081e7-a6fc-475e-9377-ca923b6c59f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.944381 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e081e7-a6fc-475e-9377-ca923b6c59f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.945127 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e081e7-a6fc-475e-9377-ca923b6c59f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:31.946870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e081e7-a6fc-475e-9377-ca923b6c59f0 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:31.960822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1074/2104] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:31.961825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e081e7-a6fc-475e-9377-ca923b6c59f0 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.972251 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e081e7-a6fc-475e-9377-ca923b6c59f0 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:31.977124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a075a-3ffc-48d9-ad3a-113d7c8f3afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:31.977427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1031/2105] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:31.981297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a075a-3ffc-48d9-ad3a-113d7c8f3afd admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:31.981297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a075a-3ffc-48d9-ad3a-113d7c8f3afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:31.981297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a075a-3ffc-48d9-ad3a-113d7c8f3afd admin admin] PATH_INFO: `/v3/projects/d63edf0ea87748beb70946b8950b066f/users/b92a47e8971d49f3bbeea408a189aad7/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:31.987710 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3eaf4-0e39-40d9-a061-9cf0ecc9b6a9 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:31.990377 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-91d3eaf4-0e39-40d9-a061-9cf0ecc9b6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:31.997344 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a075a-3ffc-48d9-ad3a-113d7c8f3afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63edf0ea87748beb70946b8950b066f, user_id=b92a47e8971d49f3bbeea408a189aad7, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:32.000453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a075a-3ffc-48d9-ad3a-113d7c8f3afd admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:32.015714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1075/2106] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:31 2022] PUT /identity/v3/projects/d63edf0ea87748beb70946b8950b066f/users/b92a47e8971d49f3bbeea408a189aad7/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:32.019632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a075a-3ffc-48d9-ad3a-113d7c8f3afd admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:32.058465 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3eaf4-0e39-40d9-a061-9cf0ecc9b6a9 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:32.095152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a075a-3ffc-48d9-ad3a-113d7c8f3afd admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:32.102664 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7e14e-19f2-4e02-ae5a-d4a9820cddc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:32.105100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7e14e-19f2-4e02-ae5a-d4a9820cddc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:32.106064 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7e14e-19f2-4e02-ae5a-d4a9820cddc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:32.106637 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7e14e-19f2-4e02-ae5a-d4a9820cddc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:32.108410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7e14e-19f2-4e02-ae5a-d4a9820cddc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:32.111992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7e14e-19f2-4e02-ae5a-d4a9820cddc3 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:32.128740 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1076/2107] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:32.128923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2341d-b800-4af2-aa15-f286b82fee6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:32.128923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2341d-b800-4af2-aa15-f286b82fee6e service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:32.128923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2341d-b800-4af2-aa15-f286b82fee6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:32.128923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2341d-b800-4af2-aa15-f286b82fee6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:32.129962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7e14e-19f2-4e02-ae5a-d4a9820cddc3 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:32.142034 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7e14e-19f2-4e02-ae5a-d4a9820cddc3 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:32.144269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2341d-b800-4af2-aa15-f286b82fee6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:32.145764 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2341d-b800-4af2-aa15-f286b82fee6e service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:32.157968 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1032/2108] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:32.167066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a3d03-a505-4d2f-a1a4-05b93cc8a434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:32.167980 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a3d03-a505-4d2f-a1a4-05b93cc8a434 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:32.168430 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a3d03-a505-4d2f-a1a4-05b93cc8a434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:32.169072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a3d03-a505-4d2f-a1a4-05b93cc8a434 admin admin] PATH_INFO: `/v3/projects/d63edf0ea87748beb70946b8950b066f/users/b92a47e8971d49f3bbeea408a189aad7/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:32.170803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a3d03-a505-4d2f-a1a4-05b93cc8a434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63edf0ea87748beb70946b8950b066f, user_id=b92a47e8971d49f3bbeea408a189aad7, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:32.177998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a3d03-a505-4d2f-a1a4-05b93cc8a434 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:32.190817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1077/2109] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:32 2022] PUT /identity/v3/projects/d63edf0ea87748beb70946b8950b066f/users/b92a47e8971d49f3bbeea408a189aad7/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:33.242723 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e475bfc-076c-4f2c-a54b-df094c8a2083 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.243254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e475bfc-076c-4f2c-a54b-df094c8a2083 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.243254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e475bfc-076c-4f2c-a54b-df094c8a2083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.310013 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-2e475bfc-076c-4f2c-a54b-df094c8a2083 None None] MFA Rules not processed for user `74a5347974cf44bd87aa6deef79740e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:33.311449 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-2e475bfc-076c-4f2c-a54b-df094c8a2083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:33.392743 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1033/2110] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:33.398153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a3d03-a505-4d2f-a1a4-05b93cc8a434 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:33.485691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a3d03-a505-4d2f-a1a4-05b93cc8a434 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:33.490851 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce3447-b07f-48a4-9103-177f3ee4961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:33.491151 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce3447-b07f-48a4-9103-177f3ee4961c admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.491820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce3447-b07f-48a4-9103-177f3ee4961c admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.492106 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce3447-b07f-48a4-9103-177f3ee4961c admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.493637 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce3447-b07f-48a4-9103-177f3ee4961c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:33.496273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce3447-b07f-48a4-9103-177f3ee4961c admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:33.539838 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1078/2111] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:33 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:33.544726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e475bfc-076c-4f2c-a54b-df094c8a2083 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:33.559706 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e475bfc-076c-4f2c-a54b-df094c8a2083 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:33.640448 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1008293-0d01-4c19-afaa-da9b2831a344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:33.641656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1008293-0d01-4c19-afaa-da9b2831a344 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.642067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1008293-0d01-4c19-afaa-da9b2831a344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.642667 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1008293-0d01-4c19-afaa-da9b2831a344 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.643213 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1008293-0d01-4c19-afaa-da9b2831a344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:33.646554 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1008293-0d01-4c19-afaa-da9b2831a344 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:33.686183 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1034/2112] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:33 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:33.691762 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce3447-b07f-48a4-9103-177f3ee4961c admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:33.707948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce3447-b07f-48a4-9103-177f3ee4961c admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:33.725245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca700055-cd5a-441a-90f1-c6c30476a994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:33.727602 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca700055-cd5a-441a-90f1-c6c30476a994 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.727602 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca700055-cd5a-441a-90f1-c6c30476a994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.728018 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca700055-cd5a-441a-90f1-c6c30476a994 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.731432 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca700055-cd5a-441a-90f1-c6c30476a994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:33.736441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca700055-cd5a-441a-90f1-c6c30476a994 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:33.780909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1079/2113] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:33.784934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1008293-0d01-4c19-afaa-da9b2831a344 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:33.797565 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1008293-0d01-4c19-afaa-da9b2831a344 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:33.803569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0d7d1-c76d-4ec7-9789-76a1b7f4e31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:33.804775 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0d7d1-c76d-4ec7-9789-76a1b7f4e31f admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.805237 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0d7d1-c76d-4ec7-9789-76a1b7f4e31f admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.806155 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0d7d1-c76d-4ec7-9789-76a1b7f4e31f admin admin] PATH_INFO: `/v3/projects/80407d5686164cecb1e91a039e1d8c9f/users/a9be393faf68460f900ddcc1c8a5900a/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.838601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0d7d1-c76d-4ec7-9789-76a1b7f4e31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=80407d5686164cecb1e91a039e1d8c9f, user_id=a9be393faf68460f900ddcc1c8a5900a, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:33.846540 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0d7d1-c76d-4ec7-9789-76a1b7f4e31f admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:33.869728 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1035/2114] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:33 2022] PUT /identity/v3/projects/80407d5686164cecb1e91a039e1d8c9f/users/a9be393faf68460f900ddcc1c8a5900a/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:33.871139 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca700055-cd5a-441a-90f1-c6c30476a994 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:33.873271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0d7d1-c76d-4ec7-9789-76a1b7f4e31f admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:33.877631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-72b0d7d1-c76d-4ec7-9789-76a1b7f4e31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:33.882986 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca700055-cd5a-441a-90f1-c6c30476a994 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:33.974263 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0d7d1-c76d-4ec7-9789-76a1b7f4e31f admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:33.984760 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcea6c-6df7-40e3-9107-9b07ba19b470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:33.985438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcea6c-6df7-40e3-9107-9b07ba19b470 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.985718 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcea6c-6df7-40e3-9107-9b07ba19b470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.985994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcea6c-6df7-40e3-9107-9b07ba19b470 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.986723 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcea6c-6df7-40e3-9107-9b07ba19b470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:33.987472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080e271-1aea-4337-be7d-01833885d3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:33.988426 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080e271-1aea-4337-be7d-01833885d3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:33.988643 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080e271-1aea-4337-be7d-01833885d3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:33.989163 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080e271-1aea-4337-be7d-01833885d3b5 admin admin] PATH_INFO: `/v3/users/42b928cdf5ef407099de426d5d37a773` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:33.991409 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcea6c-6df7-40e3-9107-9b07ba19b470 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:33.993962 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080e271-1aea-4337-be7d-01833885d3b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b928cdf5ef407099de426d5d37a773)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:33.996613 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080e271-1aea-4337-be7d-01833885d3b5 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:34.014082 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1080/2115] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:34.018313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcea6c-6df7-40e3-9107-9b07ba19b470 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:34.037355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcea6c-6df7-40e3-9107-9b07ba19b470 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:34.047550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadc05f-05ef-485f-bced-797a853d87b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:34.048484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadc05f-05ef-485f-bced-797a853d87b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:34.048765 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadc05f-05ef-485f-bced-797a853d87b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:34.064218 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadc05f-05ef-485f-bced-797a853d87b1 admin admin] PATH_INFO: `/v3/projects/80407d5686164cecb1e91a039e1d8c9f/users/a9be393faf68460f900ddcc1c8a5900a/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:34.064218 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dadc05f-05ef-485f-bced-797a853d87b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80407d5686164cecb1e91a039e1d8c9f, user_id=a9be393faf68460f900ddcc1c8a5900a, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:34.064218 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dadc05f-05ef-485f-bced-797a853d87b1 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:34.100911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d080e271-1aea-4337-be7d-01833885d3b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b928cdf5ef407099de426d5d37a773'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:34.104828 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d080e271-1aea-4337-be7d-01833885d3b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b928cdf5ef407099de426d5d37a773'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:34.110704 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1081/2116] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:34 2022] PUT /identity/v3/projects/80407d5686164cecb1e91a039e1d8c9f/users/a9be393faf68460f900ddcc1c8a5900a/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:34.121379 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d080e271-1aea-4337-be7d-01833885d3b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b928cdf5ef407099de426d5d37a773'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:34.132082 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d080e271-1aea-4337-be7d-01833885d3b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b928cdf5ef407099de426d5d37a773'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:34.133395 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d080e271-1aea-4337-be7d-01833885d3b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b928cdf5ef407099de426d5d37a773'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:34.153903 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1036/2117] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:33 2022] DELETE /identity/v3/users/42b928cdf5ef407099de426d5d37a773 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:34.157259 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e44f87-8825-4e9e-8fa2-2880100dd42f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:34.157550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e44f87-8825-4e9e-8fa2-2880100dd42f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:34.157828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e44f87-8825-4e9e-8fa2-2880100dd42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:34.184554 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-c1e44f87-8825-4e9e-8fa2-2880100dd42f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:34.186015 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c1e44f87-8825-4e9e-8fa2-2880100dd42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:34.322877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1082/2118] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:34.335896 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080e271-1aea-4337-be7d-01833885d3b5 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:34.338061 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d080e271-1aea-4337-be7d-01833885d3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:34.460230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080e271-1aea-4337-be7d-01833885d3b5 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:34.464577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2afde-b86a-4877-806a-ef5743b2a539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:34.466050 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2afde-b86a-4877-806a-ef5743b2a539 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:34.466407 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2afde-b86a-4877-806a-ef5743b2a539 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:34.466877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2afde-b86a-4877-806a-ef5743b2a539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:34.479925 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2afde-b86a-4877-806a-ef5743b2a539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:34.481894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2afde-b86a-4877-806a-ef5743b2a539 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:34.504205 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1037/2119] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:35.428990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e44f87-8825-4e9e-8fa2-2880100dd42f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:35.430513 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c1e44f87-8825-4e9e-8fa2-2880100dd42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:35.444426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e44f87-8825-4e9e-8fa2-2880100dd42f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:35.450260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56a128-c1e6-455b-9a12-1e579be5c6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:35.450437 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56a128-c1e6-455b-9a12-1e579be5c6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:35.450644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56a128-c1e6-455b-9a12-1e579be5c6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:35.451079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56a128-c1e6-455b-9a12-1e579be5c6f4 admin admin] PATH_INFO: `/v3/projects/4579a8f2f6454f889efc87d1666474df` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:35.452514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56a128-c1e6-455b-9a12-1e579be5c6f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4579a8f2f6454f889efc87d1666474df)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:35.454921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56a128-c1e6-455b-9a12-1e579be5c6f4 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:35.541837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bf56a128-c1e6-455b-9a12-1e579be5c6f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4579a8f2f6454f889efc87d1666474df', 'request_id': 'req-bf56a128-c1e6-455b-9a12-1e579be5c6f4'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:35.560827 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bf56a128-c1e6-455b-9a12-1e579be5c6f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4579a8f2f6454f889efc87d1666474df', 'request_id': 'req-bf56a128-c1e6-455b-9a12-1e579be5c6f4'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:35.572706 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bf56a128-c1e6-455b-9a12-1e579be5c6f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4579a8f2f6454f889efc87d1666474df', 'request_id': 'req-bf56a128-c1e6-455b-9a12-1e579be5c6f4'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:35.574744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d6d19-d378-46fd-9c82-567480462022 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:35.575551 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d6d19-d378-46fd-9c82-567480462022 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:35.576011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d6d19-d378-46fd-9c82-567480462022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:35.593802 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bf56a128-c1e6-455b-9a12-1e579be5c6f4 admin admin] The token cache is being invalidate because project 4579a8f2f6454f889efc87d1666474df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:35.594208 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bf56a128-c1e6-455b-9a12-1e579be5c6f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:35.595046 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bf56a128-c1e6-455b-9a12-1e579be5c6f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:35.597084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1083/2120] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:35 2022] DELETE /identity/v3/projects/4579a8f2f6454f889efc87d1666474df => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:35.605103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c69e4-2b60-4c01-84c5-dca05f0e3d2d None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:35.605327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c69e4-2b60-4c01-84c5-dca05f0e3d2d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:35.605670 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c69e4-2b60-4c01-84c5-dca05f0e3d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:35.610085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-a84d6d19-d378-46fd-9c82-567480462022 None None] MFA Rules not processed for user `a9be393faf68460f900ddcc1c8a5900a`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:35.612142 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a84d6d19-d378-46fd-9c82-567480462022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:35.643983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-625c69e4-2b60-4c01-84c5-dca05f0e3d2d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:35.645762 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-625c69e4-2b60-4c01-84c5-dca05f0e3d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:35.716347 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1038/2121] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:35.725926 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d6d19-d378-46fd-9c82-567480462022 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:35.728393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a84d6d19-d378-46fd-9c82-567480462022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:35.771670 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1084/2122] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:35.780117 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b8caf-a6e5-4069-adef-69f7d6f9bb8d None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:35.780733 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b8caf-a6e5-4069-adef-69f7d6f9bb8d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:35.781160 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b8caf-a6e5-4069-adef-69f7d6f9bb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:35.815526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d6d19-d378-46fd-9c82-567480462022 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:35.816887 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-fd0b8caf-a6e5-4069-adef-69f7d6f9bb8d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:35.818325 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-fd0b8caf-a6e5-4069-adef-69f7d6f9bb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:35.820425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818185f-f5ea-47b1-96ce-55764c3e5ca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:35.821451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818185f-f5ea-47b1-96ce-55764c3e5ca9 service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:35.821977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818185f-f5ea-47b1-96ce-55764c3e5ca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:35.822450 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818185f-f5ea-47b1-96ce-55764c3e5ca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:35.824548 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a818185f-f5ea-47b1-96ce-55764c3e5ca9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:35.832969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1085/2123] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:35.834169 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b8caf-a6e5-4069-adef-69f7d6f9bb8d None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:35.852324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b8caf-a6e5-4069-adef-69f7d6f9bb8d None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:35.857267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dcf21-2c3c-4a06-bcff-688e21f3a351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:35.857935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dcf21-2c3c-4a06-bcff-688e21f3a351 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:35.858206 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dcf21-2c3c-4a06-bcff-688e21f3a351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:35.858479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dcf21-2c3c-4a06-bcff-688e21f3a351 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:35.859193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37dcf21-2c3c-4a06-bcff-688e21f3a351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:35.859494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37dcf21-2c3c-4a06-bcff-688e21f3a351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:35.861091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37dcf21-2c3c-4a06-bcff-688e21f3a351 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:35.876217 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1086/2124] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:35.877793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dcf21-2c3c-4a06-bcff-688e21f3a351 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:35.889219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dcf21-2c3c-4a06-bcff-688e21f3a351 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:35.912761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476d87f-b5aa-48ae-bbd8-283ef452bfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:35.913441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476d87f-b5aa-48ae-bbd8-283ef452bfbf admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:35.913721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476d87f-b5aa-48ae-bbd8-283ef452bfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:35.913993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476d87f-b5aa-48ae-bbd8-283ef452bfbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:35.914682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476d87f-b5aa-48ae-bbd8-283ef452bfbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:35.917151 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476d87f-b5aa-48ae-bbd8-283ef452bfbf admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:35.929376 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818185f-f5ea-47b1-96ce-55764c3e5ca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:35.931115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818185f-f5ea-47b1-96ce-55764c3e5ca9 service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:35.961821 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1039/2125] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:35.977318 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1087/2126] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:35 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:35.982441 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818185f-f5ea-47b1-96ce-55764c3e5ca9 service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:36.011468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818185f-f5ea-47b1-96ce-55764c3e5ca9 service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:36.094108 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208d711-88e1-4a24-9e20-f41e76526dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:36.094940 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208d711-88e1-4a24-9e20-f41e76526dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:36.095341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208d711-88e1-4a24-9e20-f41e76526dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:36.095817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208d711-88e1-4a24-9e20-f41e76526dc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:36.096650 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208d711-88e1-4a24-9e20-f41e76526dc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:36.098670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208d711-88e1-4a24-9e20-f41e76526dc8 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:36.135589 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1040/2127] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:35 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:36.136975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476d87f-b5aa-48ae-bbd8-283ef452bfbf admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:36.154888 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476d87f-b5aa-48ae-bbd8-283ef452bfbf admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:36.178629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba3920-f10a-495c-93f7-5a3ab35f3458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:36.179618 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba3920-f10a-495c-93f7-5a3ab35f3458 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:36.179905 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba3920-f10a-495c-93f7-5a3ab35f3458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:36.180186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba3920-f10a-495c-93f7-5a3ab35f3458 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:36.183330 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba3920-f10a-495c-93f7-5a3ab35f3458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:36.187613 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba3920-f10a-495c-93f7-5a3ab35f3458 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:36.208220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1088/2128] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:36.210385 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208d711-88e1-4a24-9e20-f41e76526dc8 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:36.226205 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208d711-88e1-4a24-9e20-f41e76526dc8 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:36.235019 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f51547-f684-444a-ad22-9d8e9da5b289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:36.236388 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f51547-f684-444a-ad22-9d8e9da5b289 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:36.237553 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f51547-f684-444a-ad22-9d8e9da5b289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:36.238062 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f51547-f684-444a-ad22-9d8e9da5b289 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:36.239073 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f51547-f684-444a-ad22-9d8e9da5b289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:36.241468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f51547-f684-444a-ad22-9d8e9da5b289 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:36.268468 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba3920-f10a-495c-93f7-5a3ab35f3458 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:36.280203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1041/2129] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:36.285670 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba3920-f10a-495c-93f7-5a3ab35f3458 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:36.307123 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe68a8-7d8f-4680-bb8a-41787f503a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:36.308396 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe68a8-7d8f-4680-bb8a-41787f503a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:36.308788 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe68a8-7d8f-4680-bb8a-41787f503a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:36.309158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe68a8-7d8f-4680-bb8a-41787f503a1c admin admin] PATH_INFO: `/v3/projects/a2a5a7ccfdd7447c8009d4766c704703/users/31bbc5f270724463a2691b52d5fd7804/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:36.373002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe68a8-7d8f-4680-bb8a-41787f503a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a5a7ccfdd7447c8009d4766c704703, user_id=31bbc5f270724463a2691b52d5fd7804, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:36.376072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe68a8-7d8f-4680-bb8a-41787f503a1c admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:36.412211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1089/2130] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:36 2022] PUT /identity/v3/projects/a2a5a7ccfdd7447c8009d4766c704703/users/31bbc5f270724463a2691b52d5fd7804/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:36.434346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b70755-a169-464b-b5d4-2c3b2c4e0928 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:36.437698 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b70755-a169-464b-b5d4-2c3b2c4e0928 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:36.437698 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b70755-a169-464b-b5d4-2c3b2c4e0928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:36.540568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-42b70755-a169-464b-b5d4-2c3b2c4e0928 None None] MFA Rules not processed for user `31bbc5f270724463a2691b52d5fd7804`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:36.543839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-42b70755-a169-464b-b5d4-2c3b2c4e0928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:36.735109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe68a8-7d8f-4680-bb8a-41787f503a1c admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:36.742483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1042/2131] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:36.863530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe68a8-7d8f-4680-bb8a-41787f503a1c admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:36.871417 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2964f8-5550-47c0-b8c4-24bc9aae610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:36.872212 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2964f8-5550-47c0-b8c4-24bc9aae610d admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:36.872598 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2964f8-5550-47c0-b8c4-24bc9aae610d admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:36.875067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2964f8-5550-47c0-b8c4-24bc9aae610d admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:36.875973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2964f8-5550-47c0-b8c4-24bc9aae610d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:36.884384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2964f8-5550-47c0-b8c4-24bc9aae610d admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:36.953722 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b70755-a169-464b-b5d4-2c3b2c4e0928 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:36.963244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1090/2132] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:36 2022] POST /identity/v3/projects => generated 375 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:36.967774 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b70755-a169-464b-b5d4-2c3b2c4e0928 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:37.067652 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c220b1a-4c6a-4b07-ae50-502b0d231233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:37.068560 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c220b1a-4c6a-4b07-ae50-502b0d231233 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:37.069005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c220b1a-4c6a-4b07-ae50-502b0d231233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:37.069420 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c220b1a-4c6a-4b07-ae50-502b0d231233 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:37.070683 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c220b1a-4c6a-4b07-ae50-502b0d231233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:37.076628 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c220b1a-4c6a-4b07-ae50-502b0d231233 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:37.100780 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1043/2133] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:36 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:37.106065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2964f8-5550-47c0-b8c4-24bc9aae610d admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:37.119311 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2964f8-5550-47c0-b8c4-24bc9aae610d admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:37.126504 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ae635-8dce-401b-8e39-072e8a9d18fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:37.127193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ae635-8dce-401b-8e39-072e8a9d18fd admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:37.127473 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ae635-8dce-401b-8e39-072e8a9d18fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:37.127745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ae635-8dce-401b-8e39-072e8a9d18fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:37.128581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ae635-8dce-401b-8e39-072e8a9d18fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:37.130756 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ae635-8dce-401b-8e39-072e8a9d18fd admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:37.153645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c220b1a-4c6a-4b07-ae50-502b0d231233 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:37.172202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1091/2134] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:37.178448 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c220b1a-4c6a-4b07-ae50-502b0d231233 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:37.187383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f305293-3152-4724-9116-a8d34911817e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:37.188693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f305293-3152-4724-9116-a8d34911817e admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:37.189159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f305293-3152-4724-9116-a8d34911817e admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:37.189579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f305293-3152-4724-9116-a8d34911817e admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:37.190506 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f305293-3152-4724-9116-a8d34911817e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:37.192279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f305293-3152-4724-9116-a8d34911817e admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:37.208501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ae635-8dce-401b-8e39-072e8a9d18fd admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:37.214754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1044/2135] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:37.220645 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ae635-8dce-401b-8e39-072e8a9d18fd admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:37.227957 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15081b1a-a464-4a9b-b613-a3cbcb5a63f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:37.230641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15081b1a-a464-4a9b-b613-a3cbcb5a63f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:37.231372 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15081b1a-a464-4a9b-b613-a3cbcb5a63f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:37.232010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15081b1a-a464-4a9b-b613-a3cbcb5a63f3 admin admin] PATH_INFO: `/v3/projects/177adf77e0534ac6949bc88add3bfc25/users/b2bae24a668841d8a0fecf68b580f2de/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:37.256907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15081b1a-a464-4a9b-b613-a3cbcb5a63f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=177adf77e0534ac6949bc88add3bfc25, user_id=b2bae24a668841d8a0fecf68b580f2de, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:37.261832 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15081b1a-a464-4a9b-b613-a3cbcb5a63f3 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:37.294731 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf6f37-b1bb-4542-8a39-8d107f927b90 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:37.295286 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf6f37-b1bb-4542-8a39-8d107f927b90 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:37.295760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf6f37-b1bb-4542-8a39-8d107f927b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:37.297355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1092/2136] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:37 2022] PUT /identity/v3/projects/177adf77e0534ac6949bc88add3bfc25/users/b2bae24a668841d8a0fecf68b580f2de/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:37.346995 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-40cf6f37-b1bb-4542-8a39-8d107f927b90 None None] MFA Rules not processed for user `b2bae24a668841d8a0fecf68b580f2de`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:37.352836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-40cf6f37-b1bb-4542-8a39-8d107f927b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:37.545454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1045/2137] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:37.548312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15081b1a-a464-4a9b-b613-a3cbcb5a63f3 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:37.722949 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf6f37-b1bb-4542-8a39-8d107f927b90 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:37.789965 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15081b1a-a464-4a9b-b613-a3cbcb5a63f3 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:37.804855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95fb94-f090-492c-bb7e-327c48af7eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:37.805609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95fb94-f090-492c-bb7e-327c48af7eea admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:37.805827 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95fb94-f090-492c-bb7e-327c48af7eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:37.806734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95fb94-f090-492c-bb7e-327c48af7eea admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:37.808697 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95fb94-f090-492c-bb7e-327c48af7eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:37.812970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95fb94-f090-492c-bb7e-327c48af7eea admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:37.855859 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf6f37-b1bb-4542-8a39-8d107f927b90 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:37.860245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fe85d-5455-4980-8fe2-3cfbc51d9d9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:37.860909 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fe85d-5455-4980-8fe2-3cfbc51d9d9b service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:37.861193 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fe85d-5455-4980-8fe2-3cfbc51d9d9b service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:37.867053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fe85d-5455-4980-8fe2-3cfbc51d9d9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:37.876957 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1093/2138] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:37 2022] POST /identity/v3/projects => generated 375 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:37.882142 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95fb94-f090-492c-bb7e-327c48af7eea admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:38.027956 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95fb94-f090-492c-bb7e-327c48af7eea admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:38.030931 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fe85d-5455-4980-8fe2-3cfbc51d9d9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:38.032595 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fe85d-5455-4980-8fe2-3cfbc51d9d9b service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:38.033680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7b09a-2241-41ba-adae-8bb7dc716574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:38.039117 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7b09a-2241-41ba-adae-8bb7dc716574 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:38.039407 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7b09a-2241-41ba-adae-8bb7dc716574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:38.039731 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7b09a-2241-41ba-adae-8bb7dc716574 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:38.040522 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7b09a-2241-41ba-adae-8bb7dc716574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:38.042478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7b09a-2241-41ba-adae-8bb7dc716574 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:38.063223 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1046/2139] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:38.098808 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1094/2140] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:37 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:38.103526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fe85d-5455-4980-8fe2-3cfbc51d9d9b service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:38.121868 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fe85d-5455-4980-8fe2-3cfbc51d9d9b service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:38.129395 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ff5b3-3d3f-46a1-9c68-80aaeb14845a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:38.130912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ff5b3-3d3f-46a1-9c68-80aaeb14845a admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:38.131204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ff5b3-3d3f-46a1-9c68-80aaeb14845a admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:38.131919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ff5b3-3d3f-46a1-9c68-80aaeb14845a admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:38.132603 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ff5b3-3d3f-46a1-9c68-80aaeb14845a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:38.135333 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ff5b3-3d3f-46a1-9c68-80aaeb14845a admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:38.182693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1047/2141] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:38.186515 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7b09a-2241-41ba-adae-8bb7dc716574 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:38.218727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7b09a-2241-41ba-adae-8bb7dc716574 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:38.242306 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4816b7-0a6d-4804-87ef-e0b1456641a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:38.242306 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4816b7-0a6d-4804-87ef-e0b1456641a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:38.242557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4816b7-0a6d-4804-87ef-e0b1456641a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:38.242779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4816b7-0a6d-4804-87ef-e0b1456641a4 admin admin] PATH_INFO: `/v3/projects/a2b13b17b1004ed787fda2ed0600e5f4/users/660052acf2b14eaba4c1c63ecd3e41ac/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:38.289051 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4816b7-0a6d-4804-87ef-e0b1456641a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b13b17b1004ed787fda2ed0600e5f4, user_id=660052acf2b14eaba4c1c63ecd3e41ac, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:38.292451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4816b7-0a6d-4804-87ef-e0b1456641a4 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:38.330687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1095/2142] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:38 2022] PUT /identity/v3/projects/a2b13b17b1004ed787fda2ed0600e5f4/users/660052acf2b14eaba4c1c63ecd3e41ac/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:38.331734 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ff5b3-3d3f-46a1-9c68-80aaeb14845a admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:38.350344 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ff5b3-3d3f-46a1-9c68-80aaeb14845a admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:38.565143 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f32e8-9016-492e-b852-a30e99d48d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:38.566298 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f32e8-9016-492e-b852-a30e99d48d22 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:38.583956 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f32e8-9016-492e-b852-a30e99d48d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:38.584720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f32e8-9016-492e-b852-a30e99d48d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:38.585632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f32e8-9016-492e-b852-a30e99d48d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:38.588035 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f32e8-9016-492e-b852-a30e99d48d22 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:38.607295 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1048/2143] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:38.609029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4816b7-0a6d-4804-87ef-e0b1456641a4 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:38.631302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4816b7-0a6d-4804-87ef-e0b1456641a4 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:38.644934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c579e7a-8749-428d-ae2b-c02431be8aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:38.648285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c579e7a-8749-428d-ae2b-c02431be8aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:38.659637 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c579e7a-8749-428d-ae2b-c02431be8aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:38.660239 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c579e7a-8749-428d-ae2b-c02431be8aa6 admin admin] PATH_INFO: `/v3/projects/a2b13b17b1004ed787fda2ed0600e5f4/users/660052acf2b14eaba4c1c63ecd3e41ac/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:38.663671 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c579e7a-8749-428d-ae2b-c02431be8aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b13b17b1004ed787fda2ed0600e5f4, user_id=660052acf2b14eaba4c1c63ecd3e41ac, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:38.667357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c579e7a-8749-428d-ae2b-c02431be8aa6 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:38.705392 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbce86c-059d-4ddd-8fd7-c82f661a3e40 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:38.705968 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbce86c-059d-4ddd-8fd7-c82f661a3e40 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:38.706666 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbce86c-059d-4ddd-8fd7-c82f661a3e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:38.714112 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1096/2144] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:38 2022] PUT /identity/v3/projects/a2b13b17b1004ed787fda2ed0600e5f4/users/660052acf2b14eaba4c1c63ecd3e41ac/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:38.775972 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-2dbce86c-059d-4ddd-8fd7-c82f661a3e40 None None] MFA Rules not processed for user `660052acf2b14eaba4c1c63ecd3e41ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:38.778895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-2dbce86c-059d-4ddd-8fd7-c82f661a3e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:38.886924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1049/2145] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:38.896835 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c579e7a-8749-428d-ae2b-c02431be8aa6 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:38.903514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-2c579e7a-8749-428d-ae2b-c02431be8aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:39.082567 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c579e7a-8749-428d-ae2b-c02431be8aa6 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:39.109065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbce86c-059d-4ddd-8fd7-c82f661a3e40 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:39.110578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ed741-ecde-4d1e-9df4-be1b9a8ab706 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:39.111365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-2dbce86c-059d-4ddd-8fd7-c82f661a3e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:39.113431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ed741-ecde-4d1e-9df4-be1b9a8ab706 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:39.117153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ed741-ecde-4d1e-9df4-be1b9a8ab706 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:39.123407 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ed741-ecde-4d1e-9df4-be1b9a8ab706 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:39.258959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ed741-ecde-4d1e-9df4-be1b9a8ab706 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:39.263161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ed741-ecde-4d1e-9df4-be1b9a8ab706 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:39.281191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1097/2146] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:39.314536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbce86c-059d-4ddd-8fd7-c82f661a3e40 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:39.328897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3045e-96a1-4ac9-86ec-109f18816349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:39.330196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3045e-96a1-4ac9-86ec-109f18816349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:39.330648 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3045e-96a1-4ac9-86ec-109f18816349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:39.331117 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3045e-96a1-4ac9-86ec-109f18816349 admin admin] PATH_INFO: `/v3/users/46a3d0998b4e4637a9348a3f20223852` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:39.333805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3045e-96a1-4ac9-86ec-109f18816349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a3d0998b4e4637a9348a3f20223852)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:39.338635 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3045e-96a1-4ac9-86ec-109f18816349 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:39.473747 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b0a3045e-96a1-4ac9-86ec-109f18816349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a3d0998b4e4637a9348a3f20223852'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:39.474459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b0a3045e-96a1-4ac9-86ec-109f18816349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a3d0998b4e4637a9348a3f20223852'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:39.492720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b0a3045e-96a1-4ac9-86ec-109f18816349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a3d0998b4e4637a9348a3f20223852'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:39.509494 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b0a3045e-96a1-4ac9-86ec-109f18816349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a3d0998b4e4637a9348a3f20223852'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:39.512279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b0a3045e-96a1-4ac9-86ec-109f18816349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a3d0998b4e4637a9348a3f20223852'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:39.539773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1050/2147] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:39 2022] DELETE /identity/v3/users/46a3d0998b4e4637a9348a3f20223852 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:39.544773 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedb484-ae9a-4fde-b2b2-49fa829438b0 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:39.545409 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedb484-ae9a-4fde-b2b2-49fa829438b0 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:39.545901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedb484-ae9a-4fde-b2b2-49fa829438b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:39.584355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-2fedb484-ae9a-4fde-b2b2-49fa829438b0 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:39.585899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-2fedb484-ae9a-4fde-b2b2-49fa829438b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:39.689016 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1098/2148] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:39.703739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3045e-96a1-4ac9-86ec-109f18816349 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:39.706338 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b0a3045e-96a1-4ac9-86ec-109f18816349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:39.899678 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3045e-96a1-4ac9-86ec-109f18816349 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:39.910250 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee162fd-36ab-47e3-a98e-d3c1276fe449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:39.911186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee162fd-36ab-47e3-a98e-d3c1276fe449 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:39.911676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee162fd-36ab-47e3-a98e-d3c1276fe449 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:39.912351 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee162fd-36ab-47e3-a98e-d3c1276fe449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:39.930157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee162fd-36ab-47e3-a98e-d3c1276fe449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:39.931910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee162fd-36ab-47e3-a98e-d3c1276fe449 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:39.954904 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1051/2149] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:40.006565 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81437b88-ab7b-4a60-b3d1-82d703a512c2 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:40.007529 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81437b88-ab7b-4a60-b3d1-82d703a512c2 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:40.008266 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81437b88-ab7b-4a60-b3d1-82d703a512c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:40.074252 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-81437b88-ab7b-4a60-b3d1-82d703a512c2 None None] MFA Rules not processed for user `b92a47e8971d49f3bbeea408a189aad7`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:40.075952 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-81437b88-ab7b-4a60-b3d1-82d703a512c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:40.223236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1099/2150] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:40.233308 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee162fd-36ab-47e3-a98e-d3c1276fe449 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:40.235108 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-1ee162fd-36ab-47e3-a98e-d3c1276fe449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:40.409812 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee162fd-36ab-47e3-a98e-d3c1276fe449 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:40.416495 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e7f15-7e85-4528-a652-c05a270a0cd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:40.417441 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e7f15-7e85-4528-a652-c05a270a0cd5 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:40.417971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e7f15-7e85-4528-a652-c05a270a0cd5 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:40.418367 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e7f15-7e85-4528-a652-c05a270a0cd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:40.420708 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d30e7f15-7e85-4528-a652-c05a270a0cd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:40.493761 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e7f15-7e85-4528-a652-c05a270a0cd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:40.496291 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e7f15-7e85-4528-a652-c05a270a0cd5 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:40.518493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1052/2151] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:40.572544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81437b88-ab7b-4a60-b3d1-82d703a512c2 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:40.574056 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-81437b88-ab7b-4a60-b3d1-82d703a512c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:40.605874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81437b88-ab7b-4a60-b3d1-82d703a512c2 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:40.611359 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c99c59-c3fc-4f1f-b63f-dab5f0851838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:40.612278 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c99c59-c3fc-4f1f-b63f-dab5f0851838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:40.612562 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c99c59-c3fc-4f1f-b63f-dab5f0851838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:40.612850 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c99c59-c3fc-4f1f-b63f-dab5f0851838 admin admin] PATH_INFO: `/v3/projects/36182fe0c2a742e185c252ab83d86b1b` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:40.614481 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c99c59-c3fc-4f1f-b63f-dab5f0851838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36182fe0c2a742e185c252ab83d86b1b)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:40.616261 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c99c59-c3fc-4f1f-b63f-dab5f0851838 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:40.687718 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-74c99c59-c3fc-4f1f-b63f-dab5f0851838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36182fe0c2a742e185c252ab83d86b1b', 'request_id': 'req-74c99c59-c3fc-4f1f-b63f-dab5f0851838'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:40.695865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-74c99c59-c3fc-4f1f-b63f-dab5f0851838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36182fe0c2a742e185c252ab83d86b1b', 'request_id': 'req-74c99c59-c3fc-4f1f-b63f-dab5f0851838'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:40.702371 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-74c99c59-c3fc-4f1f-b63f-dab5f0851838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36182fe0c2a742e185c252ab83d86b1b', 'request_id': 'req-74c99c59-c3fc-4f1f-b63f-dab5f0851838'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:40.716047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-74c99c59-c3fc-4f1f-b63f-dab5f0851838 admin admin] The token cache is being invalidate because project 36182fe0c2a742e185c252ab83d86b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:40.716378 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-74c99c59-c3fc-4f1f-b63f-dab5f0851838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:40.717629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-74c99c59-c3fc-4f1f-b63f-dab5f0851838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:40.719029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1100/2152] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:40 2022] DELETE /identity/v3/projects/36182fe0c2a742e185c252ab83d86b1b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:40.724936 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f100ba-971d-4383-b3bf-15c9b5daf204 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:40.725236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f100ba-971d-4383-b3bf-15c9b5daf204 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:40.725509 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f100ba-971d-4383-b3bf-15c9b5daf204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:40.748469 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-04f100ba-971d-4383-b3bf-15c9b5daf204 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:40.749908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-04f100ba-971d-4383-b3bf-15c9b5daf204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:40.824898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1053/2153] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:40.832940 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ed5f5-ed4a-4f43-b05f-25f6460252e9 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:40.833809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ed5f5-ed4a-4f43-b05f-25f6460252e9 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:40.834274 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ed5f5-ed4a-4f43-b05f-25f6460252e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:40.878824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-dd8ed5f5-ed4a-4f43-b05f-25f6460252e9 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:40.878824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-dd8ed5f5-ed4a-4f43-b05f-25f6460252e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:40.905447 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1101/2154] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:40.906987 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f100ba-971d-4383-b3bf-15c9b5daf204 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:40.919727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f100ba-971d-4383-b3bf-15c9b5daf204 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:40.925157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943b95b-c2be-40d0-9540-ea2253cdfb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:40.925991 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943b95b-c2be-40d0-9540-ea2253cdfb98 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:40.926276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943b95b-c2be-40d0-9540-ea2253cdfb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:40.926548 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943b95b-c2be-40d0-9540-ea2253cdfb98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:40.927726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943b95b-c2be-40d0-9540-ea2253cdfb98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:40.928031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943b95b-c2be-40d0-9540-ea2253cdfb98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:40.930782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943b95b-c2be-40d0-9540-ea2253cdfb98 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:40.953777 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1054/2155] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:40.956281 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ed5f5-ed4a-4f43-b05f-25f6460252e9 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:40.967821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ed5f5-ed4a-4f43-b05f-25f6460252e9 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:40.982276 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c8705-05b3-42f8-bf5f-ee236d366af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:40.983213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c8705-05b3-42f8-bf5f-ee236d366af2 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:40.983630 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c8705-05b3-42f8-bf5f-ee236d366af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:40.983909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c8705-05b3-42f8-bf5f-ee236d366af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:40.984798 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c8705-05b3-42f8-bf5f-ee236d366af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:40.986716 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c8705-05b3-42f8-bf5f-ee236d366af2 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:41.067863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1102/2156] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:40 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:41.072065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943b95b-c2be-40d0-9540-ea2253cdfb98 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:41.086554 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943b95b-c2be-40d0-9540-ea2253cdfb98 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:41.203580 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ee011-290b-4abc-a070-0ff09bca1fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:41.204277 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ee011-290b-4abc-a070-0ff09bca1fae admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:41.204562 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ee011-290b-4abc-a070-0ff09bca1fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:41.204835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ee011-290b-4abc-a070-0ff09bca1fae admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:41.205528 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ee011-290b-4abc-a070-0ff09bca1fae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:41.208545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ee011-290b-4abc-a070-0ff09bca1fae admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:41.247157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1055/2157] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:41 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:41.251336 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c8705-05b3-42f8-bf5f-ee236d366af2 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:41.275681 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c8705-05b3-42f8-bf5f-ee236d366af2 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:41.291478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e443cfc-3f20-4372-bb36-f9f85cfac93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:41.291910 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e443cfc-3f20-4372-bb36-f9f85cfac93f admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:41.292210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e443cfc-3f20-4372-bb36-f9f85cfac93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:41.292473 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e443cfc-3f20-4372-bb36-f9f85cfac93f admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:41.293203 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e443cfc-3f20-4372-bb36-f9f85cfac93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:41.295937 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e443cfc-3f20-4372-bb36-f9f85cfac93f admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:41.313102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1103/2158] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:41.317486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ee011-290b-4abc-a070-0ff09bca1fae admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:41.336804 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e443cfc-3f20-4372-bb36-f9f85cfac93f admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:41.339397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-9e443cfc-3f20-4372-bb36-f9f85cfac93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:41.341015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ee011-290b-4abc-a070-0ff09bca1fae admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:41.360070 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44fd84-c22e-4a54-9981-2824b03899cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:41.360763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44fd84-c22e-4a54-9981-2824b03899cf admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:41.361052 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44fd84-c22e-4a54-9981-2824b03899cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:41.361387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44fd84-c22e-4a54-9981-2824b03899cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:41.363438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44fd84-c22e-4a54-9981-2824b03899cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:41.367873 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44fd84-c22e-4a54-9981-2824b03899cf admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:41.407289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1056/2159] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:01:41.408101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44fd84-c22e-4a54-9981-2824b03899cf admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:41.428264 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44fd84-c22e-4a54-9981-2824b03899cf admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:41.439666 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a821c-0ea0-4b4c-849c-d2fd950459e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:41.440573 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a821c-0ea0-4b4c-849c-d2fd950459e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:41.440853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a821c-0ea0-4b4c-849c-d2fd950459e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:41.441133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a821c-0ea0-4b4c-849c-d2fd950459e6 admin admin] PATH_INFO: `/v3/projects/b1e759f08bf04eeabbbc1b14bca8a169/users/c4f57917c86244c2baecd9d795c502c4/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:41.484149 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e443cfc-3f20-4372-bb36-f9f85cfac93f admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:41.485015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a821c-0ea0-4b4c-849c-d2fd950459e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e759f08bf04eeabbbc1b14bca8a169, user_id=c4f57917c86244c2baecd9d795c502c4, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:41.491818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a821c-0ea0-4b4c-849c-d2fd950459e6 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:41.502628 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454337d-6609-4169-8203-1118f8ae50e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:41.503285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454337d-6609-4169-8203-1118f8ae50e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:41.503673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454337d-6609-4169-8203-1118f8ae50e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:41.503839 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454337d-6609-4169-8203-1118f8ae50e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:41.522891 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1057/2160] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:41 2022] PUT /identity/v3/projects/b1e759f08bf04eeabbbc1b14bca8a169/users/c4f57917c86244c2baecd9d795c502c4/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:41.523008 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-9454337d-6609-4169-8203-1118f8ae50e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:41.524445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70751c-d232-48b8-bc9f-1c5028c63c25 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:41.525360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70751c-d232-48b8-bc9f-1c5028c63c25 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:41.525520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70751c-d232-48b8-bc9f-1c5028c63c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:41.554106 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-3a70751c-d232-48b8-bc9f-1c5028c63c25 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:41.555633 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-3a70751c-d232-48b8-bc9f-1c5028c63c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:41.691173 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1058/2161] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:41.703863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454337d-6609-4169-8203-1118f8ae50e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:41.705784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454337d-6609-4169-8203-1118f8ae50e5 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:41.707388 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70751c-d232-48b8-bc9f-1c5028c63c25 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:41.709607 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-3a70751c-d232-48b8-bc9f-1c5028c63c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:41.718274 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1104/2162] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:41.784913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70751c-d232-48b8-bc9f-1c5028c63c25 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:41.790238 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9899b9-f7e3-4fbd-a85d-19f6208afcad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:41.791793 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9899b9-f7e3-4fbd-a85d-19f6208afcad service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:41.792398 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9899b9-f7e3-4fbd-a85d-19f6208afcad service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:41.792968 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9899b9-f7e3-4fbd-a85d-19f6208afcad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:41.805034 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9899b9-f7e3-4fbd-a85d-19f6208afcad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:41.807655 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9899b9-f7e3-4fbd-a85d-19f6208afcad service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:41.819364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1059/2163] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:42.478957 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454337d-6609-4169-8203-1118f8ae50e5 service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:42.489446 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454337d-6609-4169-8203-1118f8ae50e5 service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:42.570992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ad4fc-5927-4a3c-9845-ba8d60ab2855 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:42.572052 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ad4fc-5927-4a3c-9845-ba8d60ab2855 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:42.572052 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ad4fc-5927-4a3c-9845-ba8d60ab2855 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:42.574629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ad4fc-5927-4a3c-9845-ba8d60ab2855 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:42.578423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a39ad4fc-5927-4a3c-9845-ba8d60ab2855 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:42.746686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ad4fc-5927-4a3c-9845-ba8d60ab2855 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:42.750807 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ad4fc-5927-4a3c-9845-ba8d60ab2855 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:42.776093 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1105/2164] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:47.190937 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9899b9-f7e3-4fbd-a85d-19f6208afcad service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:47.192469 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ac9899b9-f7e3-4fbd-a85d-19f6208afcad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:47.217312 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9899b9-f7e3-4fbd-a85d-19f6208afcad service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:47.237516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2048d-fc8f-4e92-b095-99df3bf2fcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:47.238735 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2048d-fc8f-4e92-b095-99df3bf2fcdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.239252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2048d-fc8f-4e92-b095-99df3bf2fcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.239739 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2048d-fc8f-4e92-b095-99df3bf2fcdd admin admin] PATH_INFO: `/v3/users/31bbc5f270724463a2691b52d5fd7804` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:47.241326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2048d-fc8f-4e92-b095-99df3bf2fcdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=31bbc5f270724463a2691b52d5fd7804)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:47.244344 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2048d-fc8f-4e92-b095-99df3bf2fcdd admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:47.254860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43855de8-4c13-45c3-a1f0-339b165c8ba7 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.255451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43855de8-4c13-45c3-a1f0-339b165c8ba7 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.255451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43855de8-4c13-45c3-a1f0-339b165c8ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:47.304977 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-43855de8-4c13-45c3-a1f0-339b165c8ba7 None None] MFA Rules not processed for user `c4f57917c86244c2baecd9d795c502c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:47.306955 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-43855de8-4c13-45c3-a1f0-339b165c8ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:47.330558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-19d2048d-fc8f-4e92-b095-99df3bf2fcdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31bbc5f270724463a2691b52d5fd7804'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:47.331547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-19d2048d-fc8f-4e92-b095-99df3bf2fcdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31bbc5f270724463a2691b52d5fd7804'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:47.354311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-19d2048d-fc8f-4e92-b095-99df3bf2fcdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31bbc5f270724463a2691b52d5fd7804'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:47.373437 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-19d2048d-fc8f-4e92-b095-99df3bf2fcdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31bbc5f270724463a2691b52d5fd7804'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:47.375437 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-19d2048d-fc8f-4e92-b095-99df3bf2fcdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31bbc5f270724463a2691b52d5fd7804'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:47.410202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1060/2165] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:47 2022] DELETE /identity/v3/users/31bbc5f270724463a2691b52d5fd7804 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:47.415398 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cac2d-af0e-4444-821b-055f38da8412 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.418218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cac2d-af0e-4444-821b-055f38da8412 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.418862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cac2d-af0e-4444-821b-055f38da8412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:47.444665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1106/2166] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:47.445973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43855de8-4c13-45c3-a1f0-339b165c8ba7 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:47.448232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-43855de8-4c13-45c3-a1f0-339b165c8ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:47.452929 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-c03cac2d-af0e-4444-821b-055f38da8412 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:47.454123 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-c03cac2d-af0e-4444-821b-055f38da8412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:47.481106 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43855de8-4c13-45c3-a1f0-339b165c8ba7 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:47.584362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1061/2167] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:47.598227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cac2d-af0e-4444-821b-055f38da8412 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:47.600525 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-c03cac2d-af0e-4444-821b-055f38da8412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:47.610081 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc79458-9d6e-4a0d-bc70-185f595a438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:47.610927 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc79458-9d6e-4a0d-bc70-185f595a438a admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.611350 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc79458-9d6e-4a0d-bc70-185f595a438a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.611779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc79458-9d6e-4a0d-bc70-185f595a438a admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:47.612885 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc79458-9d6e-4a0d-bc70-185f595a438a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:47.615199 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc79458-9d6e-4a0d-bc70-185f595a438a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:47.666431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1107/2168] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:47 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:47.670985 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc79458-9d6e-4a0d-bc70-185f595a438a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:47.687529 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cac2d-af0e-4444-821b-055f38da8412 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:47.737537 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc79458-9d6e-4a0d-bc70-185f595a438a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:47.746492 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d609f7c-ab28-4155-9303-12dc5e1a3b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:47.747260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d609f7c-ab28-4155-9303-12dc5e1a3b74 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.747612 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d609f7c-ab28-4155-9303-12dc5e1a3b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.747711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcabea-cb62-45dd-8a8c-cc535ef55a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:47.748011 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d609f7c-ab28-4155-9303-12dc5e1a3b74 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:47.748375 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcabea-cb62-45dd-8a8c-cc535ef55a71 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.748661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcabea-cb62-45dd-8a8c-cc535ef55a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.748930 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d609f7c-ab28-4155-9303-12dc5e1a3b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:47.749036 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcabea-cb62-45dd-8a8c-cc535ef55a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:47.750962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d609f7c-ab28-4155-9303-12dc5e1a3b74 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:47.759393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcabea-cb62-45dd-8a8c-cc535ef55a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:47.760885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcabea-cb62-45dd-8a8c-cc535ef55a71 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:47.774652 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1062/2169] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:01:47.776731 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1108/2170] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:47 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:47.781640 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcabea-cb62-45dd-8a8c-cc535ef55a71 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:47.792826 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcabea-cb62-45dd-8a8c-cc535ef55a71 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:47.800432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76dcd7-418c-4c5c-a17f-12d5b6f2bde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:47.801115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76dcd7-418c-4c5c-a17f-12d5b6f2bde5 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.801676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76dcd7-418c-4c5c-a17f-12d5b6f2bde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.801794 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76dcd7-418c-4c5c-a17f-12d5b6f2bde5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:47.802574 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76dcd7-418c-4c5c-a17f-12d5b6f2bde5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:47.804195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76dcd7-418c-4c5c-a17f-12d5b6f2bde5 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:47.821516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1063/2171] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:47.822378 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d609f7c-ab28-4155-9303-12dc5e1a3b74 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:47.832895 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d609f7c-ab28-4155-9303-12dc5e1a3b74 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:47.839528 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4770a-e60c-4b01-8e7d-2eaaa228769c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:47.840419 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4770a-e60c-4b01-8e7d-2eaaa228769c admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.840702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4770a-e60c-4b01-8e7d-2eaaa228769c admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.840978 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4770a-e60c-4b01-8e7d-2eaaa228769c admin admin] PATH_INFO: `/v3/projects/39473eb2570a473ea318fffb547e4267/users/b7eab96549924bfdb0213e1c8a200917/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:47.865734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4770a-e60c-4b01-8e7d-2eaaa228769c admin admin] RBAC: Authorizing `identity:create_grant(project_id=39473eb2570a473ea318fffb547e4267, user_id=b7eab96549924bfdb0213e1c8a200917, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:47.870794 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4770a-e60c-4b01-8e7d-2eaaa228769c admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:47.888645 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1109/2172] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:47 2022] PUT /identity/v3/projects/39473eb2570a473ea318fffb547e4267/users/b7eab96549924bfdb0213e1c8a200917/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:47.892466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76dcd7-418c-4c5c-a17f-12d5b6f2bde5 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:47.903862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76dcd7-418c-4c5c-a17f-12d5b6f2bde5 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:47.976868 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbba53-52bc-46c5-af18-5d88bba75e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:47.977448 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbba53-52bc-46c5-af18-5d88bba75e95 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:47.978427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbba53-52bc-46c5-af18-5d88bba75e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:47.978556 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbba53-52bc-46c5-af18-5d88bba75e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:47.979283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbba53-52bc-46c5-af18-5d88bba75e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:47.980930 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbba53-52bc-46c5-af18-5d88bba75e95 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:47.993868 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1064/2173] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:47.998635 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4770a-e60c-4b01-8e7d-2eaaa228769c admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:48.014034 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4770a-e60c-4b01-8e7d-2eaaa228769c admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:48.019588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b0462-9a6d-46bc-a7b9-bda08c560229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:48.020739 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0462-9a6d-46bc-a7b9-bda08c560229 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:48.021021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0462-9a6d-46bc-a7b9-bda08c560229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:48.021303 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0462-9a6d-46bc-a7b9-bda08c560229 admin admin] PATH_INFO: `/v3/projects/39473eb2570a473ea318fffb547e4267/users/b7eab96549924bfdb0213e1c8a200917/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:48.023558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b0462-9a6d-46bc-a7b9-bda08c560229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39473eb2570a473ea318fffb547e4267, user_id=b7eab96549924bfdb0213e1c8a200917, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:48.027038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b0462-9a6d-46bc-a7b9-bda08c560229 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:48.037745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1110/2174] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:47 2022] PUT /identity/v3/projects/39473eb2570a473ea318fffb547e4267/users/b7eab96549924bfdb0213e1c8a200917/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:48.078638 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbba53-52bc-46c5-af18-5d88bba75e95 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:48.080795 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-54dbba53-52bc-46c5-af18-5d88bba75e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:48.106037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbba53-52bc-46c5-af18-5d88bba75e95 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:48.192796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26adcf8-975a-4d5f-88ec-98408635bd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:48.194358 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26adcf8-975a-4d5f-88ec-98408635bd11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:48.194676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26adcf8-975a-4d5f-88ec-98408635bd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:48.194930 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26adcf8-975a-4d5f-88ec-98408635bd11 admin admin] PATH_INFO: `/v3/projects/a2a5a7ccfdd7447c8009d4766c704703` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:48.196215 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26adcf8-975a-4d5f-88ec-98408635bd11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a5a7ccfdd7447c8009d4766c704703)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:48.198138 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26adcf8-975a-4d5f-88ec-98408635bd11 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:48.249274 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-c26adcf8-975a-4d5f-88ec-98408635bd11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a5a7ccfdd7447c8009d4766c704703', 'request_id': 'req-c26adcf8-975a-4d5f-88ec-98408635bd11'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:48.254840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-c26adcf8-975a-4d5f-88ec-98408635bd11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a5a7ccfdd7447c8009d4766c704703', 'request_id': 'req-c26adcf8-975a-4d5f-88ec-98408635bd11'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:48.262521 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-c26adcf8-975a-4d5f-88ec-98408635bd11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a5a7ccfdd7447c8009d4766c704703', 'request_id': 'req-c26adcf8-975a-4d5f-88ec-98408635bd11'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:48.279921 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-c26adcf8-975a-4d5f-88ec-98408635bd11 admin admin] The token cache is being invalidate because project a2a5a7ccfdd7447c8009d4766c704703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:48.280642 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-c26adcf8-975a-4d5f-88ec-98408635bd11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:48.281403 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-c26adcf8-975a-4d5f-88ec-98408635bd11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:48.283561 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1065/2175] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:48 2022] DELETE /identity/v3/projects/a2a5a7ccfdd7447c8009d4766c704703 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:48.288123 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b0462-9a6d-46bc-a7b9-bda08c560229 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:48.290117 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d02b0462-9a6d-46bc-a7b9-bda08c560229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:48.304031 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b0462-9a6d-46bc-a7b9-bda08c560229 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:48.362755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e7f16-72f2-4e1f-8fb8-5f8c9676ca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:48.363553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e7f16-72f2-4e1f-8fb8-5f8c9676ca20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:48.363837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e7f16-72f2-4e1f-8fb8-5f8c9676ca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:48.364114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e7f16-72f2-4e1f-8fb8-5f8c9676ca20 admin admin] PATH_INFO: `/v3/users/b2bae24a668841d8a0fecf68b580f2de` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:48.365382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e7f16-72f2-4e1f-8fb8-5f8c9676ca20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2bae24a668841d8a0fecf68b580f2de)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:48.367303 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e7f16-72f2-4e1f-8fb8-5f8c9676ca20 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:48.426473 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-ce6e7f16-72f2-4e1f-8fb8-5f8c9676ca20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2bae24a668841d8a0fecf68b580f2de'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:48.440514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-ce6e7f16-72f2-4e1f-8fb8-5f8c9676ca20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2bae24a668841d8a0fecf68b580f2de'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:48.448583 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-ce6e7f16-72f2-4e1f-8fb8-5f8c9676ca20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2bae24a668841d8a0fecf68b580f2de'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:48.449411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-ce6e7f16-72f2-4e1f-8fb8-5f8c9676ca20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2bae24a668841d8a0fecf68b580f2de'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:48.462391 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-ce6e7f16-72f2-4e1f-8fb8-5f8c9676ca20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2bae24a668841d8a0fecf68b580f2de'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:48.471548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1111/2176] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:48 2022] DELETE /identity/v3/users/b2bae24a668841d8a0fecf68b580f2de => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:48.817770 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26adcf8-975a-4d5f-88ec-98408635bd11 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:48.853681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26adcf8-975a-4d5f-88ec-98408635bd11 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:49.015313 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39368382-65b7-4ed6-9d61-2be336286e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:49.016463 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39368382-65b7-4ed6-9d61-2be336286e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:49.016844 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39368382-65b7-4ed6-9d61-2be336286e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:49.017338 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39368382-65b7-4ed6-9d61-2be336286e51 admin admin] PATH_INFO: `/v3/projects/177adf77e0534ac6949bc88add3bfc25` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:49.019113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39368382-65b7-4ed6-9d61-2be336286e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=177adf77e0534ac6949bc88add3bfc25)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:49.021378 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39368382-65b7-4ed6-9d61-2be336286e51 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:49.146924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-39368382-65b7-4ed6-9d61-2be336286e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177adf77e0534ac6949bc88add3bfc25', 'request_id': 'req-39368382-65b7-4ed6-9d61-2be336286e51'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.172998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-39368382-65b7-4ed6-9d61-2be336286e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177adf77e0534ac6949bc88add3bfc25', 'request_id': 'req-39368382-65b7-4ed6-9d61-2be336286e51'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.187271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-39368382-65b7-4ed6-9d61-2be336286e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177adf77e0534ac6949bc88add3bfc25', 'request_id': 'req-39368382-65b7-4ed6-9d61-2be336286e51'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.207505 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-39368382-65b7-4ed6-9d61-2be336286e51 admin admin] The token cache is being invalidate because project 177adf77e0534ac6949bc88add3bfc25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:49.209489 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-39368382-65b7-4ed6-9d61-2be336286e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.212754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-39368382-65b7-4ed6-9d61-2be336286e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.218959 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1066/2177] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:48 2022] DELETE /identity/v3/projects/177adf77e0534ac6949bc88add3bfc25 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:49.221096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e7f16-72f2-4e1f-8fb8-5f8c9676ca20 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:49.224110 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ce6e7f16-72f2-4e1f-8fb8-5f8c9676ca20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:49.246329 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e7f16-72f2-4e1f-8fb8-5f8c9676ca20 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:49.317625 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f1680-7aff-4b5a-afed-8826780166d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:49.318501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f1680-7aff-4b5a-afed-8826780166d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:49.318937 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f1680-7aff-4b5a-afed-8826780166d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:49.319348 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f1680-7aff-4b5a-afed-8826780166d2 admin admin] PATH_INFO: `/v3/users/660052acf2b14eaba4c1c63ecd3e41ac` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:49.320594 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f1680-7aff-4b5a-afed-8826780166d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=660052acf2b14eaba4c1c63ecd3e41ac)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:49.323087 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f1680-7aff-4b5a-afed-8826780166d2 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:49.373697 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b41f1680-7aff-4b5a-afed-8826780166d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '660052acf2b14eaba4c1c63ecd3e41ac'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.393545 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b41f1680-7aff-4b5a-afed-8826780166d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '660052acf2b14eaba4c1c63ecd3e41ac'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.396131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b41f1680-7aff-4b5a-afed-8826780166d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '660052acf2b14eaba4c1c63ecd3e41ac'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.396907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b41f1680-7aff-4b5a-afed-8826780166d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '660052acf2b14eaba4c1c63ecd3e41ac'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.405813 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b41f1680-7aff-4b5a-afed-8826780166d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '660052acf2b14eaba4c1c63ecd3e41ac'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.412479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1112/2178] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:49 2022] DELETE /identity/v3/users/660052acf2b14eaba4c1c63ecd3e41ac => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:49.710428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39368382-65b7-4ed6-9d61-2be336286e51 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:49.713424 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-39368382-65b7-4ed6-9d61-2be336286e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:49.738396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39368382-65b7-4ed6-9d61-2be336286e51 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:49.802442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbd112-a738-4a1f-8e2e-51b2c628cd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:49.803409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbd112-a738-4a1f-8e2e-51b2c628cd22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:49.803783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbd112-a738-4a1f-8e2e-51b2c628cd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:49.804124 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbd112-a738-4a1f-8e2e-51b2c628cd22 admin admin] PATH_INFO: `/v3/projects/a2b13b17b1004ed787fda2ed0600e5f4` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:49.805495 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbd112-a738-4a1f-8e2e-51b2c628cd22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b13b17b1004ed787fda2ed0600e5f4)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:49.808368 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbd112-a738-4a1f-8e2e-51b2c628cd22 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:49.883616 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-e5bbd112-a738-4a1f-8e2e-51b2c628cd22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b13b17b1004ed787fda2ed0600e5f4', 'request_id': 'req-e5bbd112-a738-4a1f-8e2e-51b2c628cd22'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.890609 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-e5bbd112-a738-4a1f-8e2e-51b2c628cd22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b13b17b1004ed787fda2ed0600e5f4', 'request_id': 'req-e5bbd112-a738-4a1f-8e2e-51b2c628cd22'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.898165 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-e5bbd112-a738-4a1f-8e2e-51b2c628cd22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b13b17b1004ed787fda2ed0600e5f4', 'request_id': 'req-e5bbd112-a738-4a1f-8e2e-51b2c628cd22'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.915189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-e5bbd112-a738-4a1f-8e2e-51b2c628cd22 admin admin] The token cache is being invalidate because project a2b13b17b1004ed787fda2ed0600e5f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:49.915461 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-e5bbd112-a738-4a1f-8e2e-51b2c628cd22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.916193 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-e5bbd112-a738-4a1f-8e2e-51b2c628cd22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:49.918057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1067/2179] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:49 2022] DELETE /identity/v3/projects/a2b13b17b1004ed787fda2ed0600e5f4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:49.923098 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbe513-0dab-428c-bb35-822f73009a0b None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:49.923512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbe513-0dab-428c-bb35-822f73009a0b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:49.923935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbe513-0dab-428c-bb35-822f73009a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:49.947115 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-15fbe513-0dab-428c-bb35-822f73009a0b None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:49.948531 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-15fbe513-0dab-428c-bb35-822f73009a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:50.027270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1113/2180] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:50.039554 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3d00d-1d42-4bf9-8598-2655d0cb96d4 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:50.039937 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3d00d-1d42-4bf9-8598-2655d0cb96d4 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:50.040143 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3d00d-1d42-4bf9-8598-2655d0cb96d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:50.058732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-56f3d00d-1d42-4bf9-8598-2655d0cb96d4 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:50.059945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-56f3d00d-1d42-4bf9-8598-2655d0cb96d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:50.075463 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1068/2181] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:50.076544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbe513-0dab-428c-bb35-822f73009a0b None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:50.090573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbe513-0dab-428c-bb35-822f73009a0b None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:50.095884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf1b52-bb09-497b-bbbf-9b04aa6ed750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:50.096735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf1b52-bb09-497b-bbbf-9b04aa6ed750 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:50.097119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf1b52-bb09-497b-bbbf-9b04aa6ed750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:50.097495 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf1b52-bb09-497b-bbbf-9b04aa6ed750 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:50.098323 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf1b52-bb09-497b-bbbf-9b04aa6ed750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:50.098731 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf1b52-bb09-497b-bbbf-9b04aa6ed750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:50.100441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf1b52-bb09-497b-bbbf-9b04aa6ed750 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:50.119157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1114/2182] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:50.126449 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3d00d-1d42-4bf9-8598-2655d0cb96d4 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:50.146007 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3d00d-1d42-4bf9-8598-2655d0cb96d4 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:50.158162 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25718254-87c4-4a54-9e53-a73577a1e5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:50.159928 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25718254-87c4-4a54-9e53-a73577a1e5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:50.160352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25718254-87c4-4a54-9e53-a73577a1e5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:50.161801 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25718254-87c4-4a54-9e53-a73577a1e5f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:50.162973 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25718254-87c4-4a54-9e53-a73577a1e5f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:50.168305 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25718254-87c4-4a54-9e53-a73577a1e5f6 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:50.213750 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1069/2183] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:50 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:50.215967 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf1b52-bb09-497b-bbbf-9b04aa6ed750 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:50.234938 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf1b52-bb09-497b-bbbf-9b04aa6ed750 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:50.348060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070f43e-7620-46cc-8201-0b9f5c882424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:50.350033 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070f43e-7620-46cc-8201-0b9f5c882424 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:50.350797 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070f43e-7620-46cc-8201-0b9f5c882424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:50.351315 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070f43e-7620-46cc-8201-0b9f5c882424 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:50.352278 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070f43e-7620-46cc-8201-0b9f5c882424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:50.355112 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070f43e-7620-46cc-8201-0b9f5c882424 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:50.402219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1115/2184] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:50 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:01:50.405864 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25718254-87c4-4a54-9e53-a73577a1e5f6 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:50.431225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25718254-87c4-4a54-9e53-a73577a1e5f6 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:50.455819 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a710477-2a44-44a0-a39c-f1c814374a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:50.458677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a710477-2a44-44a0-a39c-f1c814374a3a admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:50.458982 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a710477-2a44-44a0-a39c-f1c814374a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:50.460441 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a710477-2a44-44a0-a39c-f1c814374a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:50.461238 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a710477-2a44-44a0-a39c-f1c814374a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:50.463062 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a710477-2a44-44a0-a39c-f1c814374a3a admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:50.489072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1070/2185] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:50.494204 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070f43e-7620-46cc-8201-0b9f5c882424 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:50.518487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070f43e-7620-46cc-8201-0b9f5c882424 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:50.526727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e8c81-1255-4aa5-8463-fc2adebc023b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:50.527650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e8c81-1255-4aa5-8463-fc2adebc023b admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:50.528086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e8c81-1255-4aa5-8463-fc2adebc023b admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:50.528647 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e8c81-1255-4aa5-8463-fc2adebc023b admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:50.530172 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e8c81-1255-4aa5-8463-fc2adebc023b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:50.532939 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e8c81-1255-4aa5-8463-fc2adebc023b admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:50.554204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a710477-2a44-44a0-a39c-f1c814374a3a admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:50.570024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1116/2186] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:50.577145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a710477-2a44-44a0-a39c-f1c814374a3a admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:50.584308 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2567998-982d-4bdd-a9fc-78a20ea38041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:50.588012 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2567998-982d-4bdd-a9fc-78a20ea38041 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:50.588660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2567998-982d-4bdd-a9fc-78a20ea38041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:50.589094 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2567998-982d-4bdd-a9fc-78a20ea38041 admin admin] PATH_INFO: `/v3/projects/cdc4505b52714863b9bf8143c27f0a02/users/c4d7e361f048469aa63bcb2fac42ed83/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:50.641134 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2567998-982d-4bdd-a9fc-78a20ea38041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc4505b52714863b9bf8143c27f0a02, user_id=c4d7e361f048469aa63bcb2fac42ed83, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:50.645903 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2567998-982d-4bdd-a9fc-78a20ea38041 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:50.694060 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1071/2187] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:50 2022] PUT /identity/v3/projects/cdc4505b52714863b9bf8143c27f0a02/users/c4d7e361f048469aa63bcb2fac42ed83/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:50.717489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cb556-b29a-42ab-9317-9a101b37796e None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:50.717899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cb556-b29a-42ab-9317-9a101b37796e None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:50.718733 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cb556-b29a-42ab-9317-9a101b37796e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:50.765438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-8f0cb556-b29a-42ab-9317-9a101b37796e None None] MFA Rules not processed for user `c4d7e361f048469aa63bcb2fac42ed83`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:50.772712 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-8f0cb556-b29a-42ab-9317-9a101b37796e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:50.950020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1117/2188] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:50.959158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2567998-982d-4bdd-a9fc-78a20ea38041 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:50.962999 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a2567998-982d-4bdd-a9fc-78a20ea38041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:51.043025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2567998-982d-4bdd-a9fc-78a20ea38041 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:51.049464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fa00b-a775-4e9a-a8a5-b592f557c07d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:51.050374 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa00b-a775-4e9a-a8a5-b592f557c07d service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:51.050759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa00b-a775-4e9a-a8a5-b592f557c07d service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:51.051249 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa00b-a775-4e9a-a8a5-b592f557c07d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:51.063312 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fa00b-a775-4e9a-a8a5-b592f557c07d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:51.065361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fa00b-a775-4e9a-a8a5-b592f557c07d service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:51.081784 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1072/2189] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:52.662891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21db98-a446-4eb8-817b-445de2386008 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:52.663502 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21db98-a446-4eb8-817b-445de2386008 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:52.663702 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21db98-a446-4eb8-817b-445de2386008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:52.709862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-7f21db98-a446-4eb8-817b-445de2386008 None None] MFA Rules not processed for user `c4d7e361f048469aa63bcb2fac42ed83`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:52.711475 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-7f21db98-a446-4eb8-817b-445de2386008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:52.740732 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1118/2190] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:55.542395 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b9676-3289-471c-b221-ef92d4999a68 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:55.542911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b9676-3289-471c-b221-ef92d4999a68 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:55.542992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b9676-3289-471c-b221-ef92d4999a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:55.544402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21db98-a446-4eb8-817b-445de2386008 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:55.546877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-7f21db98-a446-4eb8-817b-445de2386008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:55.599385 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-bb6b9676-3289-471c-b221-ef92d4999a68 None None] MFA Rules not processed for user `b7eab96549924bfdb0213e1c8a200917`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:55.600874 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-bb6b9676-3289-471c-b221-ef92d4999a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:55.683388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21db98-a446-4eb8-817b-445de2386008 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:55.693357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869d850-63a8-495e-88b1-59ceefa5aa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:55.694621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869d850-63a8-495e-88b1-59ceefa5aa30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:55.695096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869d850-63a8-495e-88b1-59ceefa5aa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:55.695648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869d850-63a8-495e-88b1-59ceefa5aa30 admin admin] PATH_INFO: `/v3/users/74a5347974cf44bd87aa6deef79740e5` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:55.698396 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869d850-63a8-495e-88b1-59ceefa5aa30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a5347974cf44bd87aa6deef79740e5)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:55.700695 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869d850-63a8-495e-88b1-59ceefa5aa30 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:55.735029 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1073/2191] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:55.753646 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b9676-3289-471c-b221-ef92d4999a68 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:55.755777 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-bb6b9676-3289-471c-b221-ef92d4999a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:55.822529 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6869d850-63a8-495e-88b1-59ceefa5aa30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a5347974cf44bd87aa6deef79740e5'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:55.848781 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6869d850-63a8-495e-88b1-59ceefa5aa30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a5347974cf44bd87aa6deef79740e5'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:55.859764 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6869d850-63a8-495e-88b1-59ceefa5aa30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a5347974cf44bd87aa6deef79740e5'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:55.862675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6869d850-63a8-495e-88b1-59ceefa5aa30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a5347974cf44bd87aa6deef79740e5'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:55.885712 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6869d850-63a8-495e-88b1-59ceefa5aa30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a5347974cf44bd87aa6deef79740e5'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:55.906469 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1119/2192] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:55 2022] DELETE /identity/v3/users/74a5347974cf44bd87aa6deef79740e5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:55.923066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b9676-3289-471c-b221-ef92d4999a68 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:56.035241 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c1623-d06c-4b40-a097-e622d6120591 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d674fd1d6ab43ab982b66bb2349b625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:56.036022 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c1623-d06c-4b40-a097-e622d6120591 service glance] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:56.036329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c1623-d06c-4b40-a097-e622d6120591 service glance] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:56.036872 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c1623-d06c-4b40-a097-e622d6120591 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:56.043104 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b53c1623-d06c-4b40-a097-e622d6120591 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:56.218205 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c1623-d06c-4b40-a097-e622d6120591 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:56.219711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c1623-d06c-4b40-a097-e622d6120591 service glance] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:56.237383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1074/2193] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:01:56.536078 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0dc1d-5551-412e-9dab-6b0c02fcab86 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:56.536320 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0dc1d-5551-412e-9dab-6b0c02fcab86 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:56.539011 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0dc1d-5551-412e-9dab-6b0c02fcab86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:56.567194 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-4bb0dc1d-5551-412e-9dab-6b0c02fcab86 None None] MFA Rules not processed for user `df5dcdfb4eda417ebc0af2432497617d`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:56.568823 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-4bb0dc1d-5551-412e-9dab-6b0c02fcab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:56.685248 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1120/2194] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 14:01:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:01:56.745695 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c1623-d06c-4b40-a097-e622d6120591 service glance] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:56.747783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b53c1623-d06c-4b40-a097-e622d6120591 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:56.830725 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c1623-d06c-4b40-a097-e622d6120591 service glance] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:56.838992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b1c05-2a2b-48e4-9430-383cd669de89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd102155cd1bd4368ad272668da1651f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:56.839975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b1c05-2a2b-48e4-9430-383cd669de89 service swift] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:56.840238 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b1c05-2a2b-48e4-9430-383cd669de89 service swift] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:56.840753 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b1c05-2a2b-48e4-9430-383cd669de89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:56.850313 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b1c05-2a2b-48e4-9430-383cd669de89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:56.851926 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b1c05-2a2b-48e4-9430-383cd669de89 service swift] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:56.874700 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1075/2195] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 14:01:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:01:57.290934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0dc1d-5551-412e-9dab-6b0c02fcab86 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:57.292732 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-4bb0dc1d-5551-412e-9dab-6b0c02fcab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:57.435615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0dc1d-5551-412e-9dab-6b0c02fcab86 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:57.441936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521176b-0af7-4d19-9c7c-a511b9312f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:57.442944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521176b-0af7-4d19-9c7c-a511b9312f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:57.443233 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521176b-0af7-4d19-9c7c-a511b9312f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:57.443510 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521176b-0af7-4d19-9c7c-a511b9312f00 admin admin] PATH_INFO: `/v3/projects/f0a0817431534af8af0e991417947246` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:57.444804 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521176b-0af7-4d19-9c7c-a511b9312f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a0817431534af8af0e991417947246)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:57.447505 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521176b-0af7-4d19-9c7c-a511b9312f00 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:57.533867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b521176b-0af7-4d19-9c7c-a511b9312f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a0817431534af8af0e991417947246', 'request_id': 'req-b521176b-0af7-4d19-9c7c-a511b9312f00'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:57.544834 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b521176b-0af7-4d19-9c7c-a511b9312f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a0817431534af8af0e991417947246', 'request_id': 'req-b521176b-0af7-4d19-9c7c-a511b9312f00'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:57.551913 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b521176b-0af7-4d19-9c7c-a511b9312f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a0817431534af8af0e991417947246', 'request_id': 'req-b521176b-0af7-4d19-9c7c-a511b9312f00'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:57.565400 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b521176b-0af7-4d19-9c7c-a511b9312f00 admin admin] The token cache is being invalidate because project f0a0817431534af8af0e991417947246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:57.566011 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b521176b-0af7-4d19-9c7c-a511b9312f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:57.567045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b521176b-0af7-4d19-9c7c-a511b9312f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:57.573403 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1121/2196] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:57 2022] DELETE /identity/v3/projects/f0a0817431534af8af0e991417947246 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:57.577397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b1c05-2a2b-48e4-9430-383cd669de89 service swift] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:57.609152 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b1c05-2a2b-48e4-9430-383cd669de89 service swift] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:57.703045 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab746c88-4dec-4ccd-85a8-3349d68b8bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:57.704337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab746c88-4dec-4ccd-85a8-3349d68b8bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:57.704864 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab746c88-4dec-4ccd-85a8-3349d68b8bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:57.705327 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab746c88-4dec-4ccd-85a8-3349d68b8bdb admin admin] PATH_INFO: `/v3/users/a9be393faf68460f900ddcc1c8a5900a` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:57.706795 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab746c88-4dec-4ccd-85a8-3349d68b8bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9be393faf68460f900ddcc1c8a5900a)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:57.709330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab746c88-4dec-4ccd-85a8-3349d68b8bdb admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:57.833537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-ab746c88-4dec-4ccd-85a8-3349d68b8bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9be393faf68460f900ddcc1c8a5900a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:57.835452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-ab746c88-4dec-4ccd-85a8-3349d68b8bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9be393faf68460f900ddcc1c8a5900a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:57.856467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-ab746c88-4dec-4ccd-85a8-3349d68b8bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9be393faf68460f900ddcc1c8a5900a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:57.866766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-ab746c88-4dec-4ccd-85a8-3349d68b8bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9be393faf68460f900ddcc1c8a5900a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:57.868788 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-ab746c88-4dec-4ccd-85a8-3349d68b8bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9be393faf68460f900ddcc1c8a5900a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:57.886650 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1076/2197] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:01:57 2022] DELETE /identity/v3/users/a9be393faf68460f900ddcc1c8a5900a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:58.151396 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521176b-0af7-4d19-9c7c-a511b9312f00 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:58.154422 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b521176b-0af7-4d19-9c7c-a511b9312f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:58.184829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521176b-0af7-4d19-9c7c-a511b9312f00 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:58.366021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f702e2-df23-47b7-b30a-6fe55916ee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:58.366949 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f702e2-df23-47b7-b30a-6fe55916ee66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:58.367228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f702e2-df23-47b7-b30a-6fe55916ee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:58.367681 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f702e2-df23-47b7-b30a-6fe55916ee66 admin admin] PATH_INFO: `/v3/projects/80407d5686164cecb1e91a039e1d8c9f` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:58.369364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f702e2-df23-47b7-b30a-6fe55916ee66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80407d5686164cecb1e91a039e1d8c9f)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:58.371287 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f702e2-df23-47b7-b30a-6fe55916ee66 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:58.507320 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-f1f702e2-df23-47b7-b30a-6fe55916ee66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80407d5686164cecb1e91a039e1d8c9f', 'request_id': 'req-f1f702e2-df23-47b7-b30a-6fe55916ee66'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:58.553069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-f1f702e2-df23-47b7-b30a-6fe55916ee66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80407d5686164cecb1e91a039e1d8c9f', 'request_id': 'req-f1f702e2-df23-47b7-b30a-6fe55916ee66'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:58.563025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-f1f702e2-df23-47b7-b30a-6fe55916ee66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80407d5686164cecb1e91a039e1d8c9f', 'request_id': 'req-f1f702e2-df23-47b7-b30a-6fe55916ee66'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:58.627615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-f1f702e2-df23-47b7-b30a-6fe55916ee66 admin admin] The token cache is being invalidate because project 80407d5686164cecb1e91a039e1d8c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:01:58.628347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-f1f702e2-df23-47b7-b30a-6fe55916ee66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:58.632680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-f1f702e2-df23-47b7-b30a-6fe55916ee66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:01:58.637745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1122/2198] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:01:58 2022] DELETE /identity/v3/projects/80407d5686164cecb1e91a039e1d8c9f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:01:58.639781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca61cd-ec15-4fb7-b065-78cfe479dc3b None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:58.640148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca61cd-ec15-4fb7-b065-78cfe479dc3b None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:58.640528 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca61cd-ec15-4fb7-b065-78cfe479dc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:58.697149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-14ca61cd-ec15-4fb7-b065-78cfe479dc3b None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:58.705110 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-14ca61cd-ec15-4fb7-b065-78cfe479dc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:58.814235 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1077/2199] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:58.823161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6930cf3-fcc1-4555-9988-8582db2a57e9 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:58.823460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6930cf3-fcc1-4555-9988-8582db2a57e9 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:58.823727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6930cf3-fcc1-4555-9988-8582db2a57e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:58.858519 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f6930cf3-fcc1-4555-9988-8582db2a57e9 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:58.860855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f6930cf3-fcc1-4555-9988-8582db2a57e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:58.891814 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1123/2200] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:58.895911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca61cd-ec15-4fb7-b065-78cfe479dc3b None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:58.910454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca61cd-ec15-4fb7-b065-78cfe479dc3b None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:58.918466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042747e-e602-45dc-81db-58f1d2c5502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:58.919832 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042747e-e602-45dc-81db-58f1d2c5502c admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:58.920380 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042747e-e602-45dc-81db-58f1d2c5502c admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:58.921441 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042747e-e602-45dc-81db-58f1d2c5502c admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:58.922765 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042747e-e602-45dc-81db-58f1d2c5502c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:01:58.923292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042747e-e602-45dc-81db-58f1d2c5502c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:58.925679 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042747e-e602-45dc-81db-58f1d2c5502c admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:58.957160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1078/2201] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:01:58.961484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6930cf3-fcc1-4555-9988-8582db2a57e9 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:58.972541 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6930cf3-fcc1-4555-9988-8582db2a57e9 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:58.992008 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282970d7-b0e1-48f1-b63c-51d6fd2f098f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:59.006128 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282970d7-b0e1-48f1-b63c-51d6fd2f098f admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:59.007595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282970d7-b0e1-48f1-b63c-51d6fd2f098f admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:59.008220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282970d7-b0e1-48f1-b63c-51d6fd2f098f admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:59.019022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282970d7-b0e1-48f1-b63c-51d6fd2f098f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:59.021363 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282970d7-b0e1-48f1-b63c-51d6fd2f098f admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:59.103760 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1124/2202] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:01:58 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:59.104888 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042747e-e602-45dc-81db-58f1d2c5502c admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:59.115978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042747e-e602-45dc-81db-58f1d2c5502c admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:59.307984 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0d87a-a7ec-4091-bfaf-8b5f5ee8235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:59.309326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0d87a-a7ec-4091-bfaf-8b5f5ee8235f admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:59.309584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0d87a-a7ec-4091-bfaf-8b5f5ee8235f admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:59.309856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0d87a-a7ec-4091-bfaf-8b5f5ee8235f admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:59.310563 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0d87a-a7ec-4091-bfaf-8b5f5ee8235f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:59.320983 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0d87a-a7ec-4091-bfaf-8b5f5ee8235f admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:59.429944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282970d7-b0e1-48f1-b63c-51d6fd2f098f admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:59.441057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1079/2203] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:01:59 2022] POST /identity/v3/users => generated 288 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:01:59.445044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282970d7-b0e1-48f1-b63c-51d6fd2f098f admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:59.452235 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38766d2-ca77-4dff-a80e-23d6a1822459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:59.453370 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38766d2-ca77-4dff-a80e-23d6a1822459 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:59.453855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38766d2-ca77-4dff-a80e-23d6a1822459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:59.454333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38766d2-ca77-4dff-a80e-23d6a1822459 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:59.455275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38766d2-ca77-4dff-a80e-23d6a1822459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:59.457109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38766d2-ca77-4dff-a80e-23d6a1822459 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:59.478148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0d87a-a7ec-4091-bfaf-8b5f5ee8235f admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:59.479184 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1125/2204] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:59.490824 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0d87a-a7ec-4091-bfaf-8b5f5ee8235f admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:59.496650 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46335c57-2a97-48d9-aa38-7695f2c6664e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:59.497794 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46335c57-2a97-48d9-aa38-7695f2c6664e admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:59.498144 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46335c57-2a97-48d9-aa38-7695f2c6664e admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:59.498482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46335c57-2a97-48d9-aa38-7695f2c6664e admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:59.499760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46335c57-2a97-48d9-aa38-7695f2c6664e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:59.501893 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46335c57-2a97-48d9-aa38-7695f2c6664e admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:59.528713 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38766d2-ca77-4dff-a80e-23d6a1822459 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:59.544047 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1080/2205] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:01:59.546170 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38766d2-ca77-4dff-a80e-23d6a1822459 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:59.552371 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1d67b-d1bd-4a60-b7f8-0a7f88ab8be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:59.553611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1d67b-d1bd-4a60-b7f8-0a7f88ab8be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:59.554116 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1d67b-d1bd-4a60-b7f8-0a7f88ab8be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:59.554601 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1d67b-d1bd-4a60-b7f8-0a7f88ab8be0 admin admin] PATH_INFO: `/v3/projects/e1b76194a5e64675997483f5acdfe6aa/users/dd1fe41bb9bf4e37ac3bfdc854d4c167/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:59.594371 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1d67b-d1bd-4a60-b7f8-0a7f88ab8be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b76194a5e64675997483f5acdfe6aa, user_id=dd1fe41bb9bf4e37ac3bfdc854d4c167, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:59.598200 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1d67b-d1bd-4a60-b7f8-0a7f88ab8be0 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:01:59.623457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1126/2206] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:01:59 2022] PUT /identity/v3/projects/e1b76194a5e64675997483f5acdfe6aa/users/dd1fe41bb9bf4e37ac3bfdc854d4c167/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:01:59.635281 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dceb37-63c8-4466-a45f-6524f8811fd1 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:59.635641 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dceb37-63c8-4466-a45f-6524f8811fd1 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:59.635989 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dceb37-63c8-4466-a45f-6524f8811fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:59.673590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-39dceb37-63c8-4466-a45f-6524f8811fd1 None None] MFA Rules not processed for user `dd1fe41bb9bf4e37ac3bfdc854d4c167`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:01:59.675511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-39dceb37-63c8-4466-a45f-6524f8811fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:59.812797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1081/2207] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:01:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:01:59.820982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1d67b-d1bd-4a60-b7f8-0a7f88ab8be0 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:01:59.824814 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a5c1d67b-d1bd-4a60-b7f8-0a7f88ab8be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:01:59.972819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1d67b-d1bd-4a60-b7f8-0a7f88ab8be0 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:01:59.979217 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f851e3e-c265-494c-ac7c-cc25c75ced00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:01:59.979970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f851e3e-c265-494c-ac7c-cc25c75ced00 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:01:59.980348 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f851e3e-c265-494c-ac7c-cc25c75ced00 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:01:59.980698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f851e3e-c265-494c-ac7c-cc25c75ced00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:01:59.993847 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f851e3e-c265-494c-ac7c-cc25c75ced00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:01:59.996354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f851e3e-c265-494c-ac7c-cc25c75ced00 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:00.012894 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1127/2208] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:01:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:03.709169 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dceb37-63c8-4466-a45f-6524f8811fd1 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:03.910722 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dceb37-63c8-4466-a45f-6524f8811fd1 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:03.916270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99d803-90f0-40f3-88d0-0c4e012871df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:03.917377 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99d803-90f0-40f3-88d0-0c4e012871df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:03.918001 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99d803-90f0-40f3-88d0-0c4e012871df admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:03.918440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99d803-90f0-40f3-88d0-0c4e012871df admin admin] PATH_INFO: `/v3/users/dd1fe41bb9bf4e37ac3bfdc854d4c167` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:03.920477 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99d803-90f0-40f3-88d0-0c4e012871df admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd1fe41bb9bf4e37ac3bfdc854d4c167)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:03.922645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99d803-90f0-40f3-88d0-0c4e012871df admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:04.000876 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-bc99d803-90f0-40f3-88d0-0c4e012871df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd1fe41bb9bf4e37ac3bfdc854d4c167'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:04.001955 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-bc99d803-90f0-40f3-88d0-0c4e012871df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd1fe41bb9bf4e37ac3bfdc854d4c167'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:04.019153 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-bc99d803-90f0-40f3-88d0-0c4e012871df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd1fe41bb9bf4e37ac3bfdc854d4c167'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:04.033830 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-bc99d803-90f0-40f3-88d0-0c4e012871df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd1fe41bb9bf4e37ac3bfdc854d4c167'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:04.034465 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-bc99d803-90f0-40f3-88d0-0c4e012871df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd1fe41bb9bf4e37ac3bfdc854d4c167'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:04.063335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1082/2209] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:02:03 2022] DELETE /identity/v3/users/dd1fe41bb9bf4e37ac3bfdc854d4c167 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:04.064837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc9d2e-7bdd-48a2-833e-dacb26efe880 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:04.065640 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc9d2e-7bdd-48a2-833e-dacb26efe880 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:04.066079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc9d2e-7bdd-48a2-833e-dacb26efe880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:04.097955 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9f83-86a1-4e29-b6c6-f665d67537d0 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:04.098417 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9f83-86a1-4e29-b6c6-f665d67537d0 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:04.098863 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9f83-86a1-4e29-b6c6-f665d67537d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:04.126803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-c20d9f83-86a1-4e29-b6c6-f665d67537d0 None None] MFA Rules not processed for user `9d87a4de3fbf4cbb9e21523634007629`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:04.129778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-c20d9f83-86a1-4e29-b6c6-f665d67537d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:04.156686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-dfbc9d2e-7bdd-48a2-833e-dacb26efe880 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:04.158515 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-dfbc9d2e-7bdd-48a2-833e-dacb26efe880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:04.216276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1083/2210] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:02:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:04.235836 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1128/2211] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:02:04.247044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d9f83-86a1-4e29-b6c6-f665d67537d0 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:04.248710 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-c20d9f83-86a1-4e29-b6c6-f665d67537d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:04.404015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d9f83-86a1-4e29-b6c6-f665d67537d0 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:04.409416 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b062e3-9c67-459c-8372-707baf649c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:04.410325 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b062e3-9c67-459c-8372-707baf649c13 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:04.410750 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b062e3-9c67-459c-8372-707baf649c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:04.411193 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b062e3-9c67-459c-8372-707baf649c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:04.423343 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b062e3-9c67-459c-8372-707baf649c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:04.425408 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b062e3-9c67-459c-8372-707baf649c13 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:04.450410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1084/2212] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:02:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:05.123950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc9d2e-7bdd-48a2-833e-dacb26efe880 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:05.126288 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-dfbc9d2e-7bdd-48a2-833e-dacb26efe880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:05.161036 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc9d2e-7bdd-48a2-833e-dacb26efe880 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:05.184754 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a757dd9-56e5-41e7-926e-45522646b089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:05.187858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a757dd9-56e5-41e7-926e-45522646b089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:05.188416 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a757dd9-56e5-41e7-926e-45522646b089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:05.189123 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a757dd9-56e5-41e7-926e-45522646b089 admin admin] PATH_INFO: `/v3/projects/e1b76194a5e64675997483f5acdfe6aa` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:05.197673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a757dd9-56e5-41e7-926e-45522646b089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b76194a5e64675997483f5acdfe6aa)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:05.206821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a757dd9-56e5-41e7-926e-45522646b089 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:05.410629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8a757dd9-56e5-41e7-926e-45522646b089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b76194a5e64675997483f5acdfe6aa', 'request_id': 'req-8a757dd9-56e5-41e7-926e-45522646b089'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:05.437020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8a757dd9-56e5-41e7-926e-45522646b089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b76194a5e64675997483f5acdfe6aa', 'request_id': 'req-8a757dd9-56e5-41e7-926e-45522646b089'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:05.450528 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8a757dd9-56e5-41e7-926e-45522646b089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b76194a5e64675997483f5acdfe6aa', 'request_id': 'req-8a757dd9-56e5-41e7-926e-45522646b089'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:05.496658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8a757dd9-56e5-41e7-926e-45522646b089 admin admin] The token cache is being invalidate because project e1b76194a5e64675997483f5acdfe6aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:05.500555 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8a757dd9-56e5-41e7-926e-45522646b089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:05.503085 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8a757dd9-56e5-41e7-926e-45522646b089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:05.509789 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1129/2213] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:02:05 2022] DELETE /identity/v3/projects/e1b76194a5e64675997483f5acdfe6aa => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:05.514906 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0a71b-28f1-4404-8f77-02417d3c45b3 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:05.521276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0a71b-28f1-4404-8f77-02417d3c45b3 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:05.521558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0a71b-28f1-4404-8f77-02417d3c45b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:05.637708 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-acc0a71b-28f1-4404-8f77-02417d3c45b3 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:05.639157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-acc0a71b-28f1-4404-8f77-02417d3c45b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:05.875998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1085/2214] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:05.884585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928ba4b-3f2e-4381-9510-31cbd5698356 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:05.885437 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928ba4b-3f2e-4381-9510-31cbd5698356 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:05.885950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928ba4b-3f2e-4381-9510-31cbd5698356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:05.978471 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-a928ba4b-3f2e-4381-9510-31cbd5698356 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:05.983148 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a928ba4b-3f2e-4381-9510-31cbd5698356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:06.000673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1130/2215] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:06.005873 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0a71b-28f1-4404-8f77-02417d3c45b3 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:06.018622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0a71b-28f1-4404-8f77-02417d3c45b3 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:06.040910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc13f3a-74d3-4816-951a-68e55e1de8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:06.041580 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc13f3a-74d3-4816-951a-68e55e1de8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:06.041856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc13f3a-74d3-4816-951a-68e55e1de8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:06.042126 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc13f3a-74d3-4816-951a-68e55e1de8b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:06.042972 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc13f3a-74d3-4816-951a-68e55e1de8b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:02:06.043218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc13f3a-74d3-4816-951a-68e55e1de8b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:06.046927 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc13f3a-74d3-4816-951a-68e55e1de8b6 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:06.080796 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1086/2216] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:02:06.084967 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928ba4b-3f2e-4381-9510-31cbd5698356 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:06.103667 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928ba4b-3f2e-4381-9510-31cbd5698356 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:06.112478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c551d7d-73fe-4b71-aa56-ea12181df85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:06.113467 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c551d7d-73fe-4b71-aa56-ea12181df85a admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:06.113748 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c551d7d-73fe-4b71-aa56-ea12181df85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:06.114023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c551d7d-73fe-4b71-aa56-ea12181df85a admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:06.114786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c551d7d-73fe-4b71-aa56-ea12181df85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:06.119281 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c551d7d-73fe-4b71-aa56-ea12181df85a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:06.179590 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1131/2217] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:02:06 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:02:06.183657 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc13f3a-74d3-4816-951a-68e55e1de8b6 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:06.195839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc13f3a-74d3-4816-951a-68e55e1de8b6 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:06.315895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11585727-5ae7-4659-9f65-627df675f824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:06.317044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11585727-5ae7-4659-9f65-627df675f824 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:06.317510 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11585727-5ae7-4659-9f65-627df675f824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:06.317936 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11585727-5ae7-4659-9f65-627df675f824 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:06.318779 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11585727-5ae7-4659-9f65-627df675f824 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:06.321964 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11585727-5ae7-4659-9f65-627df675f824 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:06.376681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1087/2218] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:02:06 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:06.377000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c551d7d-73fe-4b71-aa56-ea12181df85a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:06.407577 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c551d7d-73fe-4b71-aa56-ea12181df85a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:06.429067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f818f6-d063-4af4-af08-a06960a81e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:06.429757 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f818f6-d063-4af4-af08-a06960a81e4c admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:06.438861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f818f6-d063-4af4-af08-a06960a81e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:06.439142 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f818f6-d063-4af4-af08-a06960a81e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:06.440936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f818f6-d063-4af4-af08-a06960a81e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:06.442740 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f818f6-d063-4af4-af08-a06960a81e4c admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:06.479943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1132/2219] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:06.484550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11585727-5ae7-4659-9f65-627df675f824 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:06.519579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11585727-5ae7-4659-9f65-627df675f824 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:06.526897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffc9af-cd5a-4af4-b6fa-dfbac2cfb728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:06.528216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffc9af-cd5a-4af4-b6fa-dfbac2cfb728 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:06.528804 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffc9af-cd5a-4af4-b6fa-dfbac2cfb728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:06.529288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffc9af-cd5a-4af4-b6fa-dfbac2cfb728 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:06.535858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffc9af-cd5a-4af4-b6fa-dfbac2cfb728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:06.538447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffc9af-cd5a-4af4-b6fa-dfbac2cfb728 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:06.554381 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1088/2220] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:06.559077 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f818f6-d063-4af4-af08-a06960a81e4c admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:06.570012 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f818f6-d063-4af4-af08-a06960a81e4c admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:06.582130 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb65cc-6ad7-4e8c-a876-52589766e5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:06.583385 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb65cc-6ad7-4e8c-a876-52589766e5d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:06.583868 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb65cc-6ad7-4e8c-a876-52589766e5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:06.584394 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb65cc-6ad7-4e8c-a876-52589766e5d2 admin admin] PATH_INFO: `/v3/projects/336feb33c57c489dbefe6a22b6a2557e/users/f74fb6ef9c78469aa1c730d9ca5b321e/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:06.600286 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb65cc-6ad7-4e8c-a876-52589766e5d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=336feb33c57c489dbefe6a22b6a2557e, user_id=f74fb6ef9c78469aa1c730d9ca5b321e, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:06.603861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb65cc-6ad7-4e8c-a876-52589766e5d2 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:06.637518 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1133/2221] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:02:06 2022] PUT /identity/v3/projects/336feb33c57c489dbefe6a22b6a2557e/users/f74fb6ef9c78469aa1c730d9ca5b321e/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:06.651953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac95e0-6d2b-4488-acb0-bb677d6c4e1d None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:06.653460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac95e0-6d2b-4488-acb0-bb677d6c4e1d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:06.653909 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac95e0-6d2b-4488-acb0-bb677d6c4e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:06.690406 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-bdac95e0-6d2b-4488-acb0-bb677d6c4e1d None None] MFA Rules not processed for user `f74fb6ef9c78469aa1c730d9ca5b321e`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:06.692020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-bdac95e0-6d2b-4488-acb0-bb677d6c4e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:06.818845 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1089/2222] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:02:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:06.842636 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb65cc-6ad7-4e8c-a876-52589766e5d2 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:06.844911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-dfeb65cc-6ad7-4e8c-a876-52589766e5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:06.926237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb65cc-6ad7-4e8c-a876-52589766e5d2 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:06.932005 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79bdba-503f-42a1-b68f-260af468d0a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:06.932727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79bdba-503f-42a1-b68f-260af468d0a3 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:06.933073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79bdba-503f-42a1-b68f-260af468d0a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:06.933414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79bdba-503f-42a1-b68f-260af468d0a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:06.947495 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79bdba-503f-42a1-b68f-260af468d0a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:06.950484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79bdba-503f-42a1-b68f-260af468d0a3 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:06.970579 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1134/2223] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:02:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:07.609616 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d512ed-950c-450e-981a-f5cba61d75ac None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:07.610209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d512ed-950c-450e-981a-f5cba61d75ac None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:07.610209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d512ed-950c-450e-981a-f5cba61d75ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:07.655876 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-77d512ed-950c-450e-981a-f5cba61d75ac None None] MFA Rules not processed for user `8c563c6a229b4e619992ccfb0da1a748`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:07.657563 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-77d512ed-950c-450e-981a-f5cba61d75ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:07.785667 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1090/2224] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:02:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:10.132005 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79bdba-503f-42a1-b68f-260af468d0a3 service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:10.291856 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79bdba-503f-42a1-b68f-260af468d0a3 service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:10.310490 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02262d30-31af-4c1c-bab6-db7b0b8c5f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:10.311376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02262d30-31af-4c1c-bab6-db7b0b8c5f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:10.311647 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02262d30-31af-4c1c-bab6-db7b0b8c5f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:10.311916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02262d30-31af-4c1c-bab6-db7b0b8c5f63 admin admin] PATH_INFO: `/v3/users/f74fb6ef9c78469aa1c730d9ca5b321e` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:10.321020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02262d30-31af-4c1c-bab6-db7b0b8c5f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74fb6ef9c78469aa1c730d9ca5b321e)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:10.322967 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02262d30-31af-4c1c-bab6-db7b0b8c5f63 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:10.412859 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-02262d30-31af-4c1c-bab6-db7b0b8c5f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74fb6ef9c78469aa1c730d9ca5b321e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.431628 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-02262d30-31af-4c1c-bab6-db7b0b8c5f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74fb6ef9c78469aa1c730d9ca5b321e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.447363 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-02262d30-31af-4c1c-bab6-db7b0b8c5f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74fb6ef9c78469aa1c730d9ca5b321e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.448739 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-02262d30-31af-4c1c-bab6-db7b0b8c5f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74fb6ef9c78469aa1c730d9ca5b321e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.459506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-02262d30-31af-4c1c-bab6-db7b0b8c5f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74fb6ef9c78469aa1c730d9ca5b321e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:10.473656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1135/2225] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:02:10 2022] DELETE /identity/v3/users/f74fb6ef9c78469aa1c730d9ca5b321e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:10.478264 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaa9c2-bebf-43e5-abbd-33b4cdbb8566 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:10.479094 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaa9c2-bebf-43e5-abbd-33b4cdbb8566 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:10.483149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaa9c2-bebf-43e5-abbd-33b4cdbb8566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:10.533903 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-03aaa9c2-bebf-43e5-abbd-33b4cdbb8566 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:10.535310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-03aaa9c2-bebf-43e5-abbd-33b4cdbb8566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:10.675304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1091/2226] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:10.687805 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02262d30-31af-4c1c-bab6-db7b0b8c5f63 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:10.689278 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-02262d30-31af-4c1c-bab6-db7b0b8c5f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:10.772956 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02262d30-31af-4c1c-bab6-db7b0b8c5f63 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:10.777517 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee497876-2e39-4b6e-877f-b014916ef0a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:10.778649 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee497876-2e39-4b6e-877f-b014916ef0a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:10.779261 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee497876-2e39-4b6e-877f-b014916ef0a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:10.779631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee497876-2e39-4b6e-877f-b014916ef0a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:10.789967 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee497876-2e39-4b6e-877f-b014916ef0a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:10.791513 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee497876-2e39-4b6e-877f-b014916ef0a9 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:10.803462 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1136/2227] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:11.431480 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aaa9c2-bebf-43e5-abbd-33b4cdbb8566 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:11.432937 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-03aaa9c2-bebf-43e5-abbd-33b4cdbb8566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:11.452780 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aaa9c2-bebf-43e5-abbd-33b4cdbb8566 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:11.468438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1d3ca-c070-4794-ba48-a7b9061481a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:11.470291 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1d3ca-c070-4794-ba48-a7b9061481a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:11.470742 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1d3ca-c070-4794-ba48-a7b9061481a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:11.471166 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1d3ca-c070-4794-ba48-a7b9061481a0 admin admin] PATH_INFO: `/v3/projects/336feb33c57c489dbefe6a22b6a2557e` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:11.473003 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1d3ca-c070-4794-ba48-a7b9061481a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=336feb33c57c489dbefe6a22b6a2557e)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:11.475201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1d3ca-c070-4794-ba48-a7b9061481a0 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:11.627317 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-5ec1d3ca-c070-4794-ba48-a7b9061481a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '336feb33c57c489dbefe6a22b6a2557e', 'request_id': 'req-5ec1d3ca-c070-4794-ba48-a7b9061481a0'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:11.637377 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-5ec1d3ca-c070-4794-ba48-a7b9061481a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '336feb33c57c489dbefe6a22b6a2557e', 'request_id': 'req-5ec1d3ca-c070-4794-ba48-a7b9061481a0'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:11.644653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-5ec1d3ca-c070-4794-ba48-a7b9061481a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '336feb33c57c489dbefe6a22b6a2557e', 'request_id': 'req-5ec1d3ca-c070-4794-ba48-a7b9061481a0'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:11.680692 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-5ec1d3ca-c070-4794-ba48-a7b9061481a0 admin admin] The token cache is being invalidate because project 336feb33c57c489dbefe6a22b6a2557e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:11.681569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-5ec1d3ca-c070-4794-ba48-a7b9061481a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:11.682566 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-5ec1d3ca-c070-4794-ba48-a7b9061481a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:11.687887 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1092/2228] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:02:11 2022] DELETE /identity/v3/projects/336feb33c57c489dbefe6a22b6a2557e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:11.698349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9099e3c-2e1e-48c3-90d4-d1d6d46cb601 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:11.699242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9099e3c-2e1e-48c3-90d4-d1d6d46cb601 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:11.699656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9099e3c-2e1e-48c3-90d4-d1d6d46cb601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:11.736217 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-e9099e3c-2e1e-48c3-90d4-d1d6d46cb601 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:11.737755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e9099e3c-2e1e-48c3-90d4-d1d6d46cb601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:11.945644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1137/2229] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:11.953061 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7db59a-e36f-4cc2-ba2b-0d37df4df6ca None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:11.953335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7db59a-e36f-4cc2-ba2b-0d37df4df6ca None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:11.954089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7db59a-e36f-4cc2-ba2b-0d37df4df6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:11.987977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-5b7db59a-e36f-4cc2-ba2b-0d37df4df6ca None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:11.995433 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-5b7db59a-e36f-4cc2-ba2b-0d37df4df6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:12.036341 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9099e3c-2e1e-48c3-90d4-d1d6d46cb601 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.037251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1093/2230] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:12.056706 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9099e3c-2e1e-48c3-90d4-d1d6d46cb601 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.095898 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ad7fa-52b6-4c65-9a29-08175022372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.096716 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ad7fa-52b6-4c65-9a29-08175022372a admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.097062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ad7fa-52b6-4c65-9a29-08175022372a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.097412 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ad7fa-52b6-4c65-9a29-08175022372a admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.098387 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ad7fa-52b6-4c65-9a29-08175022372a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:02:12.098761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ad7fa-52b6-4c65-9a29-08175022372a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.100569 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ad7fa-52b6-4c65-9a29-08175022372a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.127238 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1138/2231] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:02:12.127467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7db59a-e36f-4cc2-ba2b-0d37df4df6ca None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.184684 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7db59a-e36f-4cc2-ba2b-0d37df4df6ca None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.196887 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70e5d7-cf84-4420-b063-cb114992dc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.197566 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70e5d7-cf84-4420-b063-cb114992dc96 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.197848 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70e5d7-cf84-4420-b063-cb114992dc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.198120 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70e5d7-cf84-4420-b063-cb114992dc96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.203005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70e5d7-cf84-4420-b063-cb114992dc96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.203005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70e5d7-cf84-4420-b063-cb114992dc96 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.316609 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1094/2232] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:02:12 2022] POST /identity/v3/projects => generated 399 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:12.317273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ad7fa-52b6-4c65-9a29-08175022372a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.327926 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ad7fa-52b6-4c65-9a29-08175022372a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.431435 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850269d-4f42-412c-a361-6f06a1e9f729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.432206 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850269d-4f42-412c-a361-6f06a1e9f729 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.432750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850269d-4f42-412c-a361-6f06a1e9f729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.433100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850269d-4f42-412c-a361-6f06a1e9f729 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.434644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850269d-4f42-412c-a361-6f06a1e9f729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.440135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850269d-4f42-412c-a361-6f06a1e9f729 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.509261 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1139/2233] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:02:12 2022] POST /identity/v3/users => generated 300 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:02:12.512967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70e5d7-cf84-4420-b063-cb114992dc96 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.527327 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70e5d7-cf84-4420-b063-cb114992dc96 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.539899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae2cf2-94ba-468d-8a67-ee831c63b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.540900 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae2cf2-94ba-468d-8a67-ee831c63b7ba admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.541348 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae2cf2-94ba-468d-8a67-ee831c63b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.541775 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae2cf2-94ba-468d-8a67-ee831c63b7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.542668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae2cf2-94ba-468d-8a67-ee831c63b7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.544303 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae2cf2-94ba-468d-8a67-ee831c63b7ba admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.571138 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1095/2234] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:12.575340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850269d-4f42-412c-a361-6f06a1e9f729 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.597186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850269d-4f42-412c-a361-6f06a1e9f729 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.604851 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908f902-6842-4a24-8ceb-16263699d2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.605597 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908f902-6842-4a24-8ceb-16263699d2db admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.605954 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908f902-6842-4a24-8ceb-16263699d2db admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.606297 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908f902-6842-4a24-8ceb-16263699d2db admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.607108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908f902-6842-4a24-8ceb-16263699d2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.608804 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908f902-6842-4a24-8ceb-16263699d2db admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.625837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1140/2235] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:02:12.630022 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae2cf2-94ba-468d-8a67-ee831c63b7ba admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.642435 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae2cf2-94ba-468d-8a67-ee831c63b7ba admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.653511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c5257-87cf-40af-aad7-00818a864858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.654409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c5257-87cf-40af-aad7-00818a864858 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.654687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c5257-87cf-40af-aad7-00818a864858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.654960 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c5257-87cf-40af-aad7-00818a864858 admin admin] PATH_INFO: `/v3/projects/c2f6d085a48d4a75a69d320c4b953903/users/e47604632e0f45009cde22d1656ec7cb/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.676891 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c5257-87cf-40af-aad7-00818a864858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f6d085a48d4a75a69d320c4b953903, user_id=e47604632e0f45009cde22d1656ec7cb, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.680609 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c5257-87cf-40af-aad7-00818a864858 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.696560 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1096/2236] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:02:12 2022] PUT /identity/v3/projects/c2f6d085a48d4a75a69d320c4b953903/users/e47604632e0f45009cde22d1656ec7cb/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:12.708378 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d2adf-f87e-480b-853c-789e6d3bc382 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.708921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d2adf-f87e-480b-853c-789e6d3bc382 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.709024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d2adf-f87e-480b-853c-789e6d3bc382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.736795 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-3e5d2adf-f87e-480b-853c-789e6d3bc382 None None] MFA Rules not processed for user `e47604632e0f45009cde22d1656ec7cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:12.738375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-3e5d2adf-f87e-480b-853c-789e6d3bc382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:12.812609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1141/2237] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:02:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:12.824940 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c5257-87cf-40af-aad7-00818a864858 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:12.826655 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-673c5257-87cf-40af-aad7-00818a864858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:12.898901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c5257-87cf-40af-aad7-00818a864858 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:12.908814 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3b333-c65f-480e-9488-80433975d4bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:12.911157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3b333-c65f-480e-9488-80433975d4bf service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:12.911370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3b333-c65f-480e-9488-80433975d4bf service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:12.911756 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3b333-c65f-480e-9488-80433975d4bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:12.926307 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3b333-c65f-480e-9488-80433975d4bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:12.928056 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3b333-c65f-480e-9488-80433975d4bf service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:12.941404 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1097/2238] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:02:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:13.178657 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c72742-9aa1-438a-bd4f-21942cc6bed1 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:13.178943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c72742-9aa1-438a-bd4f-21942cc6bed1 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:13.179221 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c72742-9aa1-438a-bd4f-21942cc6bed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:13.197036 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-25c72742-9aa1-438a-bd4f-21942cc6bed1 None None] MFA Rules not processed for user `c4f57917c86244c2baecd9d795c502c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:13.198212 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-25c72742-9aa1-438a-bd4f-21942cc6bed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:13.272706 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1142/2239] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:02:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:20.079247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3b333-c65f-480e-9488-80433975d4bf service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:20.214440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cab68-9ef8-4ae6-854d-7c7149b5955f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.215437 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cab68-9ef8-4ae6-854d-7c7149b5955f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.215926 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cab68-9ef8-4ae6-854d-7c7149b5955f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.256729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3b333-c65f-480e-9488-80433975d4bf service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:20.267921 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07eaa6-9238-4d47-a0e9-39718f825e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:20.268917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07eaa6-9238-4d47-a0e9-39718f825e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.269255 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07eaa6-9238-4d47-a0e9-39718f825e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.270054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07eaa6-9238-4d47-a0e9-39718f825e34 admin admin] PATH_INFO: `/v3/users/e47604632e0f45009cde22d1656ec7cb` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.271094 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07eaa6-9238-4d47-a0e9-39718f825e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e47604632e0f45009cde22d1656ec7cb)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:20.276887 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07eaa6-9238-4d47-a0e9-39718f825e34 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:20.337675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f30cab68-9ef8-4ae6-854d-7c7149b5955f None None] MFA Rules not processed for user `df5dcdfb4eda417ebc0af2432497617d`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:20.340895 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f30cab68-9ef8-4ae6-854d-7c7149b5955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:20.368305 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-7f07eaa6-9238-4d47-a0e9-39718f825e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e47604632e0f45009cde22d1656ec7cb'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.370386 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-7f07eaa6-9238-4d47-a0e9-39718f825e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e47604632e0f45009cde22d1656ec7cb'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.402946 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-7f07eaa6-9238-4d47-a0e9-39718f825e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e47604632e0f45009cde22d1656ec7cb'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.415623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-7f07eaa6-9238-4d47-a0e9-39718f825e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e47604632e0f45009cde22d1656ec7cb'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.416652 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-7f07eaa6-9238-4d47-a0e9-39718f825e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e47604632e0f45009cde22d1656ec7cb'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:20.438321 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1098/2240] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:02:20 2022] DELETE /identity/v3/users/e47604632e0f45009cde22d1656ec7cb => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:20.440791 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1a214-9cc8-4f79-ae3f-b4adea346bab None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.441268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1a214-9cc8-4f79-ae3f-b4adea346bab None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.441688 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1a214-9cc8-4f79-ae3f-b4adea346bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.460266 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1143/2241] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 14:02:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 10 14:02:20.474866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-e0c1a214-9cc8-4f79-ae3f-b4adea346bab None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:20.477302 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-e0c1a214-9cc8-4f79-ae3f-b4adea346bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:20.485728 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cab68-9ef8-4ae6-854d-7c7149b5955f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:20.490875 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f30cab68-9ef8-4ae6-854d-7c7149b5955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:20.572148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1099/2242] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:20.590047 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1a214-9cc8-4f79-ae3f-b4adea346bab None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:20.592545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-e0c1a214-9cc8-4f79-ae3f-b4adea346bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:20.611217 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cab68-9ef8-4ae6-854d-7c7149b5955f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:20.698564 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1a214-9cc8-4f79-ae3f-b4adea346bab None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:20.716235 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d89c26-7675-4ec8-aa1c-fd7c2bee6133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:20.716894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d89c26-7675-4ec8-aa1c-fd7c2bee6133 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.717173 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d89c26-7675-4ec8-aa1c-fd7c2bee6133 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.717449 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d89c26-7675-4ec8-aa1c-fd7c2bee6133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.718189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b8c22-3742-40fd-8686-94ddfe7110b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd102155cd1bd4368ad272668da1651f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:20.720060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b8c22-3742-40fd-8686-94ddfe7110b4 service swift] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:20.720060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b8c22-3742-40fd-8686-94ddfe7110b4 service swift] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:20.720467 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b8c22-3742-40fd-8686-94ddfe7110b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:20.740425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d89c26-7675-4ec8-aa1c-fd7c2bee6133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:20.742296 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d89c26-7675-4ec8-aa1c-fd7c2bee6133 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:20.763342 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1100/2243] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:02:20.791170 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b8c22-3742-40fd-8686-94ddfe7110b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:20.792965 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b8c22-3742-40fd-8686-94ddfe7110b4 service swift] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:20.805180 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1144/2244] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 14:02:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:02:22.549903 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d89c26-7675-4ec8-aa1c-fd7c2bee6133 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:22.552286 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-93d89c26-7675-4ec8-aa1c-fd7c2bee6133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:22.590844 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d89c26-7675-4ec8-aa1c-fd7c2bee6133 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:22.605325 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75687cf2-5934-4cd9-8bda-c99d8c3b2595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:22.613786 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75687cf2-5934-4cd9-8bda-c99d8c3b2595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:22.614191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75687cf2-5934-4cd9-8bda-c99d8c3b2595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:22.614590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75687cf2-5934-4cd9-8bda-c99d8c3b2595 admin admin] PATH_INFO: `/v3/projects/c2f6d085a48d4a75a69d320c4b953903` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:22.619333 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75687cf2-5934-4cd9-8bda-c99d8c3b2595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2f6d085a48d4a75a69d320c4b953903)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:22.627448 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75687cf2-5934-4cd9-8bda-c99d8c3b2595 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:22.828957 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-75687cf2-5934-4cd9-8bda-c99d8c3b2595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2f6d085a48d4a75a69d320c4b953903', 'request_id': 'req-75687cf2-5934-4cd9-8bda-c99d8c3b2595'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:22.844156 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-75687cf2-5934-4cd9-8bda-c99d8c3b2595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2f6d085a48d4a75a69d320c4b953903', 'request_id': 'req-75687cf2-5934-4cd9-8bda-c99d8c3b2595'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:22.859359 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-75687cf2-5934-4cd9-8bda-c99d8c3b2595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2f6d085a48d4a75a69d320c4b953903', 'request_id': 'req-75687cf2-5934-4cd9-8bda-c99d8c3b2595'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:22.886337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-75687cf2-5934-4cd9-8bda-c99d8c3b2595 admin admin] The token cache is being invalidate because project c2f6d085a48d4a75a69d320c4b953903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:22.886772 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-75687cf2-5934-4cd9-8bda-c99d8c3b2595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:22.888386 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-75687cf2-5934-4cd9-8bda-c99d8c3b2595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:22.892088 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1101/2245] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:02:22 2022] DELETE /identity/v3/projects/c2f6d085a48d4a75a69d320c4b953903 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:24.056278 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ecd2a-6f71-4dfd-a547-d3545217299c None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:24.056751 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ecd2a-6f71-4dfd-a547-d3545217299c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:24.056847 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ecd2a-6f71-4dfd-a547-d3545217299c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:24.088748 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-889ecd2a-6f71-4dfd-a547-d3545217299c None None] MFA Rules not processed for user `bd14de0fd51c4fd89d9875b9c47100cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:24.090231 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-889ecd2a-6f71-4dfd-a547-d3545217299c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:24.165517 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1145/2246] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:02:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:31.755331 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee3649-31e0-4d3b-9c10-916489c78939 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:31.756432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee3649-31e0-4d3b-9c10-916489c78939 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:31.756783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee3649-31e0-4d3b-9c10-916489c78939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:31.779559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-55ee3649-31e0-4d3b-9c10-916489c78939 None None] MFA Rules not processed for user `df5dcdfb4eda417ebc0af2432497617d`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:31.780968 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-55ee3649-31e0-4d3b-9c10-916489c78939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:31.851609 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1102/2247] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 14:02:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:31.863924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ecd2a-6f71-4dfd-a547-d3545217299c None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:31.865398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-889ecd2a-6f71-4dfd-a547-d3545217299c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:31.941514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ecd2a-6f71-4dfd-a547-d3545217299c None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:31.947108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a54a9d-b0ad-40bf-af12-640160a99b52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd102155cd1bd4368ad272668da1651f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:31.947750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a54a9d-b0ad-40bf-af12-640160a99b52 service swift] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:31.948031 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a54a9d-b0ad-40bf-af12-640160a99b52 service swift] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:31.948339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a54a9d-b0ad-40bf-af12-640160a99b52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:31.956674 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a54a9d-b0ad-40bf-af12-640160a99b52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:31.958230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a54a9d-b0ad-40bf-af12-640160a99b52 service swift] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:31.970975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1146/2248] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 14:02:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:02:32.668714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297b34b-a9ad-4463-88fb-77aa798ca9b5 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:32.668984 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297b34b-a9ad-4463-88fb-77aa798ca9b5 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:32.669271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297b34b-a9ad-4463-88fb-77aa798ca9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:32.689119 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-9297b34b-a9ad-4463-88fb-77aa798ca9b5 None None] MFA Rules not processed for user `df5dcdfb4eda417ebc0af2432497617d`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:32.690335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-9297b34b-a9ad-4463-88fb-77aa798ca9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:32.699532 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1103/2249] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 14:02:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:32.718081 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a54a9d-b0ad-40bf-af12-640160a99b52 service swift] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:32.729412 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a54a9d-b0ad-40bf-af12-640160a99b52 service swift] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:32.735022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e0350-6ad2-4733-ab45-04696903cb77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd102155cd1bd4368ad272668da1651f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:32.735665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e0350-6ad2-4733-ab45-04696903cb77 service swift] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:32.735939 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e0350-6ad2-4733-ab45-04696903cb77 service swift] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:32.736238 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e0350-6ad2-4733-ab45-04696903cb77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:32.745806 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e0350-6ad2-4733-ab45-04696903cb77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:32.747398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e0350-6ad2-4733-ab45-04696903cb77 service swift] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:32.757019 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1147/2250] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 14:02:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:02:33.779878 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7c7e4-7011-4e89-a0ed-557e6ab242c1 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:33.780988 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7c7e4-7011-4e89-a0ed-557e6ab242c1 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:33.782236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7c7e4-7011-4e89-a0ed-557e6ab242c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:33.835877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-48a7c7e4-7011-4e89-a0ed-557e6ab242c1 None None] MFA Rules not processed for user `df5dcdfb4eda417ebc0af2432497617d`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:33.837134 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-48a7c7e4-7011-4e89-a0ed-557e6ab242c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:33.861512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1104/2251] 10.222.0.49 () {58 vars in 967 bytes} [Tue May 10 14:02:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:33.874635 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e0350-6ad2-4733-ab45-04696903cb77 service swift] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:33.893711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e0350-6ad2-4733-ab45-04696903cb77 service swift] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:33.907828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5f096-37a1-478d-aa91-fc6d8981ae7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd102155cd1bd4368ad272668da1651f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:33.908663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5f096-37a1-478d-aa91-fc6d8981ae7c service swift] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:33.909046 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5f096-37a1-478d-aa91-fc6d8981ae7c service swift] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:33.909419 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5f096-37a1-478d-aa91-fc6d8981ae7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:33.938365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5f096-37a1-478d-aa91-fc6d8981ae7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:33.939474 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5f096-37a1-478d-aa91-fc6d8981ae7c service swift] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:33.967097 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1148/2252] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 14:02:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:02:34.357039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22644b2-daab-4666-a8e0-c8d650f3f4bc None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:34.357632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22644b2-daab-4666-a8e0-c8d650f3f4bc None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:34.358143 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22644b2-daab-4666-a8e0-c8d650f3f4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:34.389715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-f22644b2-daab-4666-a8e0-c8d650f3f4bc None None] MFA Rules not processed for user `df5dcdfb4eda417ebc0af2432497617d`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:34.391235 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-f22644b2-daab-4666-a8e0-c8d650f3f4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:34.402581 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1105/2253] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 14:02:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:34.424205 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5f096-37a1-478d-aa91-fc6d8981ae7c service swift] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:34.438591 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5f096-37a1-478d-aa91-fc6d8981ae7c service swift] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:34.444823 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448d995-d689-4d12-8456-556d37811204 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd102155cd1bd4368ad272668da1651f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:34.445801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448d995-d689-4d12-8456-556d37811204 service swift] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:34.446082 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448d995-d689-4d12-8456-556d37811204 service swift] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:34.446534 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448d995-d689-4d12-8456-556d37811204 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:34.456116 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448d995-d689-4d12-8456-556d37811204 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:34.458062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448d995-d689-4d12-8456-556d37811204 service swift] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:34.468404 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1149/2254] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 14:02:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:02:35.005629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cfe3d-2776-4190-b1bc-98e35a8ccb5c None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:35.006198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cfe3d-2776-4190-b1bc-98e35a8ccb5c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:35.006198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cfe3d-2776-4190-b1bc-98e35a8ccb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:35.044057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-de4cfe3d-2776-4190-b1bc-98e35a8ccb5c None None] MFA Rules not processed for user `df5dcdfb4eda417ebc0af2432497617d`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:35.046981 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-de4cfe3d-2776-4190-b1bc-98e35a8ccb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:35.060520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1106/2255] 10.222.0.49 () {58 vars in 967 bytes} [Tue May 10 14:02:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:35.085426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448d995-d689-4d12-8456-556d37811204 service swift] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:35.098773 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448d995-d689-4d12-8456-556d37811204 service swift] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:35.113992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c71f64-bc43-4cc9-9df4-8eeb64314278 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd102155cd1bd4368ad272668da1651f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:35.114658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c71f64-bc43-4cc9-9df4-8eeb64314278 service swift] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:35.114943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c71f64-bc43-4cc9-9df4-8eeb64314278 service swift] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:35.115217 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c71f64-bc43-4cc9-9df4-8eeb64314278 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:35.135566 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c71f64-bc43-4cc9-9df4-8eeb64314278 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:35.141537 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c71f64-bc43-4cc9-9df4-8eeb64314278 service swift] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:35.152667 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1150/2256] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 14:02:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:02:37.906998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cfe3d-2776-4190-b1bc-98e35a8ccb5c None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:37.909231 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-de4cfe3d-2776-4190-b1bc-98e35a8ccb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:38.024475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cfe3d-2776-4190-b1bc-98e35a8ccb5c None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:38.034127 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535ce23-689d-496b-890e-55c7fd17c78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:38.035266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535ce23-689d-496b-890e-55c7fd17c78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:38.035841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535ce23-689d-496b-890e-55c7fd17c78e admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:38.037377 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535ce23-689d-496b-890e-55c7fd17c78e admin admin] PATH_INFO: `/v3/users/c4d7e361f048469aa63bcb2fac42ed83` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:38.039404 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535ce23-689d-496b-890e-55c7fd17c78e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d7e361f048469aa63bcb2fac42ed83)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:38.041919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535ce23-689d-496b-890e-55c7fd17c78e admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:38.110015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b535ce23-689d-496b-890e-55c7fd17c78e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d7e361f048469aa63bcb2fac42ed83'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:38.111660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b535ce23-689d-496b-890e-55c7fd17c78e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d7e361f048469aa63bcb2fac42ed83'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:38.130853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b535ce23-689d-496b-890e-55c7fd17c78e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d7e361f048469aa63bcb2fac42ed83'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:38.146985 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b535ce23-689d-496b-890e-55c7fd17c78e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d7e361f048469aa63bcb2fac42ed83'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:38.151072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b535ce23-689d-496b-890e-55c7fd17c78e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d7e361f048469aa63bcb2fac42ed83'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:38.191099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1107/2257] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:02:37 2022] DELETE /identity/v3/users/c4d7e361f048469aa63bcb2fac42ed83 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:38.195779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed680a2d-5ee6-446c-8a9a-5f6d11a7908a None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:38.196988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed680a2d-5ee6-446c-8a9a-5f6d11a7908a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:38.197870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed680a2d-5ee6-446c-8a9a-5f6d11a7908a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:38.261489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-ed680a2d-5ee6-446c-8a9a-5f6d11a7908a None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:38.267625 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ed680a2d-5ee6-446c-8a9a-5f6d11a7908a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:38.493371 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1151/2258] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:38.501304 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535ce23-689d-496b-890e-55c7fd17c78e admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:38.503053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b535ce23-689d-496b-890e-55c7fd17c78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:38.595846 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535ce23-689d-496b-890e-55c7fd17c78e admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:38.608516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d94e4-bcdd-4e20-be1f-a4648ad2ccd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:38.609434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d94e4-bcdd-4e20-be1f-a4648ad2ccd2 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:38.610390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d94e4-bcdd-4e20-be1f-a4648ad2ccd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:38.610879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d94e4-bcdd-4e20-be1f-a4648ad2ccd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:38.625675 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d94e4-bcdd-4e20-be1f-a4648ad2ccd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:38.627525 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d94e4-bcdd-4e20-be1f-a4648ad2ccd2 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:38.652930 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1108/2259] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:38.915195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed680a2d-5ee6-446c-8a9a-5f6d11a7908a None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:38.916913 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ed680a2d-5ee6-446c-8a9a-5f6d11a7908a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:38.949350 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed680a2d-5ee6-446c-8a9a-5f6d11a7908a None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:38.967484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c2fbc-4670-45f4-a27e-7bd9e4b7beff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:38.968674 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c2fbc-4670-45f4-a27e-7bd9e4b7beff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:38.969113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c2fbc-4670-45f4-a27e-7bd9e4b7beff admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:38.969582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c2fbc-4670-45f4-a27e-7bd9e4b7beff admin admin] PATH_INFO: `/v3/projects/cdc4505b52714863b9bf8143c27f0a02` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:38.977422 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c2fbc-4670-45f4-a27e-7bd9e4b7beff admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc4505b52714863b9bf8143c27f0a02)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:38.979531 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c2fbc-4670-45f4-a27e-7bd9e4b7beff admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:39.096248 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-067c2fbc-4670-45f4-a27e-7bd9e4b7beff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc4505b52714863b9bf8143c27f0a02', 'request_id': 'req-067c2fbc-4670-45f4-a27e-7bd9e4b7beff'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:39.121509 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-067c2fbc-4670-45f4-a27e-7bd9e4b7beff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc4505b52714863b9bf8143c27f0a02', 'request_id': 'req-067c2fbc-4670-45f4-a27e-7bd9e4b7beff'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:39.128489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-067c2fbc-4670-45f4-a27e-7bd9e4b7beff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc4505b52714863b9bf8143c27f0a02', 'request_id': 'req-067c2fbc-4670-45f4-a27e-7bd9e4b7beff'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:39.141768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-067c2fbc-4670-45f4-a27e-7bd9e4b7beff admin admin] The token cache is being invalidate because project cdc4505b52714863b9bf8143c27f0a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:02:39.142167 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-067c2fbc-4670-45f4-a27e-7bd9e4b7beff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:39.143509 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-067c2fbc-4670-45f4-a27e-7bd9e4b7beff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:02:39.145292 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1152/2260] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:02:38 2022] DELETE /identity/v3/projects/cdc4505b52714863b9bf8143c27f0a02 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:02:46.103533 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d94e4-bcdd-4e20-be1f-a4648ad2ccd2 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:46.115272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d94e4-bcdd-4e20-be1f-a4648ad2ccd2 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:46.170761 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfb46c-cd36-477d-bb80-eb41cf5a327a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:46.171403 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfb46c-cd36-477d-bb80-eb41cf5a327a service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:46.171683 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfb46c-cd36-477d-bb80-eb41cf5a327a service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:46.172329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfb46c-cd36-477d-bb80-eb41cf5a327a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:46.174499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-5ddfb46c-cd36-477d-bb80-eb41cf5a327a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:46.237482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfb46c-cd36-477d-bb80-eb41cf5a327a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:46.238942 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfb46c-cd36-477d-bb80-eb41cf5a327a service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:46.250013 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1109/2261] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:02:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:51.914080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274f15e-19c3-42e0-bc83-871e4849bc95 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:51.914695 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274f15e-19c3-42e0-bc83-871e4849bc95 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:51.914695 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274f15e-19c3-42e0-bc83-871e4849bc95 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:51.916032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1153/2262] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 14:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:02:51.922893 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0735b5-6b68-48e2-8803-62edb0f327d4 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:51.924008 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0735b5-6b68-48e2-8803-62edb0f327d4 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:51.924464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0735b5-6b68-48e2-8803-62edb0f327d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:52.034815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-9c0735b5-6b68-48e2-8803-62edb0f327d4 None None] MFA Rules not processed for user `975f10f781b94bdaa8edee39a2b1bba4`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:52.042580 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-9c0735b5-6b68-48e2-8803-62edb0f327d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:52.195624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1110/2263] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 14:02:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:52.208937 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274f15e-19c3-42e0-bc83-871e4849bc95 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:52.211559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-3274f15e-19c3-42e0-bc83-871e4849bc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:52.300257 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274f15e-19c3-42e0-bc83-871e4849bc95 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:52.306757 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7138a-ccb0-4e6c-ab69-c06a800a0d18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d674fd1d6ab43ab982b66bb2349b625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:52.307408 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7138a-ccb0-4e6c-ab69-c06a800a0d18 service glance] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:52.307687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7138a-ccb0-4e6c-ab69-c06a800a0d18 service glance] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:52.307965 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7138a-ccb0-4e6c-ab69-c06a800a0d18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:52.319931 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7138a-ccb0-4e6c-ab69-c06a800a0d18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:52.321400 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7138a-ccb0-4e6c-ab69-c06a800a0d18 service glance] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:52.333148 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1154/2264] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:02:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:52.401677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42859fb7-200d-4622-bac9-94a9cc006203 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:52.401893 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42859fb7-200d-4622-bac9-94a9cc006203 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:52.402189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42859fb7-200d-4622-bac9-94a9cc006203 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:52.403544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1111/2265] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 14:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:02:52.408403 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaac9c-16c8-4b85-a6f5-a98dbea136aa None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:52.408694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaac9c-16c8-4b85-a6f5-a98dbea136aa None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:52.408975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaac9c-16c8-4b85-a6f5-a98dbea136aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:52.427213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-18eaac9c-16c8-4b85-a6f5-a98dbea136aa None None] MFA Rules not processed for user `930f350dad954c7783f479bbb25c1f46`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:52.428457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-18eaac9c-16c8-4b85-a6f5-a98dbea136aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:52.434953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1155/2266] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 14:02:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:52.448287 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42859fb7-200d-4622-bac9-94a9cc006203 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:52.449954 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-42859fb7-200d-4622-bac9-94a9cc006203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:52.463308 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42859fb7-200d-4622-bac9-94a9cc006203 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:52.466782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f60dc-1f14-41b7-aa5b-30cfcc973565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:52.467401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f60dc-1f14-41b7-aa5b-30cfcc973565 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:52.467678 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f60dc-1f14-41b7-aa5b-30cfcc973565 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:52.467951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f60dc-1f14-41b7-aa5b-30cfcc973565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:52.475585 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f60dc-1f14-41b7-aa5b-30cfcc973565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:52.477024 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f60dc-1f14-41b7-aa5b-30cfcc973565 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:52.484777 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1112/2267] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:02:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:52.574346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ce316-ff98-4a37-b326-886245c33105 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:52.574659 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ce316-ff98-4a37-b326-886245c33105 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:52.574941 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ce316-ff98-4a37-b326-886245c33105 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:52.576380 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1156/2268] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 14:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:02:52.581699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d6c87-4276-4005-b6a6-ba04c70b51d6 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:52.581989 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d6c87-4276-4005-b6a6-ba04c70b51d6 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:52.582267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d6c87-4276-4005-b6a6-ba04c70b51d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:52.601241 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-085d6c87-4276-4005-b6a6-ba04c70b51d6 None None] MFA Rules not processed for user `975f10f781b94bdaa8edee39a2b1bba4`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:02:52.602435 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-085d6c87-4276-4005-b6a6-ba04c70b51d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:52.611748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1113/2269] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 14:02:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:02:52.621966 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ce316-ff98-4a37-b326-886245c33105 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:52.632777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ce316-ff98-4a37-b326-886245c33105 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:52.636410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e50e72-77e6-4a44-ba0c-eedb5aefd25e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:52.637033 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e50e72-77e6-4a44-ba0c-eedb5aefd25e service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:52.637314 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e50e72-77e6-4a44-ba0c-eedb5aefd25e service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:52.637589 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e50e72-77e6-4a44-ba0c-eedb5aefd25e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:52.648476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e50e72-77e6-4a44-ba0c-eedb5aefd25e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:52.649879 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e50e72-77e6-4a44-ba0c-eedb5aefd25e service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:52.660392 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1157/2270] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:02:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:58.689871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d6c87-4276-4005-b6a6-ba04c70b51d6 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:58.699923 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d6c87-4276-4005-b6a6-ba04c70b51d6 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:58.703999 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca3a76-b7e7-4770-a489-e918d57dc141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:58.704817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca3a76-b7e7-4770-a489-e918d57dc141 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:58.705099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca3a76-b7e7-4770-a489-e918d57dc141 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:58.705373 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca3a76-b7e7-4770-a489-e918d57dc141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:58.707199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-28ca3a76-b7e7-4770-a489-e918d57dc141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:58.773098 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca3a76-b7e7-4770-a489-e918d57dc141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:58.774518 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca3a76-b7e7-4770-a489-e918d57dc141 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:58.783985 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1114/2271] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:02:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:02:58.805239 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e50e72-77e6-4a44-ba0c-eedb5aefd25e service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:02:58.806648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d4e50e72-77e6-4a44-ba0c-eedb5aefd25e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:58.901420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e50e72-77e6-4a44-ba0c-eedb5aefd25e service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:02:58.906448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e328f8a-1098-44db-9faa-9c1f3df29b8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8a29487b009419dbead4684bcd01cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:02:58.907087 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e328f8a-1098-44db-9faa-9c1f3df29b8f service placement] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:02:58.907830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e328f8a-1098-44db-9faa-9c1f3df29b8f service placement] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:02:58.907830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e328f8a-1098-44db-9faa-9c1f3df29b8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:02:58.909405 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-7e328f8a-1098-44db-9faa-9c1f3df29b8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:02:58.920830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e328f8a-1098-44db-9faa-9c1f3df29b8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:02:58.922352 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e328f8a-1098-44db-9faa-9c1f3df29b8f service placement] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:02:58.933203 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1158/2272] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:02:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:03:00.632592 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494804c-8574-4f3d-aeb5-7f356260290b None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:00.633152 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494804c-8574-4f3d-aeb5-7f356260290b None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:00.633263 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494804c-8574-4f3d-aeb5-7f356260290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:00.687430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-f494804c-8574-4f3d-aeb5-7f356260290b None None] MFA Rules not processed for user `df5dcdfb4eda417ebc0af2432497617d`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:00.689061 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-f494804c-8574-4f3d-aeb5-7f356260290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:00.786194 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1115/2273] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 14:03:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:00.811206 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e328f8a-1098-44db-9faa-9c1f3df29b8f service placement] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:00.813176 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-7e328f8a-1098-44db-9faa-9c1f3df29b8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:00.978252 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e328f8a-1098-44db-9faa-9c1f3df29b8f service placement] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:00.984669 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da5dc7-0547-44fd-9985-918520eb26e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd102155cd1bd4368ad272668da1651f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:00.985333 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da5dc7-0547-44fd-9985-918520eb26e9 service swift] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:00.985613 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da5dc7-0547-44fd-9985-918520eb26e9 service swift] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:00.985899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da5dc7-0547-44fd-9985-918520eb26e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:01.000188 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da5dc7-0547-44fd-9985-918520eb26e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:01.001912 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da5dc7-0547-44fd-9985-918520eb26e9 service swift] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:01.017101 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1159/2274] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 14:03:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:03:26.948609 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85475d3b-8c31-4374-baa4-a46b517e7963 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:26.949146 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85475d3b-8c31-4374-baa4-a46b517e7963 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:26.949254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85475d3b-8c31-4374-baa4-a46b517e7963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:26.967259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-85475d3b-8c31-4374-baa4-a46b517e7963 None None] MFA Rules not processed for user `df5dcdfb4eda417ebc0af2432497617d`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:26.968476 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-85475d3b-8c31-4374-baa4-a46b517e7963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:26.975577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1116/2275] 10.222.0.49 () {58 vars in 967 bytes} [Tue May 10 14:03:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:03:26.987473 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da5dc7-0547-44fd-9985-918520eb26e9 service swift] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:03:26.997506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da5dc7-0547-44fd-9985-918520eb26e9 service swift] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:03:27.002443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1bda2-58a0-455a-97f1-8d9c6b70bda3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd102155cd1bd4368ad272668da1651f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:03:27.003086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1bda2-58a0-455a-97f1-8d9c6b70bda3 service swift] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:27.003361 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1bda2-58a0-455a-97f1-8d9c6b70bda3 service swift] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:27.003631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1bda2-58a0-455a-97f1-8d9c6b70bda3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:27.012465 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1bda2-58a0-455a-97f1-8d9c6b70bda3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:03:27.014009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1bda2-58a0-455a-97f1-8d9c6b70bda3 service swift] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:03:27.022108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1160/2276] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 14:03:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:03:55.582811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35966517-7eb7-45e7-a1b4-a71f262e4d52 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:03:55.583341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35966517-7eb7-45e7-a1b4-a71f262e4d52 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:03:55.583341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35966517-7eb7-45e7-a1b4-a71f262e4d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:03:55.601444 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-35966517-7eb7-45e7-a1b4-a71f262e4d52 None None] MFA Rules not processed for user `8c563c6a229b4e619992ccfb0da1a748`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:03:55.602668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-35966517-7eb7-45e7-a1b4-a71f262e4d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:03:55.657957 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1117/2277] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:03:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:18.332436 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155d44c-20bf-43e7-be6f-c60b6ea26111 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:18.332965 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155d44c-20bf-43e7-be6f-c60b6ea26111 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:18.332965 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155d44c-20bf-43e7-be6f-c60b6ea26111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:18.350876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-2155d44c-20bf-43e7-be6f-c60b6ea26111 None None] MFA Rules not processed for user `67535c1c99484689999ef478604e51d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:18.352067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-2155d44c-20bf-43e7-be6f-c60b6ea26111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:18.409918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1161/2278] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:04:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:18.472881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa88aaf-f7ec-4f9b-ba81-8833f83ca455 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:18.472881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa88aaf-f7ec-4f9b-ba81-8833f83ca455 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:18.472881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa88aaf-f7ec-4f9b-ba81-8833f83ca455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:18.490338 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-8fa88aaf-f7ec-4f9b-ba81-8833f83ca455 None None] MFA Rules not processed for user `bd14de0fd51c4fd89d9875b9c47100cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:18.491535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8fa88aaf-f7ec-4f9b-ba81-8833f83ca455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:18.544992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1118/2279] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:04:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:50.337822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566b710-e9b7-4f8a-98b0-82edd82c7cdc None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:50.338313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566b710-e9b7-4f8a-98b0-82edd82c7cdc None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:50.338441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566b710-e9b7-4f8a-98b0-82edd82c7cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:50.358002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-3566b710-e9b7-4f8a-98b0-82edd82c7cdc None None] MFA Rules not processed for user `df5dcdfb4eda417ebc0af2432497617d`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:50.359282 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-3566b710-e9b7-4f8a-98b0-82edd82c7cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:50.367632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1162/2280] 10.222.0.49 () {58 vars in 967 bytes} [Tue May 10 14:04:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:50.422597 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa88aaf-f7ec-4f9b-ba81-8833f83ca455 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:50.434892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa88aaf-f7ec-4f9b-ba81-8833f83ca455 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:50.439966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97491e-0a49-4e46-99e0-97344877a535 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd102155cd1bd4368ad272668da1651f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:50.440638 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97491e-0a49-4e46-99e0-97344877a535 service swift] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:50.440951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97491e-0a49-4e46-99e0-97344877a535 service swift] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:50.441226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97491e-0a49-4e46-99e0-97344877a535 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:50.449505 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97491e-0a49-4e46-99e0-97344877a535 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:50.451146 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97491e-0a49-4e46-99e0-97344877a535 service swift] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:50.460090 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1119/2281] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 14:04:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 14:04:52.243006 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1109d-19cf-498b-b939-e7d408cd6d52 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:52.244693 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1109d-19cf-498b-b939-e7d408cd6d52 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:52.245021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1109d-19cf-498b-b939-e7d408cd6d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:52.266741 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-59c1109d-19cf-498b-b939-e7d408cd6d52 None None] MFA Rules not processed for user `def10f42c8744e1d8526087c874ceedd`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:04:52.268108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-59c1109d-19cf-498b-b939-e7d408cd6d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:52.327095 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1163/2282] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:04:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:04:54.500671 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97491e-0a49-4e46-99e0-97344877a535 service swift] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:54.503443 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-2d97491e-0a49-4e46-99e0-97344877a535 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:54.518951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97491e-0a49-4e46-99e0-97344877a535 service swift] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:54.524163 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b22ef-5255-499c-9a65-ab4509c1bef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:54.525021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b22ef-5255-499c-9a65-ab4509c1bef4 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:54.525496 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b22ef-5255-499c-9a65-ab4509c1bef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:54.525952 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b22ef-5255-499c-9a65-ab4509c1bef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:54.528329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b30b22ef-5255-499c-9a65-ab4509c1bef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:54.546773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b22ef-5255-499c-9a65-ab4509c1bef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:54.548720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b22ef-5255-499c-9a65-ab4509c1bef4 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:54.574477 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1120/2283] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:04:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:04:55.703320 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1109d-19cf-498b-b939-e7d408cd6d52 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:55.719898 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1109d-19cf-498b-b939-e7d408cd6d52 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:55.724967 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97134151-da02-46fb-9024-d919b8cb416c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:55.727131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97134151-da02-46fb-9024-d919b8cb416c service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:55.727647 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97134151-da02-46fb-9024-d919b8cb416c service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:55.728086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97134151-da02-46fb-9024-d919b8cb416c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:55.730959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-97134151-da02-46fb-9024-d919b8cb416c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:55.749114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97134151-da02-46fb-9024-d919b8cb416c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:55.750686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97134151-da02-46fb-9024-d919b8cb416c service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:55.763570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1164/2284] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:04:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:04:58.839875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b22ef-5255-499c-9a65-ab4509c1bef4 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:58.841731 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b30b22ef-5255-499c-9a65-ab4509c1bef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:58.920224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b22ef-5255-499c-9a65-ab4509c1bef4 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:58.924992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bafbe-5e4b-4c80-97f2-7d605925cc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:58.925863 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bafbe-5e4b-4c80-97f2-7d605925cc4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:58.926141 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bafbe-5e4b-4c80-97f2-7d605925cc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:58.926438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bafbe-5e4b-4c80-97f2-7d605925cc4d admin admin] PATH_INFO: `/v3/users/c4f57917c86244c2baecd9d795c502c4` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:58.927650 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bafbe-5e4b-4c80-97f2-7d605925cc4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4f57917c86244c2baecd9d795c502c4)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:58.929608 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bafbe-5e4b-4c80-97f2-7d605925cc4d admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:58.976203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-9a3bafbe-5e4b-4c80-97f2-7d605925cc4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4f57917c86244c2baecd9d795c502c4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:58.976876 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-9a3bafbe-5e4b-4c80-97f2-7d605925cc4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4f57917c86244c2baecd9d795c502c4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:58.988511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-9a3bafbe-5e4b-4c80-97f2-7d605925cc4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4f57917c86244c2baecd9d795c502c4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:58.996668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-9a3bafbe-5e4b-4c80-97f2-7d605925cc4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4f57917c86244c2baecd9d795c502c4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:58.997285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-9a3bafbe-5e4b-4c80-97f2-7d605925cc4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4f57917c86244c2baecd9d795c502c4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:59.009593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1121/2285] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:04:58 2022] DELETE /identity/v3/users/c4f57917c86244c2baecd9d795c502c4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:59.319527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97134151-da02-46fb-9024-d919b8cb416c service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:59.330091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97134151-da02-46fb-9024-d919b8cb416c service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:59.400766 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1def3a-a3bd-487f-995e-8f05835243ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:59.401635 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1def3a-a3bd-487f-995e-8f05835243ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:59.401962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1def3a-a3bd-487f-995e-8f05835243ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:59.402188 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1def3a-a3bd-487f-995e-8f05835243ff admin admin] PATH_INFO: `/v3/projects/b1e759f08bf04eeabbbc1b14bca8a169` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:59.403593 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1def3a-a3bd-487f-995e-8f05835243ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1e759f08bf04eeabbbc1b14bca8a169)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:59.405498 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1def3a-a3bd-487f-995e-8f05835243ff admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:59.449989 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bb1def3a-a3bd-487f-995e-8f05835243ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1e759f08bf04eeabbbc1b14bca8a169', 'request_id': 'req-bb1def3a-a3bd-487f-995e-8f05835243ff'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:59.459944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bb1def3a-a3bd-487f-995e-8f05835243ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1e759f08bf04eeabbbc1b14bca8a169', 'request_id': 'req-bb1def3a-a3bd-487f-995e-8f05835243ff'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:59.465025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bb1def3a-a3bd-487f-995e-8f05835243ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1e759f08bf04eeabbbc1b14bca8a169', 'request_id': 'req-bb1def3a-a3bd-487f-995e-8f05835243ff'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:59.477785 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bb1def3a-a3bd-487f-995e-8f05835243ff admin admin] The token cache is being invalidate because project b1e759f08bf04eeabbbc1b14bca8a169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:04:59.478068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bb1def3a-a3bd-487f-995e-8f05835243ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:59.478707 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bb1def3a-a3bd-487f-995e-8f05835243ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:59.480326 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1165/2286] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:04:59 2022] DELETE /identity/v3/projects/b1e759f08bf04eeabbbc1b14bca8a169 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:04:59.484266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bafbe-5e4b-4c80-97f2-7d605925cc4d admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:59.485800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-9a3bafbe-5e4b-4c80-97f2-7d605925cc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:59.503073 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bafbe-5e4b-4c80-97f2-7d605925cc4d admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:59.557443 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb00df5-de26-4ffc-b113-42e0f8c2edd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:59.558301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb00df5-de26-4ffc-b113-42e0f8c2edd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:59.558583 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb00df5-de26-4ffc-b113-42e0f8c2edd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:59.558859 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb00df5-de26-4ffc-b113-42e0f8c2edd7 admin admin] PATH_INFO: `/v3/users/b7eab96549924bfdb0213e1c8a200917` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:59.560033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb00df5-de26-4ffc-b113-42e0f8c2edd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7eab96549924bfdb0213e1c8a200917)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:59.562065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb00df5-de26-4ffc-b113-42e0f8c2edd7 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:59.605735 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fcb00df5-de26-4ffc-b113-42e0f8c2edd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7eab96549924bfdb0213e1c8a200917'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:59.606367 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fcb00df5-de26-4ffc-b113-42e0f8c2edd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7eab96549924bfdb0213e1c8a200917'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:59.618095 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fcb00df5-de26-4ffc-b113-42e0f8c2edd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7eab96549924bfdb0213e1c8a200917'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:59.625238 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fcb00df5-de26-4ffc-b113-42e0f8c2edd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7eab96549924bfdb0213e1c8a200917'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:59.625848 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fcb00df5-de26-4ffc-b113-42e0f8c2edd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7eab96549924bfdb0213e1c8a200917'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:59.637487 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1122/2287] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:04:59 2022] DELETE /identity/v3/users/b7eab96549924bfdb0213e1c8a200917 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:04:59.813477 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1def3a-a3bd-487f-995e-8f05835243ff admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:04:59.815464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-bb1def3a-a3bd-487f-995e-8f05835243ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:04:59.846091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1def3a-a3bd-487f-995e-8f05835243ff admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:04:59.902870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083876e-66aa-4266-a27c-e55b5f4e1553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:04:59.903729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083876e-66aa-4266-a27c-e55b5f4e1553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:04:59.904008 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083876e-66aa-4266-a27c-e55b5f4e1553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:04:59.904300 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083876e-66aa-4266-a27c-e55b5f4e1553 admin admin] PATH_INFO: `/v3/projects/39473eb2570a473ea318fffb547e4267` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:04:59.905866 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083876e-66aa-4266-a27c-e55b5f4e1553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39473eb2570a473ea318fffb547e4267)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:04:59.907765 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083876e-66aa-4266-a27c-e55b5f4e1553 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:04:59.953637 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a083876e-66aa-4266-a27c-e55b5f4e1553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39473eb2570a473ea318fffb547e4267', 'request_id': 'req-a083876e-66aa-4266-a27c-e55b5f4e1553'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:59.960934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a083876e-66aa-4266-a27c-e55b5f4e1553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39473eb2570a473ea318fffb547e4267', 'request_id': 'req-a083876e-66aa-4266-a27c-e55b5f4e1553'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:59.966480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a083876e-66aa-4266-a27c-e55b5f4e1553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39473eb2570a473ea318fffb547e4267', 'request_id': 'req-a083876e-66aa-4266-a27c-e55b5f4e1553'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:59.978260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a083876e-66aa-4266-a27c-e55b5f4e1553 admin admin] The token cache is being invalidate because project 39473eb2570a473ea318fffb547e4267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:04:59.978547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a083876e-66aa-4266-a27c-e55b5f4e1553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:59.979197 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a083876e-66aa-4266-a27c-e55b5f4e1553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:04:59.980865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1166/2288] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:04:59 2022] DELETE /identity/v3/projects/39473eb2570a473ea318fffb547e4267 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:13.048313 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb00df5-de26-4ffc-b113-42e0f8c2edd7 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:13.049821 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-fcb00df5-de26-4ffc-b113-42e0f8c2edd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:13.113185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb00df5-de26-4ffc-b113-42e0f8c2edd7 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:13.159234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a75fb3-cf1e-4ee9-9ff6-12480a952186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:13.159862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a75fb3-cf1e-4ee9-9ff6-12480a952186 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:13.160156 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a75fb3-cf1e-4ee9-9ff6-12480a952186 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:13.160455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a75fb3-cf1e-4ee9-9ff6-12480a952186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:13.162209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-37a75fb3-cf1e-4ee9-9ff6-12480a952186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:13.170992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a75fb3-cf1e-4ee9-9ff6-12480a952186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:13.172431 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a75fb3-cf1e-4ee9-9ff6-12480a952186 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:13.180476 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1123/2289] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:14.721540 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97198592-c90d-4b6f-a54d-6a78c734b7fa None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:14.722053 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97198592-c90d-4b6f-a54d-6a78c734b7fa None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:14.722136 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97198592-c90d-4b6f-a54d-6a78c734b7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:14.751840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-97198592-c90d-4b6f-a54d-6a78c734b7fa None None] MFA Rules not processed for user `9d87a4de3fbf4cbb9e21523634007629`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:14.758924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-97198592-c90d-4b6f-a54d-6a78c734b7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:14.835650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1167/2290] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:15.227945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a75fb3-cf1e-4ee9-9ff6-12480a952186 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:15.240476 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-37a75fb3-cf1e-4ee9-9ff6-12480a952186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:15.253194 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a75fb3-cf1e-4ee9-9ff6-12480a952186 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:15.260789 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a7174-935b-4e31-b839-b9e26ffd9d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:15.261884 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a7174-935b-4e31-b839-b9e26ffd9d61 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:15.262395 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a7174-935b-4e31-b839-b9e26ffd9d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:15.262672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a7174-935b-4e31-b839-b9e26ffd9d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:15.265405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0b8a7174-935b-4e31-b839-b9e26ffd9d61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:15.276199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a7174-935b-4e31-b839-b9e26ffd9d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:15.277677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a7174-935b-4e31-b839-b9e26ffd9d61 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:15.285834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1124/2291] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:15.797441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97198592-c90d-4b6f-a54d-6a78c734b7fa None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:15.799837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-97198592-c90d-4b6f-a54d-6a78c734b7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:15.882611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97198592-c90d-4b6f-a54d-6a78c734b7fa None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:15.887836 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8c62-b151-43cd-9f6e-63f563cd79c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8a29487b009419dbead4684bcd01cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:15.888759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8c62-b151-43cd-9f6e-63f563cd79c8 service placement] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:15.889048 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8c62-b151-43cd-9f6e-63f563cd79c8 service placement] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:15.889328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8c62-b151-43cd-9f6e-63f563cd79c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:15.891134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-eabe8c62-b151-43cd-9f6e-63f563cd79c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:15.905045 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8c62-b151-43cd-9f6e-63f563cd79c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:15.907122 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8c62-b151-43cd-9f6e-63f563cd79c8 service placement] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:15.918875 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1168/2292] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:16.846188 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbcc20-a9cc-4c1f-a513-5766e49d50fe None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:16.846683 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbcc20-a9cc-4c1f-a513-5766e49d50fe None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:16.846790 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbcc20-a9cc-4c1f-a513-5766e49d50fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:16.864816 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-1edbcc20-a9cc-4c1f-a513-5766e49d50fe None None] MFA Rules not processed for user `8c563c6a229b4e619992ccfb0da1a748`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:16.865999 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-1edbcc20-a9cc-4c1f-a513-5766e49d50fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:16.921330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1125/2293] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:18.081428 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8c62-b151-43cd-9f6e-63f563cd79c8 service placement] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:18.083595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-eabe8c62-b151-43cd-9f6e-63f563cd79c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:18.169850 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8c62-b151-43cd-9f6e-63f563cd79c8 service placement] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:18.179181 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5217731-ea51-43f2-94ec-3998ff0632dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:18.179865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5217731-ea51-43f2-94ec-3998ff0632dc service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:18.180323 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5217731-ea51-43f2-94ec-3998ff0632dc service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:18.180700 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5217731-ea51-43f2-94ec-3998ff0632dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:18.183638 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e5217731-ea51-43f2-94ec-3998ff0632dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:18.197493 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5217731-ea51-43f2-94ec-3998ff0632dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:18.199135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5217731-ea51-43f2-94ec-3998ff0632dc service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:18.216757 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1169/2294] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:18.896856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbcc20-a9cc-4c1f-a513-5766e49d50fe None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:18.898403 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-1edbcc20-a9cc-4c1f-a513-5766e49d50fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:18.915287 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbcc20-a9cc-4c1f-a513-5766e49d50fe None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:18.921399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a188d-c707-4c50-aa58-903319933519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:18.922047 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a188d-c707-4c50-aa58-903319933519 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:18.922525 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a188d-c707-4c50-aa58-903319933519 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:18.922803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a188d-c707-4c50-aa58-903319933519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:18.924682 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d09a188d-c707-4c50-aa58-903319933519 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:18.955676 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5217731-ea51-43f2-94ec-3998ff0632dc service nova] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:18.957727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e5217731-ea51-43f2-94ec-3998ff0632dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:18.992333 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a188d-c707-4c50-aa58-903319933519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:18.994176 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a188d-c707-4c50-aa58-903319933519 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:19.005334 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1126/2295] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:19.077265 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5217731-ea51-43f2-94ec-3998ff0632dc service nova] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:19.083015 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491e52a-e47e-4032-909d-c9b40e15f887 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:19.087229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491e52a-e47e-4032-909d-c9b40e15f887 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:19.087711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491e52a-e47e-4032-909d-c9b40e15f887 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:19.088146 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491e52a-e47e-4032-909d-c9b40e15f887 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:19.090447 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-6491e52a-e47e-4032-909d-c9b40e15f887 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:19.237289 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491e52a-e47e-4032-909d-c9b40e15f887 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:19.240755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491e52a-e47e-4032-909d-c9b40e15f887 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:19.263230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1170/2296] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:05:22.511696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a188d-c707-4c50-aa58-903319933519 service nova] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:22.526301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a188d-c707-4c50-aa58-903319933519 service nova] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:22.532467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30de60-1352-41bd-82d8-c27ff7e76895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:22.533556 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30de60-1352-41bd-82d8-c27ff7e76895 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:22.533838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30de60-1352-41bd-82d8-c27ff7e76895 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:22.534111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30de60-1352-41bd-82d8-c27ff7e76895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:22.536310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0c30de60-1352-41bd-82d8-c27ff7e76895 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:22.576329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30de60-1352-41bd-82d8-c27ff7e76895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:22.578199 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30de60-1352-41bd-82d8-c27ff7e76895 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:22.590576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1127/2297] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:32.845054 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491e52a-e47e-4032-909d-c9b40e15f887 service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:32.855041 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491e52a-e47e-4032-909d-c9b40e15f887 service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:32.858649 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cace4-35d7-4ae7-9399-5f6bec1a0552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:32.859292 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cace4-35d7-4ae7-9399-5f6bec1a0552 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:32.859574 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cace4-35d7-4ae7-9399-5f6bec1a0552 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:32.859870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cace4-35d7-4ae7-9399-5f6bec1a0552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:32.861783 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-183cace4-35d7-4ae7-9399-5f6bec1a0552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:32.925013 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cace4-35d7-4ae7-9399-5f6bec1a0552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:32.926928 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cace4-35d7-4ae7-9399-5f6bec1a0552 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:32.937198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1171/2298] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:05:34.852452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30de60-1352-41bd-82d8-c27ff7e76895 service nova] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:34.866984 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30de60-1352-41bd-82d8-c27ff7e76895 service nova] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:34.874102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721b96b-9014-4335-a0c6-f0c250c7f3e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:34.876789 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721b96b-9014-4335-a0c6-f0c250c7f3e3 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:34.877246 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721b96b-9014-4335-a0c6-f0c250c7f3e3 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:34.877701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721b96b-9014-4335-a0c6-f0c250c7f3e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:34.879788 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-f721b96b-9014-4335-a0c6-f0c250c7f3e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:34.893372 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721b96b-9014-4335-a0c6-f0c250c7f3e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:34.896650 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721b96b-9014-4335-a0c6-f0c250c7f3e3 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:34.909203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1128/2299] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:36.999405 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cace4-35d7-4ae7-9399-5f6bec1a0552 service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:37.001637 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-183cace4-35d7-4ae7-9399-5f6bec1a0552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:37.027426 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cace4-35d7-4ae7-9399-5f6bec1a0552 service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:37.033443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c38566-1199-45c3-ad0c-bc400aeaad40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:37.034944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c38566-1199-45c3-ad0c-bc400aeaad40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:37.035413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c38566-1199-45c3-ad0c-bc400aeaad40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:37.035858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c38566-1199-45c3-ad0c-bc400aeaad40 admin admin] PATH_INFO: `/v3/users/bd14de0fd51c4fd89d9875b9c47100cc` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:37.037392 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c38566-1199-45c3-ad0c-bc400aeaad40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd14de0fd51c4fd89d9875b9c47100cc)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:37.039517 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c38566-1199-45c3-ad0c-bc400aeaad40 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:37.094465 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-88c38566-1199-45c3-ad0c-bc400aeaad40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd14de0fd51c4fd89d9875b9c47100cc'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:37.106894 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-88c38566-1199-45c3-ad0c-bc400aeaad40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd14de0fd51c4fd89d9875b9c47100cc'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:37.113874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-88c38566-1199-45c3-ad0c-bc400aeaad40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd14de0fd51c4fd89d9875b9c47100cc'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:37.114594 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-88c38566-1199-45c3-ad0c-bc400aeaad40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd14de0fd51c4fd89d9875b9c47100cc'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:37.122833 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-88c38566-1199-45c3-ad0c-bc400aeaad40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd14de0fd51c4fd89d9875b9c47100cc'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:37.128904 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1172/2300] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:05:36 2022] DELETE /identity/v3/users/bd14de0fd51c4fd89d9875b9c47100cc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:05:37.320723 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721b96b-9014-4335-a0c6-f0c250c7f3e3 service nova] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:37.332918 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721b96b-9014-4335-a0c6-f0c250c7f3e3 service nova] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:37.401227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c853b-84bd-4281-a9d3-45031669316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:37.402083 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c853b-84bd-4281-a9d3-45031669316a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:37.402363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c853b-84bd-4281-a9d3-45031669316a admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:37.402639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c853b-84bd-4281-a9d3-45031669316a admin admin] PATH_INFO: `/v3/projects/368287ad726146f88559c73a86e4b26d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:37.403817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c853b-84bd-4281-a9d3-45031669316a admin admin] RBAC: Authorizing `identity:delete_project(project_id=368287ad726146f88559c73a86e4b26d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:37.405761 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c853b-84bd-4281-a9d3-45031669316a admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:37.451614 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-644c853b-84bd-4281-a9d3-45031669316a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '368287ad726146f88559c73a86e4b26d', 'request_id': 'req-644c853b-84bd-4281-a9d3-45031669316a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:37.458764 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-644c853b-84bd-4281-a9d3-45031669316a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '368287ad726146f88559c73a86e4b26d', 'request_id': 'req-644c853b-84bd-4281-a9d3-45031669316a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:37.465747 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-644c853b-84bd-4281-a9d3-45031669316a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '368287ad726146f88559c73a86e4b26d', 'request_id': 'req-644c853b-84bd-4281-a9d3-45031669316a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:37.483469 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-644c853b-84bd-4281-a9d3-45031669316a admin admin] The token cache is being invalidate because project 368287ad726146f88559c73a86e4b26d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:05:37.483754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-644c853b-84bd-4281-a9d3-45031669316a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:37.484917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-644c853b-84bd-4281-a9d3-45031669316a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:37.489784 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1129/2301] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:05:37 2022] DELETE /identity/v3/projects/368287ad726146f88559c73a86e4b26d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:37.491262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1da8b-6d59-4504-b2ba-946fe8ee389d None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:37.491549 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1da8b-6d59-4504-b2ba-946fe8ee389d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:37.491823 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1da8b-6d59-4504-b2ba-946fe8ee389d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:37.509991 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-76a1da8b-6d59-4504-b2ba-946fe8ee389d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:37.511158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-76a1da8b-6d59-4504-b2ba-946fe8ee389d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:37.568739 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1173/2302] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:37.576390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a451035-5682-4d21-b2db-bc22b974cebc None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:37.576722 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a451035-5682-4d21-b2db-bc22b974cebc None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:37.577003 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a451035-5682-4d21-b2db-bc22b974cebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:37.596020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-0a451035-5682-4d21-b2db-bc22b974cebc None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:37.597305 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0a451035-5682-4d21-b2db-bc22b974cebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:37.605802 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1130/2303] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:37.609898 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1da8b-6d59-4504-b2ba-946fe8ee389d None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:37.619421 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1da8b-6d59-4504-b2ba-946fe8ee389d None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:37.623993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c60401-ab7f-411b-ab76-fe8dec1f5b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:37.624670 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c60401-ab7f-411b-ab76-fe8dec1f5b00 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:37.624962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c60401-ab7f-411b-ab76-fe8dec1f5b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:37.625219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c60401-ab7f-411b-ab76-fe8dec1f5b00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:37.625928 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c60401-ab7f-411b-ab76-fe8dec1f5b00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:05:37.626226 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c60401-ab7f-411b-ab76-fe8dec1f5b00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:37.627783 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c60401-ab7f-411b-ab76-fe8dec1f5b00 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:37.642745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1174/2304] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:05:37.644955 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a451035-5682-4d21-b2db-bc22b974cebc None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:37.653899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a451035-5682-4d21-b2db-bc22b974cebc None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:37.658604 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e400c-52ac-4ed7-8421-98d7229da9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:37.659276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e400c-52ac-4ed7-8421-98d7229da9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:37.659545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e400c-52ac-4ed7-8421-98d7229da9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:37.659818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e400c-52ac-4ed7-8421-98d7229da9f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:37.660553 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e400c-52ac-4ed7-8421-98d7229da9f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:37.662428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e400c-52ac-4ed7-8421-98d7229da9f8 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:37.692224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1131/2305] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:05:37 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:05:37.697016 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c60401-ab7f-411b-ab76-fe8dec1f5b00 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:37.708705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c60401-ab7f-411b-ab76-fe8dec1f5b00 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:37.763959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da0e20-182f-43e6-8a47-392b6e92c300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:37.764588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da0e20-182f-43e6-8a47-392b6e92c300 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:37.764890 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da0e20-182f-43e6-8a47-392b6e92c300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:37.765145 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da0e20-182f-43e6-8a47-392b6e92c300 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:37.765828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da0e20-182f-43e6-8a47-392b6e92c300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:37.767721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da0e20-182f-43e6-8a47-392b6e92c300 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:37.786920 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1175/2306] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:05:37 2022] POST /identity/v3/users => generated 303 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:05:37.791045 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e400c-52ac-4ed7-8421-98d7229da9f8 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:37.801701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e400c-52ac-4ed7-8421-98d7229da9f8 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:37.806295 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f57d8-b904-4dc1-ac51-ef9fa5235c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:37.806936 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f57d8-b904-4dc1-ac51-ef9fa5235c14 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:37.807217 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f57d8-b904-4dc1-ac51-ef9fa5235c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:37.807493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f57d8-b904-4dc1-ac51-ef9fa5235c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:37.808244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f57d8-b904-4dc1-ac51-ef9fa5235c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:37.809824 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f57d8-b904-4dc1-ac51-ef9fa5235c14 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:37.820519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1132/2307] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:37.824284 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da0e20-182f-43e6-8a47-392b6e92c300 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:37.834041 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da0e20-182f-43e6-8a47-392b6e92c300 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:37.838592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b85f2-2bd0-485c-9a17-595e9699b1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:37.839236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b85f2-2bd0-485c-9a17-595e9699b1aa admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:37.839518 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b85f2-2bd0-485c-9a17-595e9699b1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:37.839793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b85f2-2bd0-485c-9a17-595e9699b1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:37.840542 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b85f2-2bd0-485c-9a17-595e9699b1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:37.842115 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b85f2-2bd0-485c-9a17-595e9699b1aa admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:37.851795 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1176/2308] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:37.855719 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f57d8-b904-4dc1-ac51-ef9fa5235c14 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:37.865987 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f57d8-b904-4dc1-ac51-ef9fa5235c14 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:37.870572 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053573c-303a-43b1-b6a2-38df2773c63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:37.871434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053573c-303a-43b1-b6a2-38df2773c63c admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:37.871717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053573c-303a-43b1-b6a2-38df2773c63c admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:37.871993 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053573c-303a-43b1-b6a2-38df2773c63c admin admin] PATH_INFO: `/v3/projects/5f51c41a6af74bd480e9883dc7082b2e/users/cc6e82600af64fc58f0bb971b3c53302/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:37.886875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053573c-303a-43b1-b6a2-38df2773c63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f51c41a6af74bd480e9883dc7082b2e, user_id=cc6e82600af64fc58f0bb971b3c53302, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:37.889539 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053573c-303a-43b1-b6a2-38df2773c63c admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:37.903821 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1133/2309] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:05:37 2022] PUT /identity/v3/projects/5f51c41a6af74bd480e9883dc7082b2e/users/cc6e82600af64fc58f0bb971b3c53302/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:37.914239 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194c617-0305-46cd-9008-ec658a351004 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:37.914528 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194c617-0305-46cd-9008-ec658a351004 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:37.914822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194c617-0305-46cd-9008-ec658a351004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:37.941794 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-6194c617-0305-46cd-9008-ec658a351004 None None] MFA Rules not processed for user `cc6e82600af64fc58f0bb971b3c53302`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:37.942977 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-6194c617-0305-46cd-9008-ec658a351004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:38.008024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1177/2310] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:37 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:38.012505 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053573c-303a-43b1-b6a2-38df2773c63c admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:38.072436 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053573c-303a-43b1-b6a2-38df2773c63c admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:38.077186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f80e3-a379-478b-9dbc-cafe2ee7ecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:38.077830 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f80e3-a379-478b-9dbc-cafe2ee7ecf9 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:38.078108 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f80e3-a379-478b-9dbc-cafe2ee7ecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:38.078384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f80e3-a379-478b-9dbc-cafe2ee7ecf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:38.079066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f80e3-a379-478b-9dbc-cafe2ee7ecf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:38.080993 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f80e3-a379-478b-9dbc-cafe2ee7ecf9 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:38.105187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1134/2311] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:05:38 2022] POST /identity/v3/projects => generated 403 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:05:38.109137 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194c617-0305-46cd-9008-ec658a351004 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:38.120230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194c617-0305-46cd-9008-ec658a351004 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:38.173412 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76563103-ce08-4624-8060-53d4f063071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:38.174075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76563103-ce08-4624-8060-53d4f063071a admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:38.174353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76563103-ce08-4624-8060-53d4f063071a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:38.174684 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76563103-ce08-4624-8060-53d4f063071a admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:38.175921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76563103-ce08-4624-8060-53d4f063071a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:38.177852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76563103-ce08-4624-8060-53d4f063071a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:38.195664 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1178/2312] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:05:38 2022] POST /identity/v3/users => generated 308 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:05:38.199518 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f80e3-a379-478b-9dbc-cafe2ee7ecf9 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:38.209780 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f80e3-a379-478b-9dbc-cafe2ee7ecf9 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:38.214461 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0c59b-c6b9-436e-b6af-3f09b8925fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:38.215105 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0c59b-c6b9-436e-b6af-3f09b8925fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:38.215385 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0c59b-c6b9-436e-b6af-3f09b8925fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:38.215664 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0c59b-c6b9-436e-b6af-3f09b8925fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:38.216399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0c59b-c6b9-436e-b6af-3f09b8925fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:38.217981 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0c59b-c6b9-436e-b6af-3f09b8925fb4 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:38.228786 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1135/2313] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:38.232774 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76563103-ce08-4624-8060-53d4f063071a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:38.243090 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76563103-ce08-4624-8060-53d4f063071a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:38.247734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5d5fc-0dca-4ba5-96f9-fe54ad4e3928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:38.248808 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5d5fc-0dca-4ba5-96f9-fe54ad4e3928 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:38.249096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5d5fc-0dca-4ba5-96f9-fe54ad4e3928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:38.249372 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5d5fc-0dca-4ba5-96f9-fe54ad4e3928 admin admin] PATH_INFO: `/v3/projects/ed1e3efb18f5478cafe00f3ca6cffd7d/users/4837f229d37e4ec9bcfe6c08293e08b9/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:38.263828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5d5fc-0dca-4ba5-96f9-fe54ad4e3928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1e3efb18f5478cafe00f3ca6cffd7d, user_id=4837f229d37e4ec9bcfe6c08293e08b9, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:38.266533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5d5fc-0dca-4ba5-96f9-fe54ad4e3928 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:38.280438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1179/2314] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:05:38 2022] PUT /identity/v3/projects/ed1e3efb18f5478cafe00f3ca6cffd7d/users/4837f229d37e4ec9bcfe6c08293e08b9/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:05:38.284798 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0c59b-c6b9-436e-b6af-3f09b8925fb4 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:38.294422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0c59b-c6b9-436e-b6af-3f09b8925fb4 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:38.355703 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec4bb7-a505-4a6b-b239-d88d802ff6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:38.356466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec4bb7-a505-4a6b-b239-d88d802ff6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:38.356653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec4bb7-a505-4a6b-b239-d88d802ff6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:38.356924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec4bb7-a505-4a6b-b239-d88d802ff6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:38.357631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec4bb7-a505-4a6b-b239-d88d802ff6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:38.359212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec4bb7-a505-4a6b-b239-d88d802ff6a7 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:38.369578 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1136/2315] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:38.373765 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5d5fc-0dca-4ba5-96f9-fe54ad4e3928 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:38.383943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5d5fc-0dca-4ba5-96f9-fe54ad4e3928 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:38.388654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205784e5-e18d-4ded-80dd-71f3d8e298cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:38.389534 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205784e5-e18d-4ded-80dd-71f3d8e298cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:38.389817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205784e5-e18d-4ded-80dd-71f3d8e298cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:38.390081 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205784e5-e18d-4ded-80dd-71f3d8e298cb admin admin] PATH_INFO: `/v3/projects/ed1e3efb18f5478cafe00f3ca6cffd7d/users/4837f229d37e4ec9bcfe6c08293e08b9/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:38.392058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205784e5-e18d-4ded-80dd-71f3d8e298cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1e3efb18f5478cafe00f3ca6cffd7d, user_id=4837f229d37e4ec9bcfe6c08293e08b9, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:38.394996 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205784e5-e18d-4ded-80dd-71f3d8e298cb admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:38.404992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1180/2316] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:05:38 2022] PUT /identity/v3/projects/ed1e3efb18f5478cafe00f3ca6cffd7d/users/4837f229d37e4ec9bcfe6c08293e08b9/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:38.416714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd85d4f-daed-49ca-9c52-84ab7ea3fc53 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:38.417002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd85d4f-daed-49ca-9c52-84ab7ea3fc53 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:38.417283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd85d4f-daed-49ca-9c52-84ab7ea3fc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:38.442847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-5fd85d4f-daed-49ca-9c52-84ab7ea3fc53 None None] MFA Rules not processed for user `4837f229d37e4ec9bcfe6c08293e08b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:38.444026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-5fd85d4f-daed-49ca-9c52-84ab7ea3fc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:38.508001 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1137/2317] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:38 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:38.519279 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205784e5-e18d-4ded-80dd-71f3d8e298cb admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:38.521010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-205784e5-e18d-4ded-80dd-71f3d8e298cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:38.576108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205784e5-e18d-4ded-80dd-71f3d8e298cb admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:38.579730 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff74eed-2b56-46fd-ae96-adfa19ac291a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:38.580391 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff74eed-2b56-46fd-ae96-adfa19ac291a service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:38.580675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff74eed-2b56-46fd-ae96-adfa19ac291a service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:38.580952 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff74eed-2b56-46fd-ae96-adfa19ac291a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:38.590307 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff74eed-2b56-46fd-ae96-adfa19ac291a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:38.591703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff74eed-2b56-46fd-ae96-adfa19ac291a service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:38.601974 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1181/2318] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:38 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:38.760402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd85d4f-daed-49ca-9c52-84ab7ea3fc53 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:38.824033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd85d4f-daed-49ca-9c52-84ab7ea3fc53 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:38.828592 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b5dc2-8097-4a7d-ad22-a71cb0ad90ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:38.829394 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b5dc2-8097-4a7d-ad22-a71cb0ad90ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:38.829671 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b5dc2-8097-4a7d-ad22-a71cb0ad90ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:38.829943 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b5dc2-8097-4a7d-ad22-a71cb0ad90ee admin admin] PATH_INFO: `/v3/users/cc6e82600af64fc58f0bb971b3c53302` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:38.831763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b5dc2-8097-4a7d-ad22-a71cb0ad90ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc6e82600af64fc58f0bb971b3c53302)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:38.833751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b5dc2-8097-4a7d-ad22-a71cb0ad90ee admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:38.879382 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-016b5dc2-8097-4a7d-ad22-a71cb0ad90ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc6e82600af64fc58f0bb971b3c53302'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:38.880021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-016b5dc2-8097-4a7d-ad22-a71cb0ad90ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc6e82600af64fc58f0bb971b3c53302'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:38.891085 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-016b5dc2-8097-4a7d-ad22-a71cb0ad90ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc6e82600af64fc58f0bb971b3c53302'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:38.898583 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-016b5dc2-8097-4a7d-ad22-a71cb0ad90ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc6e82600af64fc58f0bb971b3c53302'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:38.899284 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-016b5dc2-8097-4a7d-ad22-a71cb0ad90ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc6e82600af64fc58f0bb971b3c53302'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:38.911100 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1138/2319] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:05:38 2022] DELETE /identity/v3/users/cc6e82600af64fc58f0bb971b3c53302 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:38.915607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3bdeb-7fb2-451c-8cd9-1df8cc69facc None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:38.915895 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3bdeb-7fb2-451c-8cd9-1df8cc69facc None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:38.916188 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3bdeb-7fb2-451c-8cd9-1df8cc69facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:38.932893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-35e3bdeb-7fb2-451c-8cd9-1df8cc69facc None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:38.934068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-35e3bdeb-7fb2-451c-8cd9-1df8cc69facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:38.993530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1182/2320] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:05:39.003674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b5dc2-8097-4a7d-ad22-a71cb0ad90ee admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:39.005076 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-016b5dc2-8097-4a7d-ad22-a71cb0ad90ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:39.069221 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b5dc2-8097-4a7d-ad22-a71cb0ad90ee admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:39.073272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2b2da-c858-4037-9a14-55c7dc9733a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:39.073913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2b2da-c858-4037-9a14-55c7dc9733a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:39.074196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2b2da-c858-4037-9a14-55c7dc9733a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:39.074472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2b2da-c858-4037-9a14-55c7dc9733a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:39.084145 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2b2da-c858-4037-9a14-55c7dc9733a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:39.085560 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2b2da-c858-4037-9a14-55c7dc9733a0 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:39.094759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1139/2321] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:05:39.362886 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3bdeb-7fb2-451c-8cd9-1df8cc69facc None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:39.364475 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-35e3bdeb-7fb2-451c-8cd9-1df8cc69facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:39.378800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3bdeb-7fb2-451c-8cd9-1df8cc69facc None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:39.383775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99884881-ac44-43fa-a131-7cc0c69a0f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:39.384763 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99884881-ac44-43fa-a131-7cc0c69a0f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:39.385044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99884881-ac44-43fa-a131-7cc0c69a0f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:39.385321 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99884881-ac44-43fa-a131-7cc0c69a0f9a admin admin] PATH_INFO: `/v3/projects/5f51c41a6af74bd480e9883dc7082b2e` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:39.386553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99884881-ac44-43fa-a131-7cc0c69a0f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f51c41a6af74bd480e9883dc7082b2e)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:39.388486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99884881-ac44-43fa-a131-7cc0c69a0f9a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:39.436712 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-99884881-ac44-43fa-a131-7cc0c69a0f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f51c41a6af74bd480e9883dc7082b2e', 'request_id': 'req-99884881-ac44-43fa-a131-7cc0c69a0f9a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:39.444597 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-99884881-ac44-43fa-a131-7cc0c69a0f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f51c41a6af74bd480e9883dc7082b2e', 'request_id': 'req-99884881-ac44-43fa-a131-7cc0c69a0f9a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:39.450010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-99884881-ac44-43fa-a131-7cc0c69a0f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f51c41a6af74bd480e9883dc7082b2e', 'request_id': 'req-99884881-ac44-43fa-a131-7cc0c69a0f9a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:39.460792 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-99884881-ac44-43fa-a131-7cc0c69a0f9a admin admin] The token cache is being invalidate because project 5f51c41a6af74bd480e9883dc7082b2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:05:39.461076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-99884881-ac44-43fa-a131-7cc0c69a0f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:39.461698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-99884881-ac44-43fa-a131-7cc0c69a0f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:39.463280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1183/2322] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:05:39 2022] DELETE /identity/v3/projects/5f51c41a6af74bd480e9883dc7082b2e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:05:39.467261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2b2da-c858-4037-9a14-55c7dc9733a0 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:39.476856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2b2da-c858-4037-9a14-55c7dc9733a0 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:39.531048 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eee5f2-3bed-4ee0-958c-453b3eeecb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:39.531900 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eee5f2-3bed-4ee0-958c-453b3eeecb09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:39.532214 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eee5f2-3bed-4ee0-958c-453b3eeecb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:39.532500 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eee5f2-3bed-4ee0-958c-453b3eeecb09 admin admin] PATH_INFO: `/v3/users/4837f229d37e4ec9bcfe6c08293e08b9` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:39.533678 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eee5f2-3bed-4ee0-958c-453b3eeecb09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4837f229d37e4ec9bcfe6c08293e08b9)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:39.536092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eee5f2-3bed-4ee0-958c-453b3eeecb09 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:39.578963 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-e9eee5f2-3bed-4ee0-958c-453b3eeecb09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4837f229d37e4ec9bcfe6c08293e08b9'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:39.579591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-e9eee5f2-3bed-4ee0-958c-453b3eeecb09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4837f229d37e4ec9bcfe6c08293e08b9'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:39.590812 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-e9eee5f2-3bed-4ee0-958c-453b3eeecb09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4837f229d37e4ec9bcfe6c08293e08b9'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:39.598461 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-e9eee5f2-3bed-4ee0-958c-453b3eeecb09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4837f229d37e4ec9bcfe6c08293e08b9'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:39.599080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-e9eee5f2-3bed-4ee0-958c-453b3eeecb09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4837f229d37e4ec9bcfe6c08293e08b9'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:39.610856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1140/2323] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:05:39 2022] DELETE /identity/v3/users/4837f229d37e4ec9bcfe6c08293e08b9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:39.871563 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99884881-ac44-43fa-a131-7cc0c69a0f9a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:39.873420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-99884881-ac44-43fa-a131-7cc0c69a0f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:39.889504 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99884881-ac44-43fa-a131-7cc0c69a0f9a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:39.951152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e51e0-3b92-4d5b-a63a-dc2e94116a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:39.952105 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e51e0-3b92-4d5b-a63a-dc2e94116a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:39.952434 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e51e0-3b92-4d5b-a63a-dc2e94116a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:39.952707 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e51e0-3b92-4d5b-a63a-dc2e94116a68 admin admin] PATH_INFO: `/v3/projects/ed1e3efb18f5478cafe00f3ca6cffd7d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:39.953870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e51e0-3b92-4d5b-a63a-dc2e94116a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed1e3efb18f5478cafe00f3ca6cffd7d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:39.955780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e51e0-3b92-4d5b-a63a-dc2e94116a68 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:40.002439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-7a2e51e0-3b92-4d5b-a63a-dc2e94116a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed1e3efb18f5478cafe00f3ca6cffd7d', 'request_id': 'req-7a2e51e0-3b92-4d5b-a63a-dc2e94116a68'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:40.009968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-7a2e51e0-3b92-4d5b-a63a-dc2e94116a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed1e3efb18f5478cafe00f3ca6cffd7d', 'request_id': 'req-7a2e51e0-3b92-4d5b-a63a-dc2e94116a68'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:40.016153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-7a2e51e0-3b92-4d5b-a63a-dc2e94116a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed1e3efb18f5478cafe00f3ca6cffd7d', 'request_id': 'req-7a2e51e0-3b92-4d5b-a63a-dc2e94116a68'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:40.028622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-7a2e51e0-3b92-4d5b-a63a-dc2e94116a68 admin admin] The token cache is being invalidate because project ed1e3efb18f5478cafe00f3ca6cffd7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:05:40.028909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-7a2e51e0-3b92-4d5b-a63a-dc2e94116a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:40.029573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-7a2e51e0-3b92-4d5b-a63a-dc2e94116a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:40.031363 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1184/2324] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:05:39 2022] DELETE /identity/v3/projects/ed1e3efb18f5478cafe00f3ca6cffd7d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:40.036817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81246d3e-d64b-4a50-abd0-05220437e1f5 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:40.037109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81246d3e-d64b-4a50-abd0-05220437e1f5 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:40.037535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81246d3e-d64b-4a50-abd0-05220437e1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:40.057250 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-81246d3e-d64b-4a50-abd0-05220437e1f5 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:40.058425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-81246d3e-d64b-4a50-abd0-05220437e1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:40.115189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1141/2325] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:40.122675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bebd7-15cf-4404-9626-68e48ad28b66 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:40.122961 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bebd7-15cf-4404-9626-68e48ad28b66 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:40.123235 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bebd7-15cf-4404-9626-68e48ad28b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:40.141055 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-667bebd7-15cf-4404-9626-68e48ad28b66 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:40.142235 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-667bebd7-15cf-4404-9626-68e48ad28b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:40.151071 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1185/2326] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:40.160985 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81246d3e-d64b-4a50-abd0-05220437e1f5 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:40.170563 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81246d3e-d64b-4a50-abd0-05220437e1f5 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:40.175702 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89df45-7968-4913-8e81-da4de515a324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:40.176386 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89df45-7968-4913-8e81-da4de515a324 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:40.176669 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89df45-7968-4913-8e81-da4de515a324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:40.176946 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89df45-7968-4913-8e81-da4de515a324 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:40.177659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89df45-7968-4913-8e81-da4de515a324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:05:40.177964 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89df45-7968-4913-8e81-da4de515a324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:40.179551 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89df45-7968-4913-8e81-da4de515a324 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:40.191272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1142/2327] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:05:40.195488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bebd7-15cf-4404-9626-68e48ad28b66 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:40.204525 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bebd7-15cf-4404-9626-68e48ad28b66 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:40.209212 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56484e-ac45-4341-a720-2f13f0971585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:40.209853 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56484e-ac45-4341-a720-2f13f0971585 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:40.210134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56484e-ac45-4341-a720-2f13f0971585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:40.210407 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56484e-ac45-4341-a720-2f13f0971585 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:40.211093 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56484e-ac45-4341-a720-2f13f0971585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:40.212997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56484e-ac45-4341-a720-2f13f0971585 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:40.237889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1186/2328] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:05:40 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:05:40.242285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89df45-7968-4913-8e81-da4de515a324 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:40.253729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89df45-7968-4913-8e81-da4de515a324 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:40.307909 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ab2e0-e328-47cd-8214-9314004d4f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:40.308602 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ab2e0-e328-47cd-8214-9314004d4f24 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:40.308883 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ab2e0-e328-47cd-8214-9314004d4f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:40.309160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ab2e0-e328-47cd-8214-9314004d4f24 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:40.309857 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ab2e0-e328-47cd-8214-9314004d4f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:40.311894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ab2e0-e328-47cd-8214-9314004d4f24 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:40.332496 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1143/2329] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:05:40 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:05:40.335036 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56484e-ac45-4341-a720-2f13f0971585 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:40.345132 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56484e-ac45-4341-a720-2f13f0971585 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:40.350305 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87d14e-2dc1-4010-b828-8e4d85153381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:40.350956 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87d14e-2dc1-4010-b828-8e4d85153381 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:40.351239 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87d14e-2dc1-4010-b828-8e4d85153381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:40.351516 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87d14e-2dc1-4010-b828-8e4d85153381 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:40.352272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87d14e-2dc1-4010-b828-8e4d85153381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:40.353847 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87d14e-2dc1-4010-b828-8e4d85153381 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:40.364623 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1187/2330] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:40.368667 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ab2e0-e328-47cd-8214-9314004d4f24 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:40.378472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ab2e0-e328-47cd-8214-9314004d4f24 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:40.383106 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee3adb-3e3a-4bf8-98b7-c9092c3c105b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:40.383814 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee3adb-3e3a-4bf8-98b7-c9092c3c105b admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:40.384013 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee3adb-3e3a-4bf8-98b7-c9092c3c105b admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:40.384332 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee3adb-3e3a-4bf8-98b7-c9092c3c105b admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:40.385033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee3adb-3e3a-4bf8-98b7-c9092c3c105b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:40.386615 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee3adb-3e3a-4bf8-98b7-c9092c3c105b admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:40.397596 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1144/2331] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:40.401653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87d14e-2dc1-4010-b828-8e4d85153381 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:40.412049 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87d14e-2dc1-4010-b828-8e4d85153381 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:40.416951 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956be728-b6cd-414d-b026-34b2cea21130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:40.417824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956be728-b6cd-414d-b026-34b2cea21130 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:40.418102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956be728-b6cd-414d-b026-34b2cea21130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:40.418370 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956be728-b6cd-414d-b026-34b2cea21130 admin admin] PATH_INFO: `/v3/projects/cdfb20b49d2e401e9ef81fb694484ee1/users/83eb73648b744fa0af9c96d48b6a321c/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:40.432990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956be728-b6cd-414d-b026-34b2cea21130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfb20b49d2e401e9ef81fb694484ee1, user_id=83eb73648b744fa0af9c96d48b6a321c, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:40.435907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956be728-b6cd-414d-b026-34b2cea21130 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:40.448374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1188/2332] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:05:40 2022] PUT /identity/v3/projects/cdfb20b49d2e401e9ef81fb694484ee1/users/83eb73648b744fa0af9c96d48b6a321c/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:05:40.458336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8783d3-0415-4343-9325-b24523728a98 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:40.458745 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8783d3-0415-4343-9325-b24523728a98 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:40.459021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8783d3-0415-4343-9325-b24523728a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:40.486179 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-dd8783d3-0415-4343-9325-b24523728a98 None None] MFA Rules not processed for user `83eb73648b744fa0af9c96d48b6a321c`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:40.487908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-dd8783d3-0415-4343-9325-b24523728a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:40.549474 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1145/2333] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:40.554473 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956be728-b6cd-414d-b026-34b2cea21130 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:40.617397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956be728-b6cd-414d-b026-34b2cea21130 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:40.622252 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff00396-14fb-495b-a3d9-ee4c43babe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:40.622904 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff00396-14fb-495b-a3d9-ee4c43babe81 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:40.623189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff00396-14fb-495b-a3d9-ee4c43babe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:40.623462 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff00396-14fb-495b-a3d9-ee4c43babe81 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:40.624156 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff00396-14fb-495b-a3d9-ee4c43babe81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:40.626444 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff00396-14fb-495b-a3d9-ee4c43babe81 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:40.651252 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1189/2334] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:05:40 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:05:40.655224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8783d3-0415-4343-9325-b24523728a98 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:40.669351 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8783d3-0415-4343-9325-b24523728a98 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:40.734452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad3d81-0735-4359-8e81-1f807089b589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:40.735439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad3d81-0735-4359-8e81-1f807089b589 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:40.735735 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad3d81-0735-4359-8e81-1f807089b589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:40.736018 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad3d81-0735-4359-8e81-1f807089b589 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:40.737371 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad3d81-0735-4359-8e81-1f807089b589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:40.739282 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad3d81-0735-4359-8e81-1f807089b589 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:40.768255 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1146/2335] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:05:40 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:05:40.770270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff00396-14fb-495b-a3d9-ee4c43babe81 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:40.782574 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff00396-14fb-495b-a3d9-ee4c43babe81 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:40.787817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af083111-4827-4199-8b40-d0b40e76b5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:40.788516 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af083111-4827-4199-8b40-d0b40e76b5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:40.788794 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af083111-4827-4199-8b40-d0b40e76b5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:40.789067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af083111-4827-4199-8b40-d0b40e76b5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:40.789786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af083111-4827-4199-8b40-d0b40e76b5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:40.791351 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af083111-4827-4199-8b40-d0b40e76b5a9 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:40.802780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1190/2336] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:40.806758 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad3d81-0735-4359-8e81-1f807089b589 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:40.816917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad3d81-0735-4359-8e81-1f807089b589 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:40.823020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0bd3f-1672-4134-bde1-963e78b17c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:40.823905 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0bd3f-1672-4134-bde1-963e78b17c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:40.824204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0bd3f-1672-4134-bde1-963e78b17c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:40.824481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0bd3f-1672-4134-bde1-963e78b17c40 admin admin] PATH_INFO: `/v3/projects/3fd2473402c541cab9f26c3fa2627bbe/users/bc0ba7eca05e4d7abdc8a155bbbe71a5/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:40.841871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0bd3f-1672-4134-bde1-963e78b17c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd2473402c541cab9f26c3fa2627bbe, user_id=bc0ba7eca05e4d7abdc8a155bbbe71a5, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:40.844733 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0bd3f-1672-4134-bde1-963e78b17c40 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:40.860557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1147/2337] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:05:40 2022] PUT /identity/v3/projects/3fd2473402c541cab9f26c3fa2627bbe/users/bc0ba7eca05e4d7abdc8a155bbbe71a5/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:40.864906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af083111-4827-4199-8b40-d0b40e76b5a9 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:40.876356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af083111-4827-4199-8b40-d0b40e76b5a9 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:40.899901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628a020-3935-4491-b204-ea05375eb273 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:40.900214 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628a020-3935-4491-b204-ea05375eb273 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:40.900498 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628a020-3935-4491-b204-ea05375eb273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:40.918753 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-b628a020-3935-4491-b204-ea05375eb273 None None] MFA Rules not processed for user `df5dcdfb4eda417ebc0af2432497617d`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:40.919995 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b628a020-3935-4491-b204-ea05375eb273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:40.940038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca8358-1416-409a-adc4-96b6d34d4c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:40.940793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca8358-1416-409a-adc4-96b6d34d4c2b admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:40.941081 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca8358-1416-409a-adc4-96b6d34d4c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:40.941386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca8358-1416-409a-adc4-96b6d34d4c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:40.942142 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca8358-1416-409a-adc4-96b6d34d4c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:40.943755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca8358-1416-409a-adc4-96b6d34d4c2b admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:40.953562 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1191/2338] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:40.958495 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca8358-1416-409a-adc4-96b6d34d4c2b admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:40.968487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca8358-1416-409a-adc4-96b6d34d4c2b admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:40.973905 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc9369-3717-4da5-a269-7549a89ae8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:40.974822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc9369-3717-4da5-a269-7549a89ae8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:40.975097 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc9369-3717-4da5-a269-7549a89ae8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:40.975370 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc9369-3717-4da5-a269-7549a89ae8d2 admin admin] PATH_INFO: `/v3/projects/3fd2473402c541cab9f26c3fa2627bbe/users/bc0ba7eca05e4d7abdc8a155bbbe71a5/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:40.977455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc9369-3717-4da5-a269-7549a89ae8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd2473402c541cab9f26c3fa2627bbe, user_id=bc0ba7eca05e4d7abdc8a155bbbe71a5, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:40.980189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc9369-3717-4da5-a269-7549a89ae8d2 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:40.980854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1148/2339] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 14:05:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:05:40.990647 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1192/2340] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:05:40 2022] PUT /identity/v3/projects/3fd2473402c541cab9f26c3fa2627bbe/users/bc0ba7eca05e4d7abdc8a155bbbe71a5/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:05:40.993380 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628a020-3935-4491-b204-ea05375eb273 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:40.994748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b628a020-3935-4491-b204-ea05375eb273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:41.001707 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae6668-eebd-4e52-8cd0-b627db7f9f07 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:41.001991 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae6668-eebd-4e52-8cd0-b627db7f9f07 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:41.002266 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae6668-eebd-4e52-8cd0-b627db7f9f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:41.030024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-a4ae6668-eebd-4e52-8cd0-b627db7f9f07 None None] MFA Rules not processed for user `bc0ba7eca05e4d7abdc8a155bbbe71a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:41.031256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a4ae6668-eebd-4e52-8cd0-b627db7f9f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:41.074214 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628a020-3935-4491-b204-ea05375eb273 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:41.122786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1193/2341] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:05:41.136768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae6668-eebd-4e52-8cd0-b627db7f9f07 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:41.138438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a4ae6668-eebd-4e52-8cd0-b627db7f9f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:41.162824 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860c76f-d459-4e51-b4a3-e4465c5eda16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd102155cd1bd4368ad272668da1651f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:41.163891 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860c76f-d459-4e51-b4a3-e4465c5eda16 service swift] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:41.164384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860c76f-d459-4e51-b4a3-e4465c5eda16 service swift] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:41.164831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860c76f-d459-4e51-b4a3-e4465c5eda16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:41.228947 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae6668-eebd-4e52-8cd0-b627db7f9f07 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:41.232998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860c76f-d459-4e51-b4a3-e4465c5eda16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:41.233340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795d4b9-c887-495d-9606-cc3129f54185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:41.234211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795d4b9-c887-495d-9606-cc3129f54185 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:41.234609 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795d4b9-c887-495d-9606-cc3129f54185 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:41.234724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860c76f-d459-4e51-b4a3-e4465c5eda16 service swift] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:41.235050 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795d4b9-c887-495d-9606-cc3129f54185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:41.243344 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1149/2342] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 14:05:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 14:05:41.248324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795d4b9-c887-495d-9606-cc3129f54185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:41.249761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795d4b9-c887-495d-9606-cc3129f54185 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:41.260935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1194/2343] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:41 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:05:41.312157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860c76f-d459-4e51-b4a3-e4465c5eda16 service swift] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:41.314084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-4860c76f-d459-4e51-b4a3-e4465c5eda16 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:41.326341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860c76f-d459-4e51-b4a3-e4465c5eda16 service swift] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:41.330423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d204bc7-5d05-415c-8f03-749b5e8b36cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:41.331204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d204bc7-5d05-415c-8f03-749b5e8b36cf service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:41.331517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d204bc7-5d05-415c-8f03-749b5e8b36cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:41.331862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d204bc7-5d05-415c-8f03-749b5e8b36cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:41.414596 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d204bc7-5d05-415c-8f03-749b5e8b36cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:41.416109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d204bc7-5d05-415c-8f03-749b5e8b36cf service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:41.427154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1150/2344] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:42.876057 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795d4b9-c887-495d-9606-cc3129f54185 service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:42.878940 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-3795d4b9-c887-495d-9606-cc3129f54185 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:42.999024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795d4b9-c887-495d-9606-cc3129f54185 service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:43.006239 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52c9e1-33d3-4367-93ca-3ff95ad2661c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:43.006896 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52c9e1-33d3-4367-93ca-3ff95ad2661c service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:43.007186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52c9e1-33d3-4367-93ca-3ff95ad2661c service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:43.007438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52c9e1-33d3-4367-93ca-3ff95ad2661c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:43.009442 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-5f52c9e1-33d3-4367-93ca-3ff95ad2661c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:43.023840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52c9e1-33d3-4367-93ca-3ff95ad2661c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:43.025495 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52c9e1-33d3-4367-93ca-3ff95ad2661c service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:43.037329 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1195/2345] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:44.979751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d204bc7-5d05-415c-8f03-749b5e8b36cf service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:45.053818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d204bc7-5d05-415c-8f03-749b5e8b36cf service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:45.060794 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4a739-e167-4884-870a-0a21e1a07c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:45.062012 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a739-e167-4884-870a-0a21e1a07c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:45.062158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a739-e167-4884-870a-0a21e1a07c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:45.062493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a739-e167-4884-870a-0a21e1a07c44 admin admin] PATH_INFO: `/v3/users/83eb73648b744fa0af9c96d48b6a321c` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:45.063829 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4a739-e167-4884-870a-0a21e1a07c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83eb73648b744fa0af9c96d48b6a321c)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:45.065924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4a739-e167-4884-870a-0a21e1a07c44 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:45.121292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4bb4a739-e167-4884-870a-0a21e1a07c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83eb73648b744fa0af9c96d48b6a321c'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:45.122100 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4bb4a739-e167-4884-870a-0a21e1a07c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83eb73648b744fa0af9c96d48b6a321c'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:45.134374 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4bb4a739-e167-4884-870a-0a21e1a07c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83eb73648b744fa0af9c96d48b6a321c'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:45.143765 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4bb4a739-e167-4884-870a-0a21e1a07c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83eb73648b744fa0af9c96d48b6a321c'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:45.144530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4bb4a739-e167-4884-870a-0a21e1a07c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83eb73648b744fa0af9c96d48b6a321c'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:45.157706 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1151/2346] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:05:44 2022] DELETE /identity/v3/users/83eb73648b744fa0af9c96d48b6a321c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:05:45.163364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d6f92-b3be-408c-80ad-5ca25bcc4705 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:45.163874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d6f92-b3be-408c-80ad-5ca25bcc4705 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:45.164474 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d6f92-b3be-408c-80ad-5ca25bcc4705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:45.189136 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-ce6d6f92-b3be-408c-80ad-5ca25bcc4705 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:45.190835 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ce6d6f92-b3be-408c-80ad-5ca25bcc4705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:45.209096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4a739-e167-4884-870a-0a21e1a07c44 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:45.210769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-4bb4a739-e167-4884-870a-0a21e1a07c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:45.255849 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1196/2347] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:45.266114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d6f92-b3be-408c-80ad-5ca25bcc4705 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:45.269919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ce6d6f92-b3be-408c-80ad-5ca25bcc4705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:45.298010 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4a739-e167-4884-870a-0a21e1a07c44 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:45.306379 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bd2f0-6bac-40a6-aa25-82e1fbd79eb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:45.307656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bd2f0-6bac-40a6-aa25-82e1fbd79eb4 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:45.307941 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bd2f0-6bac-40a6-aa25-82e1fbd79eb4 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:45.308252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bd2f0-6bac-40a6-aa25-82e1fbd79eb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:45.310289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-925bd2f0-6bac-40a6-aa25-82e1fbd79eb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:45.339910 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d6f92-b3be-408c-80ad-5ca25bcc4705 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:45.344492 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7e825-9e63-4e6f-a399-d8ee7b7f0552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:45.345608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7e825-9e63-4e6f-a399-d8ee7b7f0552 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:45.345896 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7e825-9e63-4e6f-a399-d8ee7b7f0552 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:45.346165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7e825-9e63-4e6f-a399-d8ee7b7f0552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:45.359503 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7e825-9e63-4e6f-a399-d8ee7b7f0552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:45.360962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7e825-9e63-4e6f-a399-d8ee7b7f0552 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:45.372268 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1197/2348] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:45.396496 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bd2f0-6bac-40a6-aa25-82e1fbd79eb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:45.398127 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bd2f0-6bac-40a6-aa25-82e1fbd79eb4 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:45.409696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1152/2349] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:45.723743 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7e825-9e63-4e6f-a399-d8ee7b7f0552 service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:45.725319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-17f7e825-9e63-4e6f-a399-d8ee7b7f0552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:45.743621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7e825-9e63-4e6f-a399-d8ee7b7f0552 service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:45.755393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:45.756438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:45.756930 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:45.757129 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263 admin admin] PATH_INFO: `/v3/projects/cdfb20b49d2e401e9ef81fb694484ee1` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:45.758488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdfb20b49d2e401e9ef81fb694484ee1)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:45.760663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:45.835619 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdfb20b49d2e401e9ef81fb694484ee1', 'request_id': 'req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:45.853760 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdfb20b49d2e401e9ef81fb694484ee1', 'request_id': 'req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:45.863173 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdfb20b49d2e401e9ef81fb694484ee1', 'request_id': 'req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:45.897137 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263 admin admin] The token cache is being invalidate because project cdfb20b49d2e401e9ef81fb694484ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:05:45.897459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:45.898255 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:45.903301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1198/2350] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:05:45 2022] DELETE /identity/v3/projects/cdfb20b49d2e401e9ef81fb694484ee1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:45.904383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bd2f0-6bac-40a6-aa25-82e1fbd79eb4 service nova] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:45.915353 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bd2f0-6bac-40a6-aa25-82e1fbd79eb4 service nova] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:46.011031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa13f2-b1f2-4817-81e7-0500c3e84415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:46.013200 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa13f2-b1f2-4817-81e7-0500c3e84415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:46.013487 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa13f2-b1f2-4817-81e7-0500c3e84415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:46.013762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa13f2-b1f2-4817-81e7-0500c3e84415 admin admin] PATH_INFO: `/v3/users/bc0ba7eca05e4d7abdc8a155bbbe71a5` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:46.015469 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa13f2-b1f2-4817-81e7-0500c3e84415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0ba7eca05e4d7abdc8a155bbbe71a5)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:46.017519 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa13f2-b1f2-4817-81e7-0500c3e84415 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:46.091935 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-11fa13f2-b1f2-4817-81e7-0500c3e84415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0ba7eca05e4d7abdc8a155bbbe71a5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:46.093082 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-11fa13f2-b1f2-4817-81e7-0500c3e84415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0ba7eca05e4d7abdc8a155bbbe71a5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:46.113656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-11fa13f2-b1f2-4817-81e7-0500c3e84415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0ba7eca05e4d7abdc8a155bbbe71a5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:46.133564 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-11fa13f2-b1f2-4817-81e7-0500c3e84415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0ba7eca05e4d7abdc8a155bbbe71a5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:46.134116 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-11fa13f2-b1f2-4817-81e7-0500c3e84415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0ba7eca05e4d7abdc8a155bbbe71a5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:46.149000 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1153/2351] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:05:45 2022] DELETE /identity/v3/users/bc0ba7eca05e4d7abdc8a155bbbe71a5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:05:46.446120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:46.448018 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:46.461587 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ea0f5-8aa8-4f4a-b2f0-3a2f32521263 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:46.546711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5df5e-577e-4c99-bccd-734640ed6b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:46.547576 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5df5e-577e-4c99-bccd-734640ed6b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:46.547858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5df5e-577e-4c99-bccd-734640ed6b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:46.548133 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5df5e-577e-4c99-bccd-734640ed6b27 admin admin] PATH_INFO: `/v3/projects/3fd2473402c541cab9f26c3fa2627bbe` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:46.549398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5df5e-577e-4c99-bccd-734640ed6b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fd2473402c541cab9f26c3fa2627bbe)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:46.551818 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5df5e-577e-4c99-bccd-734640ed6b27 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:46.613662 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-d2b5df5e-577e-4c99-bccd-734640ed6b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fd2473402c541cab9f26c3fa2627bbe', 'request_id': 'req-d2b5df5e-577e-4c99-bccd-734640ed6b27'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:46.623108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-d2b5df5e-577e-4c99-bccd-734640ed6b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fd2473402c541cab9f26c3fa2627bbe', 'request_id': 'req-d2b5df5e-577e-4c99-bccd-734640ed6b27'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:46.628616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-d2b5df5e-577e-4c99-bccd-734640ed6b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fd2473402c541cab9f26c3fa2627bbe', 'request_id': 'req-d2b5df5e-577e-4c99-bccd-734640ed6b27'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:46.640999 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-d2b5df5e-577e-4c99-bccd-734640ed6b27 admin admin] The token cache is being invalidate because project 3fd2473402c541cab9f26c3fa2627bbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:05:46.641343 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-d2b5df5e-577e-4c99-bccd-734640ed6b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:46.642107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-d2b5df5e-577e-4c99-bccd-734640ed6b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:46.644385 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1199/2352] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:05:46 2022] DELETE /identity/v3/projects/3fd2473402c541cab9f26c3fa2627bbe => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:46.648905 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d2183-7c6f-4994-bcee-ebf43cdce7b3 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:46.649288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d2183-7c6f-4994-bcee-ebf43cdce7b3 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:46.649659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d2183-7c6f-4994-bcee-ebf43cdce7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:46.668340 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-339d2183-7c6f-4994-bcee-ebf43cdce7b3 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:46.669613 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-339d2183-7c6f-4994-bcee-ebf43cdce7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:46.735982 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1154/2353] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:46.743567 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b8158-eb41-4705-b501-02d511072ea9 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:46.744047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b8158-eb41-4705-b501-02d511072ea9 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:46.744586 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b8158-eb41-4705-b501-02d511072ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:46.763153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-4f1b8158-eb41-4705-b501-02d511072ea9 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:46.764882 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-4f1b8158-eb41-4705-b501-02d511072ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:46.773739 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1200/2354] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:05:46.781070 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d2183-7c6f-4994-bcee-ebf43cdce7b3 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:46.792052 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d2183-7c6f-4994-bcee-ebf43cdce7b3 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:46.798311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a12dc-db12-4ac9-80a7-7367eb7f6950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:46.799089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a12dc-db12-4ac9-80a7-7367eb7f6950 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:46.799466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a12dc-db12-4ac9-80a7-7367eb7f6950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:46.799811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a12dc-db12-4ac9-80a7-7367eb7f6950 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:46.800672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a12dc-db12-4ac9-80a7-7367eb7f6950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:05:46.801080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a12dc-db12-4ac9-80a7-7367eb7f6950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:46.802818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a12dc-db12-4ac9-80a7-7367eb7f6950 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:46.816755 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1155/2355] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:05:46.821740 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b8158-eb41-4705-b501-02d511072ea9 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:46.832349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b8158-eb41-4705-b501-02d511072ea9 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:46.837357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f668ee7-2420-4e43-8773-256e50362b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:46.838040 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f668ee7-2420-4e43-8773-256e50362b7b admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:46.838320 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f668ee7-2420-4e43-8773-256e50362b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:46.838601 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f668ee7-2420-4e43-8773-256e50362b7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:46.839303 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f668ee7-2420-4e43-8773-256e50362b7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:46.841305 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f668ee7-2420-4e43-8773-256e50362b7b admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:46.871628 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1201/2356] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:05:46 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:05:46.876118 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a12dc-db12-4ac9-80a7-7367eb7f6950 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:46.887858 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a12dc-db12-4ac9-80a7-7367eb7f6950 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:46.974982 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931f009-2025-4d50-93cd-f946fb5e8111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:46.975656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931f009-2025-4d50-93cd-f946fb5e8111 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:46.975942 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931f009-2025-4d50-93cd-f946fb5e8111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:46.976254 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931f009-2025-4d50-93cd-f946fb5e8111 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:46.976964 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931f009-2025-4d50-93cd-f946fb5e8111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:46.978954 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931f009-2025-4d50-93cd-f946fb5e8111 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:47.003293 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1156/2357] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:05:46 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:05:47.007905 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f668ee7-2420-4e43-8773-256e50362b7b admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:47.032879 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f668ee7-2420-4e43-8773-256e50362b7b admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:47.039182 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec02188-aa75-4e4f-9990-6e8016764ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:47.039860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec02188-aa75-4e4f-9990-6e8016764ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:47.040145 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec02188-aa75-4e4f-9990-6e8016764ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:47.041678 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec02188-aa75-4e4f-9990-6e8016764ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:47.041678 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec02188-aa75-4e4f-9990-6e8016764ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:47.043357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec02188-aa75-4e4f-9990-6e8016764ee5 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:47.055838 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1202/2358] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:47.060632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931f009-2025-4d50-93cd-f946fb5e8111 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:47.072447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931f009-2025-4d50-93cd-f946fb5e8111 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:47.077806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34eed0-6add-4888-903d-7aa1bb2bbad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:47.078678 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34eed0-6add-4888-903d-7aa1bb2bbad8 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:47.079117 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34eed0-6add-4888-903d-7aa1bb2bbad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:47.079559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34eed0-6add-4888-903d-7aa1bb2bbad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:47.080300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34eed0-6add-4888-903d-7aa1bb2bbad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:47.082804 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34eed0-6add-4888-903d-7aa1bb2bbad8 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:47.093761 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1157/2359] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:47.097962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec02188-aa75-4e4f-9990-6e8016764ee5 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:47.108159 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec02188-aa75-4e4f-9990-6e8016764ee5 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:47.115480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff6b05-3a6f-4bc6-86be-b63c2f919cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:47.116423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff6b05-3a6f-4bc6-86be-b63c2f919cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:47.116696 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff6b05-3a6f-4bc6-86be-b63c2f919cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:47.116971 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff6b05-3a6f-4bc6-86be-b63c2f919cf4 admin admin] PATH_INFO: `/v3/projects/b972c078b4d6439ebb9a3e9ae0b2870a/users/f8f7ff7fbca44a2fb6fce7fd90ec0db0/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:47.145451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff6b05-3a6f-4bc6-86be-b63c2f919cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b972c078b4d6439ebb9a3e9ae0b2870a, user_id=f8f7ff7fbca44a2fb6fce7fd90ec0db0, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:47.148396 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff6b05-3a6f-4bc6-86be-b63c2f919cf4 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:47.199529 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1203/2360] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:05:47 2022] PUT /identity/v3/projects/b972c078b4d6439ebb9a3e9ae0b2870a/users/f8f7ff7fbca44a2fb6fce7fd90ec0db0/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:47.202532 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab854668-cddf-4c14-982c-7f77b404b85a None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:47.202856 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab854668-cddf-4c14-982c-7f77b404b85a None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:47.203043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab854668-cddf-4c14-982c-7f77b404b85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:47.234307 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-ab854668-cddf-4c14-982c-7f77b404b85a None None] MFA Rules not processed for user `f8f7ff7fbca44a2fb6fce7fd90ec0db0`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:47.235598 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ab854668-cddf-4c14-982c-7f77b404b85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:47.337414 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1158/2361] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:47.338472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff6b05-3a6f-4bc6-86be-b63c2f919cf4 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:47.444376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff6b05-3a6f-4bc6-86be-b63c2f919cf4 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:47.453219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676ea60-8b66-463c-8ae1-c19e47138e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:47.453883 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676ea60-8b66-463c-8ae1-c19e47138e10 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:47.454131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676ea60-8b66-463c-8ae1-c19e47138e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:47.454409 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676ea60-8b66-463c-8ae1-c19e47138e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:47.455114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676ea60-8b66-463c-8ae1-c19e47138e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:47.457614 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676ea60-8b66-463c-8ae1-c19e47138e10 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:47.498884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1204/2362] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:05:47 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:05:47.503192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab854668-cddf-4c14-982c-7f77b404b85a None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:47.517961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab854668-cddf-4c14-982c-7f77b404b85a None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:47.589249 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25ce58-e9df-4c3c-90ac-12f6725bd2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:47.590396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25ce58-e9df-4c3c-90ac-12f6725bd2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:47.590682 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25ce58-e9df-4c3c-90ac-12f6725bd2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:47.590953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25ce58-e9df-4c3c-90ac-12f6725bd2e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:47.591995 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25ce58-e9df-4c3c-90ac-12f6725bd2e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:47.594383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25ce58-e9df-4c3c-90ac-12f6725bd2e4 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:47.627917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1159/2363] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:05:47 2022] POST /identity/v3/users => generated 300 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:05:47.629042 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676ea60-8b66-463c-8ae1-c19e47138e10 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:47.642683 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676ea60-8b66-463c-8ae1-c19e47138e10 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:47.649543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b9efe-7ae5-4ca3-95ec-51b9a813c3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:47.650708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b9efe-7ae5-4ca3-95ec-51b9a813c3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:47.651180 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b9efe-7ae5-4ca3-95ec-51b9a813c3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:47.651610 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b9efe-7ae5-4ca3-95ec-51b9a813c3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:47.652538 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b9efe-7ae5-4ca3-95ec-51b9a813c3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:47.654518 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b9efe-7ae5-4ca3-95ec-51b9a813c3c0 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:47.669737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1205/2364] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:05:47.673881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25ce58-e9df-4c3c-90ac-12f6725bd2e4 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:47.685727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25ce58-e9df-4c3c-90ac-12f6725bd2e4 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:47.691193 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229642d-3358-4180-a914-7c7d6dbd158c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:47.692239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229642d-3358-4180-a914-7c7d6dbd158c admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:47.692616 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229642d-3358-4180-a914-7c7d6dbd158c admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:47.692989 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229642d-3358-4180-a914-7c7d6dbd158c admin admin] PATH_INFO: `/v3/projects/d1c3cf2b8dd748f9b92bf2da2625d578/users/682b755659734c6ab84d67fe4c3bd62f/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:47.709924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229642d-3358-4180-a914-7c7d6dbd158c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c3cf2b8dd748f9b92bf2da2625d578, user_id=682b755659734c6ab84d67fe4c3bd62f, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:47.712701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229642d-3358-4180-a914-7c7d6dbd158c admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:47.728723 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1160/2365] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:05:47 2022] PUT /identity/v3/projects/d1c3cf2b8dd748f9b92bf2da2625d578/users/682b755659734c6ab84d67fe4c3bd62f/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:47.732906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b9efe-7ae5-4ca3-95ec-51b9a813c3c0 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:47.744900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b9efe-7ae5-4ca3-95ec-51b9a813c3c0 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:47.813745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc6bd9-e62d-4301-857d-63d0e38ada1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:47.814425 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc6bd9-e62d-4301-857d-63d0e38ada1e admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:47.814708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc6bd9-e62d-4301-857d-63d0e38ada1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:47.815511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc6bd9-e62d-4301-857d-63d0e38ada1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:47.816307 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc6bd9-e62d-4301-857d-63d0e38ada1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:47.817893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc6bd9-e62d-4301-857d-63d0e38ada1e admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:47.833600 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1206/2366] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:47.835031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229642d-3358-4180-a914-7c7d6dbd158c admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:47.846619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229642d-3358-4180-a914-7c7d6dbd158c admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:47.851669 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b2cc0-4dc4-4f0c-95b4-2b7a565a9bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:47.852590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b2cc0-4dc4-4f0c-95b4-2b7a565a9bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:47.852866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b2cc0-4dc4-4f0c-95b4-2b7a565a9bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:47.853138 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b2cc0-4dc4-4f0c-95b4-2b7a565a9bbe admin admin] PATH_INFO: `/v3/projects/d1c3cf2b8dd748f9b92bf2da2625d578/users/682b755659734c6ab84d67fe4c3bd62f/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:47.855175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b2cc0-4dc4-4f0c-95b4-2b7a565a9bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c3cf2b8dd748f9b92bf2da2625d578, user_id=682b755659734c6ab84d67fe4c3bd62f, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:47.857867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b2cc0-4dc4-4f0c-95b4-2b7a565a9bbe admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:47.869686 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1161/2367] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:05:47 2022] PUT /identity/v3/projects/d1c3cf2b8dd748f9b92bf2da2625d578/users/682b755659734c6ab84d67fe4c3bd62f/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:47.881659 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54b632-c5d0-4c2f-885c-97229aa31aa3 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:47.881939 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54b632-c5d0-4c2f-885c-97229aa31aa3 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:47.882210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54b632-c5d0-4c2f-885c-97229aa31aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:47.914496 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-6e54b632-c5d0-4c2f-885c-97229aa31aa3 None None] MFA Rules not processed for user `682b755659734c6ab84d67fe4c3bd62f`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:47.915768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-6e54b632-c5d0-4c2f-885c-97229aa31aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:47.989517 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1207/2368] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:48.001997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b2cc0-4dc4-4f0c-95b4-2b7a565a9bbe admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:48.004466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8b9b2cc0-4dc4-4f0c-95b4-2b7a565a9bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:48.069940 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b2cc0-4dc4-4f0c-95b4-2b7a565a9bbe admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:48.073836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be186d-9ccf-4652-93c3-7466bca8e42f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:48.074677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be186d-9ccf-4652-93c3-7466bca8e42f service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:48.075124 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be186d-9ccf-4652-93c3-7466bca8e42f service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:48.075555 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be186d-9ccf-4652-93c3-7466bca8e42f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:48.088301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be186d-9ccf-4652-93c3-7466bca8e42f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:48.089880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be186d-9ccf-4652-93c3-7466bca8e42f service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:48.101306 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1162/2369] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:05:48.176481 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54b632-c5d0-4c2f-885c-97229aa31aa3 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:48.253692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54b632-c5d0-4c2f-885c-97229aa31aa3 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:48.258614 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469d400-9c34-4567-b521-0b84830c30cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:48.259501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469d400-9c34-4567-b521-0b84830c30cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:48.259775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469d400-9c34-4567-b521-0b84830c30cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:48.260043 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469d400-9c34-4567-b521-0b84830c30cc admin admin] PATH_INFO: `/v3/users/f8f7ff7fbca44a2fb6fce7fd90ec0db0` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:48.261718 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469d400-9c34-4567-b521-0b84830c30cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f7ff7fbca44a2fb6fce7fd90ec0db0)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:48.263692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469d400-9c34-4567-b521-0b84830c30cc admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:48.319254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6469d400-9c34-4567-b521-0b84830c30cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f7ff7fbca44a2fb6fce7fd90ec0db0'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:48.333347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6469d400-9c34-4567-b521-0b84830c30cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f7ff7fbca44a2fb6fce7fd90ec0db0'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:48.342130 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6469d400-9c34-4567-b521-0b84830c30cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f7ff7fbca44a2fb6fce7fd90ec0db0'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:48.343715 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6469d400-9c34-4567-b521-0b84830c30cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f7ff7fbca44a2fb6fce7fd90ec0db0'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:48.355007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6469d400-9c34-4567-b521-0b84830c30cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f7ff7fbca44a2fb6fce7fd90ec0db0'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:48.362842 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1208/2370] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:05:48 2022] DELETE /identity/v3/users/f8f7ff7fbca44a2fb6fce7fd90ec0db0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:48.367252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f7b22-4568-4490-808f-443efe9f3e34 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:48.367540 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f7b22-4568-4490-808f-443efe9f3e34 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:48.367816 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f7b22-4568-4490-808f-443efe9f3e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:48.407822 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-286f7b22-4568-4490-808f-443efe9f3e34 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:48.409315 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-286f7b22-4568-4490-808f-443efe9f3e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:48.495851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1163/2371] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:05:48.507229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469d400-9c34-4567-b521-0b84830c30cc admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:48.509295 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-6469d400-9c34-4567-b521-0b84830c30cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:48.573871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469d400-9c34-4567-b521-0b84830c30cc admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:48.578249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca0faa-f8ba-4def-855b-7221d9dfd3c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:48.578914 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca0faa-f8ba-4def-855b-7221d9dfd3c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:48.579195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca0faa-f8ba-4def-855b-7221d9dfd3c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:48.579472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca0faa-f8ba-4def-855b-7221d9dfd3c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:48.589402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca0faa-f8ba-4def-855b-7221d9dfd3c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:48.590814 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca0faa-f8ba-4def-855b-7221d9dfd3c7 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:48.604941 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1209/2372] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:48.899683 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f7b22-4568-4490-808f-443efe9f3e34 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:48.901190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-286f7b22-4568-4490-808f-443efe9f3e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:48.921352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f7b22-4568-4490-808f-443efe9f3e34 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:48.932588 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505265c-0ad7-48d3-896a-6041bbfb0c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:48.933874 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505265c-0ad7-48d3-896a-6041bbfb0c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:48.934321 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505265c-0ad7-48d3-896a-6041bbfb0c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:48.934760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505265c-0ad7-48d3-896a-6041bbfb0c48 admin admin] PATH_INFO: `/v3/projects/b972c078b4d6439ebb9a3e9ae0b2870a` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:48.936108 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505265c-0ad7-48d3-896a-6041bbfb0c48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b972c078b4d6439ebb9a3e9ae0b2870a)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:48.938335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505265c-0ad7-48d3-896a-6041bbfb0c48 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:48.994982 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-2505265c-0ad7-48d3-896a-6041bbfb0c48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b972c078b4d6439ebb9a3e9ae0b2870a', 'request_id': 'req-2505265c-0ad7-48d3-896a-6041bbfb0c48'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:49.000293 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-2505265c-0ad7-48d3-896a-6041bbfb0c48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b972c078b4d6439ebb9a3e9ae0b2870a', 'request_id': 'req-2505265c-0ad7-48d3-896a-6041bbfb0c48'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:49.008515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-2505265c-0ad7-48d3-896a-6041bbfb0c48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b972c078b4d6439ebb9a3e9ae0b2870a', 'request_id': 'req-2505265c-0ad7-48d3-896a-6041bbfb0c48'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:49.023058 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-2505265c-0ad7-48d3-896a-6041bbfb0c48 admin admin] The token cache is being invalidate because project b972c078b4d6439ebb9a3e9ae0b2870a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:05:49.023730 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-2505265c-0ad7-48d3-896a-6041bbfb0c48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:49.024542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-2505265c-0ad7-48d3-896a-6041bbfb0c48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:49.026486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1164/2373] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:05:48 2022] DELETE /identity/v3/projects/b972c078b4d6439ebb9a3e9ae0b2870a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:49.030456 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca0faa-f8ba-4def-855b-7221d9dfd3c7 service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:49.040977 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca0faa-f8ba-4def-855b-7221d9dfd3c7 service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:49.101832 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a287c7-c8b8-4186-b992-90d78571f58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:49.102703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a287c7-c8b8-4186-b992-90d78571f58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:49.102973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a287c7-c8b8-4186-b992-90d78571f58b admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:49.103263 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a287c7-c8b8-4186-b992-90d78571f58b admin admin] PATH_INFO: `/v3/users/682b755659734c6ab84d67fe4c3bd62f` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:49.104561 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a287c7-c8b8-4186-b992-90d78571f58b admin admin] RBAC: Authorizing `identity:delete_user(user_id=682b755659734c6ab84d67fe4c3bd62f)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:49.106651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a287c7-c8b8-4186-b992-90d78571f58b admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:49.156024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-63a287c7-c8b8-4186-b992-90d78571f58b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '682b755659734c6ab84d67fe4c3bd62f'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:49.168811 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-63a287c7-c8b8-4186-b992-90d78571f58b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '682b755659734c6ab84d67fe4c3bd62f'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:49.178629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-63a287c7-c8b8-4186-b992-90d78571f58b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '682b755659734c6ab84d67fe4c3bd62f'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:49.179526 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-63a287c7-c8b8-4186-b992-90d78571f58b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '682b755659734c6ab84d67fe4c3bd62f'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:49.189020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-63a287c7-c8b8-4186-b992-90d78571f58b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '682b755659734c6ab84d67fe4c3bd62f'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:49.196138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1210/2374] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:05:49 2022] DELETE /identity/v3/users/682b755659734c6ab84d67fe4c3bd62f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:49.536775 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505265c-0ad7-48d3-896a-6041bbfb0c48 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:49.538298 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-2505265c-0ad7-48d3-896a-6041bbfb0c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:49.570969 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505265c-0ad7-48d3-896a-6041bbfb0c48 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:49.653401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb7751-f7f8-4a97-bcc0-e69e9bcf34a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:49.654505 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7751-f7f8-4a97-bcc0-e69e9bcf34a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:49.654791 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7751-f7f8-4a97-bcc0-e69e9bcf34a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:49.655071 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7751-f7f8-4a97-bcc0-e69e9bcf34a3 admin admin] PATH_INFO: `/v3/projects/d1c3cf2b8dd748f9b92bf2da2625d578` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:49.656426 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb7751-f7f8-4a97-bcc0-e69e9bcf34a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1c3cf2b8dd748f9b92bf2da2625d578)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:49.658262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb7751-f7f8-4a97-bcc0-e69e9bcf34a3 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:49.728237 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-97bb7751-f7f8-4a97-bcc0-e69e9bcf34a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1c3cf2b8dd748f9b92bf2da2625d578', 'request_id': 'req-97bb7751-f7f8-4a97-bcc0-e69e9bcf34a3'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:49.738581 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-97bb7751-f7f8-4a97-bcc0-e69e9bcf34a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1c3cf2b8dd748f9b92bf2da2625d578', 'request_id': 'req-97bb7751-f7f8-4a97-bcc0-e69e9bcf34a3'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:49.747056 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-97bb7751-f7f8-4a97-bcc0-e69e9bcf34a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1c3cf2b8dd748f9b92bf2da2625d578', 'request_id': 'req-97bb7751-f7f8-4a97-bcc0-e69e9bcf34a3'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:49.762727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-97bb7751-f7f8-4a97-bcc0-e69e9bcf34a3 admin admin] The token cache is being invalidate because project d1c3cf2b8dd748f9b92bf2da2625d578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:05:49.763077 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-97bb7751-f7f8-4a97-bcc0-e69e9bcf34a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:49.763747 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-97bb7751-f7f8-4a97-bcc0-e69e9bcf34a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:49.765709 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1165/2375] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:05:49 2022] DELETE /identity/v3/projects/d1c3cf2b8dd748f9b92bf2da2625d578 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:49.771372 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c3ebd-7834-4e97-850c-a83576473401 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:49.771957 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c3ebd-7834-4e97-850c-a83576473401 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:49.772319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c3ebd-7834-4e97-850c-a83576473401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:49.796342 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-b06c3ebd-7834-4e97-850c-a83576473401 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:49.797736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b06c3ebd-7834-4e97-850c-a83576473401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:49.875072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1211/2376] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:49.886045 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a7799-1ca3-4d53-a552-32b832d0a0bd None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:49.886479 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a7799-1ca3-4d53-a552-32b832d0a0bd None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:49.886863 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a7799-1ca3-4d53-a552-32b832d0a0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:49.925103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-148a7799-1ca3-4d53-a552-32b832d0a0bd None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:49.926396 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-148a7799-1ca3-4d53-a552-32b832d0a0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:49.934209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1166/2377] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:05:49.938505 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c3ebd-7834-4e97-850c-a83576473401 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:49.948902 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c3ebd-7834-4e97-850c-a83576473401 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:49.953828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474203d8-e396-4770-8519-7f8b0918e083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:49.954574 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474203d8-e396-4770-8519-7f8b0918e083 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:49.954853 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474203d8-e396-4770-8519-7f8b0918e083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:49.955123 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474203d8-e396-4770-8519-7f8b0918e083 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:49.956530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474203d8-e396-4770-8519-7f8b0918e083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:05:49.956832 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474203d8-e396-4770-8519-7f8b0918e083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:49.958529 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474203d8-e396-4770-8519-7f8b0918e083 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:49.971161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1212/2378] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:05:49.976185 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a7799-1ca3-4d53-a552-32b832d0a0bd None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:49.989179 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a7799-1ca3-4d53-a552-32b832d0a0bd None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:49.994213 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e20a5-e2b8-4863-ab83-61eda12e7d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:49.994978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e20a5-e2b8-4863-ab83-61eda12e7d6b admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:49.995365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e20a5-e2b8-4863-ab83-61eda12e7d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:49.995848 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e20a5-e2b8-4863-ab83-61eda12e7d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:49.996678 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e20a5-e2b8-4863-ab83-61eda12e7d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:49.998706 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e20a5-e2b8-4863-ab83-61eda12e7d6b admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:50.030239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1167/2379] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:05:49 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:05:50.035548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474203d8-e396-4770-8519-7f8b0918e083 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:50.046332 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474203d8-e396-4770-8519-7f8b0918e083 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:50.106659 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b902f7-716b-4cc9-b407-f69992e72ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:50.107474 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b902f7-716b-4cc9-b407-f69992e72ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:50.107821 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b902f7-716b-4cc9-b407-f69992e72ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:50.108270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b902f7-716b-4cc9-b407-f69992e72ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:50.108987 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b902f7-716b-4cc9-b407-f69992e72ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:50.111083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b902f7-716b-4cc9-b407-f69992e72ff5 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:50.136208 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1213/2380] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:05:50 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:05:50.138293 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e20a5-e2b8-4863-ab83-61eda12e7d6b admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:50.151852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e20a5-e2b8-4863-ab83-61eda12e7d6b admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:50.156700 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd1c1b-c719-4011-9548-302fbd742b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:50.157358 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd1c1b-c719-4011-9548-302fbd742b96 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:50.157636 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd1c1b-c719-4011-9548-302fbd742b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:50.157908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd1c1b-c719-4011-9548-302fbd742b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:50.158651 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd1c1b-c719-4011-9548-302fbd742b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:50.161016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd1c1b-c719-4011-9548-302fbd742b96 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:50.175337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1168/2381] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:50.179210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b902f7-716b-4cc9-b407-f69992e72ff5 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:50.191012 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b902f7-716b-4cc9-b407-f69992e72ff5 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:50.195809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381b80d-067b-4d8a-9065-b49a2fd914b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:50.196536 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b80d-067b-4d8a-9065-b49a2fd914b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:50.196801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b80d-067b-4d8a-9065-b49a2fd914b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:50.197073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b80d-067b-4d8a-9065-b49a2fd914b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:50.197795 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381b80d-067b-4d8a-9065-b49a2fd914b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:50.199515 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381b80d-067b-4d8a-9065-b49a2fd914b6 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:50.212214 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1214/2382] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:50.215600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd1c1b-c719-4011-9548-302fbd742b96 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:50.226306 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd1c1b-c719-4011-9548-302fbd742b96 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:50.231283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447bb34-d2a2-446c-8db2-8d3103b185c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:50.232269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447bb34-d2a2-446c-8db2-8d3103b185c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:50.232634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447bb34-d2a2-446c-8db2-8d3103b185c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:50.232915 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447bb34-d2a2-446c-8db2-8d3103b185c5 admin admin] PATH_INFO: `/v3/projects/f9a6de1257914458b659e48934e086e5/users/580fb6f532ac4fdcac998cc918ead202/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:50.251326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447bb34-d2a2-446c-8db2-8d3103b185c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a6de1257914458b659e48934e086e5, user_id=580fb6f532ac4fdcac998cc918ead202, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:50.254674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447bb34-d2a2-446c-8db2-8d3103b185c5 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:50.269716 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1169/2383] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:05:50 2022] PUT /identity/v3/projects/f9a6de1257914458b659e48934e086e5/users/580fb6f532ac4fdcac998cc918ead202/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:05:50.281119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c9d6d-38da-4acf-a0f5-3d874b18121d None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:50.281464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c9d6d-38da-4acf-a0f5-3d874b18121d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:50.281744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c9d6d-38da-4acf-a0f5-3d874b18121d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:50.310353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-d14c9d6d-38da-4acf-a0f5-3d874b18121d None None] MFA Rules not processed for user `580fb6f532ac4fdcac998cc918ead202`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:50.311616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d14c9d6d-38da-4acf-a0f5-3d874b18121d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:50.387513 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1215/2384] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:50.389022 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447bb34-d2a2-446c-8db2-8d3103b185c5 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:50.458890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447bb34-d2a2-446c-8db2-8d3103b185c5 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:50.467402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c3dcd-f3c4-4a8f-8373-95a6977964b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:50.468402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c3dcd-f3c4-4a8f-8373-95a6977964b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:50.468687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c3dcd-f3c4-4a8f-8373-95a6977964b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:50.468991 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c3dcd-f3c4-4a8f-8373-95a6977964b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:50.469685 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c3dcd-f3c4-4a8f-8373-95a6977964b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:50.471685 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c3dcd-f3c4-4a8f-8373-95a6977964b0 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:50.504399 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1170/2385] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:05:50 2022] POST /identity/v3/projects => generated 393 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:05:50.505656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c9d6d-38da-4acf-a0f5-3d874b18121d None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:50.516528 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c9d6d-38da-4acf-a0f5-3d874b18121d None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:50.576007 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9bc7e-a2fe-4fe8-828d-938f539ac690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:50.576789 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9bc7e-a2fe-4fe8-828d-938f539ac690 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:50.577076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9bc7e-a2fe-4fe8-828d-938f539ac690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:50.577355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9bc7e-a2fe-4fe8-828d-938f539ac690 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:50.578064 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9bc7e-a2fe-4fe8-828d-938f539ac690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:50.580073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9bc7e-a2fe-4fe8-828d-938f539ac690 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:50.607114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1216/2386] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:05:50 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:05:50.608627 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c3dcd-f3c4-4a8f-8373-95a6977964b0 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:50.630157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c3dcd-f3c4-4a8f-8373-95a6977964b0 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:50.637667 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625ebed-67e0-423a-9bf9-8a5ef3114c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:50.638288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625ebed-67e0-423a-9bf9-8a5ef3114c97 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:50.638570 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625ebed-67e0-423a-9bf9-8a5ef3114c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:50.638843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625ebed-67e0-423a-9bf9-8a5ef3114c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:50.639564 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625ebed-67e0-423a-9bf9-8a5ef3114c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:50.641249 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625ebed-67e0-423a-9bf9-8a5ef3114c97 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:50.652526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1171/2387] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:50.656981 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9bc7e-a2fe-4fe8-828d-938f539ac690 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:50.667556 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9bc7e-a2fe-4fe8-828d-938f539ac690 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:50.673326 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ece00-fb90-4a8f-b208-fefd51fbf02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:50.674731 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ece00-fb90-4a8f-b208-fefd51fbf02c admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:50.675019 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ece00-fb90-4a8f-b208-fefd51fbf02c admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:50.675287 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ece00-fb90-4a8f-b208-fefd51fbf02c admin admin] PATH_INFO: `/v3/projects/31988b3bbc2c426296cac368bec029a5/users/15ddc5abc6454a6783f6476441fa39a9/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:50.699830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ece00-fb90-4a8f-b208-fefd51fbf02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=31988b3bbc2c426296cac368bec029a5, user_id=15ddc5abc6454a6783f6476441fa39a9, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:50.702528 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ece00-fb90-4a8f-b208-fefd51fbf02c admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:50.715785 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1217/2388] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:05:50 2022] PUT /identity/v3/projects/31988b3bbc2c426296cac368bec029a5/users/15ddc5abc6454a6783f6476441fa39a9/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:50.719857 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625ebed-67e0-423a-9bf9-8a5ef3114c97 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:50.729794 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625ebed-67e0-423a-9bf9-8a5ef3114c97 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:50.788905 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2bc69-3a0d-46b5-8be5-8bfc50e75786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:50.789957 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2bc69-3a0d-46b5-8be5-8bfc50e75786 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:50.790247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2bc69-3a0d-46b5-8be5-8bfc50e75786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:50.790529 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2bc69-3a0d-46b5-8be5-8bfc50e75786 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:50.791249 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2bc69-3a0d-46b5-8be5-8bfc50e75786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:50.792879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2bc69-3a0d-46b5-8be5-8bfc50e75786 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:50.803670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1172/2389] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:50.807905 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ece00-fb90-4a8f-b208-fefd51fbf02c admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:50.818247 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ece00-fb90-4a8f-b208-fefd51fbf02c admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:50.822872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e7469-251a-4ec8-9205-f7ba0a61154a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:50.823742 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e7469-251a-4ec8-9205-f7ba0a61154a admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:50.824021 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e7469-251a-4ec8-9205-f7ba0a61154a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:50.824334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e7469-251a-4ec8-9205-f7ba0a61154a admin admin] PATH_INFO: `/v3/projects/31988b3bbc2c426296cac368bec029a5/users/15ddc5abc6454a6783f6476441fa39a9/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:50.826259 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e7469-251a-4ec8-9205-f7ba0a61154a admin admin] RBAC: Authorizing `identity:create_grant(project_id=31988b3bbc2c426296cac368bec029a5, user_id=15ddc5abc6454a6783f6476441fa39a9, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:50.829040 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e7469-251a-4ec8-9205-f7ba0a61154a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:50.838600 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1218/2390] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:05:50 2022] PUT /identity/v3/projects/31988b3bbc2c426296cac368bec029a5/users/15ddc5abc6454a6783f6476441fa39a9/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:50.849290 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eb9f2-484e-4003-a140-309045ae9a38 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:50.849579 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eb9f2-484e-4003-a140-309045ae9a38 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:50.849861 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eb9f2-484e-4003-a140-309045ae9a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:50.878492 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-594eb9f2-484e-4003-a140-309045ae9a38 None None] MFA Rules not processed for user `15ddc5abc6454a6783f6476441fa39a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:50.879773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-594eb9f2-484e-4003-a140-309045ae9a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:50.946397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1173/2391] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:50.957076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e7469-251a-4ec8-9205-f7ba0a61154a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:50.958755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-406e7469-251a-4ec8-9205-f7ba0a61154a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:51.015117 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e7469-251a-4ec8-9205-f7ba0a61154a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:51.019066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc04e8-d62e-4e04-980d-36ed6c62320b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:51.019698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc04e8-d62e-4e04-980d-36ed6c62320b service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:51.019980 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc04e8-d62e-4e04-980d-36ed6c62320b service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:51.020285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc04e8-d62e-4e04-980d-36ed6c62320b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:51.030622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc04e8-d62e-4e04-980d-36ed6c62320b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:51.032051 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc04e8-d62e-4e04-980d-36ed6c62320b service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:51.041751 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1219/2392] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:51.085974 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594eb9f2-484e-4003-a140-309045ae9a38 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:51.087375 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-594eb9f2-484e-4003-a140-309045ae9a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:51.099766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594eb9f2-484e-4003-a140-309045ae9a38 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:51.103418 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779eaef-b12a-4b20-9292-dec63d444950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:51.104077 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779eaef-b12a-4b20-9292-dec63d444950 service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:51.104388 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779eaef-b12a-4b20-9292-dec63d444950 service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:51.104663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779eaef-b12a-4b20-9292-dec63d444950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:51.159045 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779eaef-b12a-4b20-9292-dec63d444950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:51.160495 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779eaef-b12a-4b20-9292-dec63d444950 service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:51.169753 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1174/2393] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:54.357889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc04e8-d62e-4e04-980d-36ed6c62320b service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:54.426520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc04e8-d62e-4e04-980d-36ed6c62320b service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:54.431083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de907765-409a-4ca4-8f20-9e28bae22862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:54.431968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de907765-409a-4ca4-8f20-9e28bae22862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:54.432258 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de907765-409a-4ca4-8f20-9e28bae22862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:54.432534 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de907765-409a-4ca4-8f20-9e28bae22862 admin admin] PATH_INFO: `/v3/users/580fb6f532ac4fdcac998cc918ead202` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:54.434018 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de907765-409a-4ca4-8f20-9e28bae22862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=580fb6f532ac4fdcac998cc918ead202)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:54.435959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de907765-409a-4ca4-8f20-9e28bae22862 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:54.482107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-de907765-409a-4ca4-8f20-9e28bae22862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '580fb6f532ac4fdcac998cc918ead202'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:54.494006 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-de907765-409a-4ca4-8f20-9e28bae22862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '580fb6f532ac4fdcac998cc918ead202'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:54.501503 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-de907765-409a-4ca4-8f20-9e28bae22862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '580fb6f532ac4fdcac998cc918ead202'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:54.502302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-de907765-409a-4ca4-8f20-9e28bae22862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '580fb6f532ac4fdcac998cc918ead202'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:54.511671 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-de907765-409a-4ca4-8f20-9e28bae22862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '580fb6f532ac4fdcac998cc918ead202'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:54.519300 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1220/2394] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:05:54 2022] DELETE /identity/v3/users/580fb6f532ac4fdcac998cc918ead202 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:54.524317 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234ab87-cb53-4728-a339-b585a6b47ca0 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:54.524836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234ab87-cb53-4728-a339-b585a6b47ca0 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:54.524935 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234ab87-cb53-4728-a339-b585a6b47ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:54.542718 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-d234ab87-cb53-4728-a339-b585a6b47ca0 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:54.543994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d234ab87-cb53-4728-a339-b585a6b47ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:54.603845 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1175/2395] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:54.614058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de907765-409a-4ca4-8f20-9e28bae22862 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:54.615584 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-de907765-409a-4ca4-8f20-9e28bae22862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:54.680851 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de907765-409a-4ca4-8f20-9e28bae22862 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:54.686191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f262f82-77f7-4751-a265-92e57215880e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:54.687122 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262f82-77f7-4751-a265-92e57215880e service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:54.687394 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262f82-77f7-4751-a265-92e57215880e service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:54.687693 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262f82-77f7-4751-a265-92e57215880e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:54.709400 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f262f82-77f7-4751-a265-92e57215880e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:54.711043 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f262f82-77f7-4751-a265-92e57215880e service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:54.723135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1221/2396] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:55.117710 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234ab87-cb53-4728-a339-b585a6b47ca0 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:55.119480 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d234ab87-cb53-4728-a339-b585a6b47ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:55.149575 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234ab87-cb53-4728-a339-b585a6b47ca0 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:55.155040 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f5f83-1e79-4467-877b-7b1adcdc0df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:55.156210 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f5f83-1e79-4467-877b-7b1adcdc0df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:55.156812 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f5f83-1e79-4467-877b-7b1adcdc0df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:55.157341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f5f83-1e79-4467-877b-7b1adcdc0df5 admin admin] PATH_INFO: `/v3/projects/f9a6de1257914458b659e48934e086e5` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:55.159977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f5f83-1e79-4467-877b-7b1adcdc0df5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a6de1257914458b659e48934e086e5)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:55.162349 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f5f83-1e79-4467-877b-7b1adcdc0df5 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:55.221965 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-475f5f83-1e79-4467-877b-7b1adcdc0df5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a6de1257914458b659e48934e086e5', 'request_id': 'req-475f5f83-1e79-4467-877b-7b1adcdc0df5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:55.227920 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-475f5f83-1e79-4467-877b-7b1adcdc0df5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a6de1257914458b659e48934e086e5', 'request_id': 'req-475f5f83-1e79-4467-877b-7b1adcdc0df5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:55.236595 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-475f5f83-1e79-4467-877b-7b1adcdc0df5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a6de1257914458b659e48934e086e5', 'request_id': 'req-475f5f83-1e79-4467-877b-7b1adcdc0df5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:55.251944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-475f5f83-1e79-4467-877b-7b1adcdc0df5 admin admin] The token cache is being invalidate because project f9a6de1257914458b659e48934e086e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:05:55.252570 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-475f5f83-1e79-4467-877b-7b1adcdc0df5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:55.253441 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-475f5f83-1e79-4467-877b-7b1adcdc0df5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:55.260970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1176/2397] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:05:55 2022] DELETE /identity/v3/projects/f9a6de1257914458b659e48934e086e5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:05:55.261956 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f262f82-77f7-4751-a265-92e57215880e service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:55.275604 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f262f82-77f7-4751-a265-92e57215880e service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:55.342036 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c50e9-0287-4975-bde8-35c1890cc1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:55.343220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c50e9-0287-4975-bde8-35c1890cc1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:55.343220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c50e9-0287-4975-bde8-35c1890cc1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:55.343430 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c50e9-0287-4975-bde8-35c1890cc1f9 admin admin] PATH_INFO: `/v3/users/15ddc5abc6454a6783f6476441fa39a9` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:55.344674 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c50e9-0287-4975-bde8-35c1890cc1f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ddc5abc6454a6783f6476441fa39a9)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:55.346627 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c50e9-0287-4975-bde8-35c1890cc1f9 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:55.410399 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-392c50e9-0287-4975-bde8-35c1890cc1f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ddc5abc6454a6783f6476441fa39a9'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:55.425419 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-392c50e9-0287-4975-bde8-35c1890cc1f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ddc5abc6454a6783f6476441fa39a9'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:55.443958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-392c50e9-0287-4975-bde8-35c1890cc1f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ddc5abc6454a6783f6476441fa39a9'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:55.445994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-392c50e9-0287-4975-bde8-35c1890cc1f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ddc5abc6454a6783f6476441fa39a9'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:55.456304 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-392c50e9-0287-4975-bde8-35c1890cc1f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ddc5abc6454a6783f6476441fa39a9'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:55.465571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1222/2398] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:05:55 2022] DELETE /identity/v3/users/15ddc5abc6454a6783f6476441fa39a9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:55.550130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f5f83-1e79-4467-877b-7b1adcdc0df5 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:55.551780 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-475f5f83-1e79-4467-877b-7b1adcdc0df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:55.625457 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f5f83-1e79-4467-877b-7b1adcdc0df5 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:55.680586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e398c-bc99-4cd2-a648-015a2af3e446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:55.681599 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e398c-bc99-4cd2-a648-015a2af3e446 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:55.681890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e398c-bc99-4cd2-a648-015a2af3e446 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:55.682169 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e398c-bc99-4cd2-a648-015a2af3e446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:55.684847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ec4e398c-bc99-4cd2-a648-015a2af3e446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:55.695119 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e398c-bc99-4cd2-a648-015a2af3e446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:55.696894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e398c-bc99-4cd2-a648-015a2af3e446 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:55.706020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1177/2399] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:55.816289 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c50e9-0287-4975-bde8-35c1890cc1f9 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:55.819310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-392c50e9-0287-4975-bde8-35c1890cc1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:55.934118 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c50e9-0287-4975-bde8-35c1890cc1f9 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:55.941472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708551b-70fd-44e8-9aa4-3f891efa5b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:55.942411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708551b-70fd-44e8-9aa4-3f891efa5b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:55.942661 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708551b-70fd-44e8-9aa4-3f891efa5b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:55.942931 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708551b-70fd-44e8-9aa4-3f891efa5b76 admin admin] PATH_INFO: `/v3/projects/31988b3bbc2c426296cac368bec029a5` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:55.944138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708551b-70fd-44e8-9aa4-3f891efa5b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31988b3bbc2c426296cac368bec029a5)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:55.946359 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708551b-70fd-44e8-9aa4-3f891efa5b76 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:56.000689 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6708551b-70fd-44e8-9aa4-3f891efa5b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31988b3bbc2c426296cac368bec029a5', 'request_id': 'req-6708551b-70fd-44e8-9aa4-3f891efa5b76'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:56.008453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6708551b-70fd-44e8-9aa4-3f891efa5b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31988b3bbc2c426296cac368bec029a5', 'request_id': 'req-6708551b-70fd-44e8-9aa4-3f891efa5b76'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:56.014044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6708551b-70fd-44e8-9aa4-3f891efa5b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31988b3bbc2c426296cac368bec029a5', 'request_id': 'req-6708551b-70fd-44e8-9aa4-3f891efa5b76'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:56.026371 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6708551b-70fd-44e8-9aa4-3f891efa5b76 admin admin] The token cache is being invalidate because project 31988b3bbc2c426296cac368bec029a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:05:56.026701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6708551b-70fd-44e8-9aa4-3f891efa5b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:56.027574 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6708551b-70fd-44e8-9aa4-3f891efa5b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:05:56.029431 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1223/2400] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:05:55 2022] DELETE /identity/v3/projects/31988b3bbc2c426296cac368bec029a5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:56.035043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cf5a0-bcac-4700-b950-4db83851e82f None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:56.035375 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cf5a0-bcac-4700-b950-4db83851e82f None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:56.035628 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cf5a0-bcac-4700-b950-4db83851e82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:56.059612 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-044cf5a0-bcac-4700-b950-4db83851e82f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:56.060888 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-044cf5a0-bcac-4700-b950-4db83851e82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:56.120687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1178/2401] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:56.128811 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9a80c-45f4-489b-bd8e-c109d180ad93 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:56.129095 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9a80c-45f4-489b-bd8e-c109d180ad93 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:56.129368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9a80c-45f4-489b-bd8e-c109d180ad93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:56.150123 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-72c9a80c-45f4-489b-bd8e-c109d180ad93 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:56.151294 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-72c9a80c-45f4-489b-bd8e-c109d180ad93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:56.159391 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1224/2402] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:56.163363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cf5a0-bcac-4700-b950-4db83851e82f None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:56.173001 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cf5a0-bcac-4700-b950-4db83851e82f None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:56.177854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf469da-52ed-4fdd-9dd9-16aa4831b844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:56.178508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf469da-52ed-4fdd-9dd9-16aa4831b844 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:56.178791 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf469da-52ed-4fdd-9dd9-16aa4831b844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:56.179064 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf469da-52ed-4fdd-9dd9-16aa4831b844 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:56.179813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf469da-52ed-4fdd-9dd9-16aa4831b844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:05:56.180117 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf469da-52ed-4fdd-9dd9-16aa4831b844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:56.181745 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf469da-52ed-4fdd-9dd9-16aa4831b844 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:56.193765 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1179/2403] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:05:56.198104 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9a80c-45f4-489b-bd8e-c109d180ad93 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:56.207663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9a80c-45f4-489b-bd8e-c109d180ad93 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:56.212945 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0b137-59d4-437b-911a-3d0c8ee83e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:56.213561 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0b137-59d4-437b-911a-3d0c8ee83e03 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:56.213905 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0b137-59d4-437b-911a-3d0c8ee83e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:56.214236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0b137-59d4-437b-911a-3d0c8ee83e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:56.215025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0b137-59d4-437b-911a-3d0c8ee83e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:56.217153 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0b137-59d4-437b-911a-3d0c8ee83e03 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:56.243848 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1225/2404] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:05:56 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:05:56.247958 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf469da-52ed-4fdd-9dd9-16aa4831b844 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:56.258749 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf469da-52ed-4fdd-9dd9-16aa4831b844 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:56.315675 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6306728-6b3a-443a-b7cd-1b0f11f48978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:56.316364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6306728-6b3a-443a-b7cd-1b0f11f48978 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:56.316643 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6306728-6b3a-443a-b7cd-1b0f11f48978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:56.316913 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6306728-6b3a-443a-b7cd-1b0f11f48978 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:56.317602 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6306728-6b3a-443a-b7cd-1b0f11f48978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:56.319573 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6306728-6b3a-443a-b7cd-1b0f11f48978 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:56.339934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1180/2405] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:05:56 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:05:56.344159 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0b137-59d4-437b-911a-3d0c8ee83e03 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:56.354235 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0b137-59d4-437b-911a-3d0c8ee83e03 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:56.358894 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd281e8-60f4-4085-8917-14624cb230a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:56.359544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd281e8-60f4-4085-8917-14624cb230a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:56.359825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd281e8-60f4-4085-8917-14624cb230a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:56.360094 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd281e8-60f4-4085-8917-14624cb230a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:56.360838 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd281e8-60f4-4085-8917-14624cb230a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:56.362433 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd281e8-60f4-4085-8917-14624cb230a6 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:56.373188 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1226/2406] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:05:56.378060 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6306728-6b3a-443a-b7cd-1b0f11f48978 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:56.389207 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6306728-6b3a-443a-b7cd-1b0f11f48978 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:56.394676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d829b-c228-4000-8172-cabe78f0a826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:56.395364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d829b-c228-4000-8172-cabe78f0a826 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:56.395694 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d829b-c228-4000-8172-cabe78f0a826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:56.395971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d829b-c228-4000-8172-cabe78f0a826 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:56.396723 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d829b-c228-4000-8172-cabe78f0a826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:56.398500 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d829b-c228-4000-8172-cabe78f0a826 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:56.408250 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1181/2407] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:56.412357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd281e8-60f4-4085-8917-14624cb230a6 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:56.421989 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd281e8-60f4-4085-8917-14624cb230a6 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:56.427125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c900138-bc06-44b7-b875-72aa436653e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:56.427993 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c900138-bc06-44b7-b875-72aa436653e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:56.428302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c900138-bc06-44b7-b875-72aa436653e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:56.428570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c900138-bc06-44b7-b875-72aa436653e4 admin admin] PATH_INFO: `/v3/projects/a24ede3e62824431af8ad805392153ee/users/2cb7c0ccf0da49279744b9a65ef489a5/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:56.443694 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c900138-bc06-44b7-b875-72aa436653e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24ede3e62824431af8ad805392153ee, user_id=2cb7c0ccf0da49279744b9a65ef489a5, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:56.446392 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c900138-bc06-44b7-b875-72aa436653e4 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:56.459105 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1227/2408] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:05:56 2022] PUT /identity/v3/projects/a24ede3e62824431af8ad805392153ee/users/2cb7c0ccf0da49279744b9a65ef489a5/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:56.469982 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81b1e7-bc0f-452e-abdf-571cdcc6bd99 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:56.470274 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81b1e7-bc0f-452e-abdf-571cdcc6bd99 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:56.470555 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81b1e7-bc0f-452e-abdf-571cdcc6bd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:56.497903 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-9f81b1e7-bc0f-452e-abdf-571cdcc6bd99 None None] MFA Rules not processed for user `2cb7c0ccf0da49279744b9a65ef489a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:56.499115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-9f81b1e7-bc0f-452e-abdf-571cdcc6bd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:56.570127 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1182/2409] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:56.574357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c900138-bc06-44b7-b875-72aa436653e4 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:56.636665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c900138-bc06-44b7-b875-72aa436653e4 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:56.641823 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065da44-ef4d-4eca-bdd0-8da4ff0b2068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:56.642349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065da44-ef4d-4eca-bdd0-8da4ff0b2068 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:56.642630 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065da44-ef4d-4eca-bdd0-8da4ff0b2068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:56.642929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065da44-ef4d-4eca-bdd0-8da4ff0b2068 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:56.643874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065da44-ef4d-4eca-bdd0-8da4ff0b2068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:56.645773 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065da44-ef4d-4eca-bdd0-8da4ff0b2068 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:56.670680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1228/2410] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:05:56 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:05:56.675319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81b1e7-bc0f-452e-abdf-571cdcc6bd99 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:56.685899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81b1e7-bc0f-452e-abdf-571cdcc6bd99 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:56.740395 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2b6e9-b51e-458e-a81e-70882b265444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:56.741069 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2b6e9-b51e-458e-a81e-70882b265444 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:56.741335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2b6e9-b51e-458e-a81e-70882b265444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:56.741612 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2b6e9-b51e-458e-a81e-70882b265444 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:56.742300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2b6e9-b51e-458e-a81e-70882b265444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:56.744226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2b6e9-b51e-458e-a81e-70882b265444 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:56.763478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1183/2411] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:05:56 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:05:56.767416 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065da44-ef4d-4eca-bdd0-8da4ff0b2068 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:56.778371 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065da44-ef4d-4eca-bdd0-8da4ff0b2068 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:56.783098 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804f896-02c3-40a9-a53f-201b1a89f92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:56.784323 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804f896-02c3-40a9-a53f-201b1a89f92d admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:56.784607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804f896-02c3-40a9-a53f-201b1a89f92d admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:56.784883 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804f896-02c3-40a9-a53f-201b1a89f92d admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:56.785602 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804f896-02c3-40a9-a53f-201b1a89f92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:56.787781 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804f896-02c3-40a9-a53f-201b1a89f92d admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:56.798722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1229/2412] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:56.803273 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2b6e9-b51e-458e-a81e-70882b265444 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:56.813599 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2b6e9-b51e-458e-a81e-70882b265444 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:56.818286 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a282e-4fcd-41c2-81cb-aaed32afde82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:56.818957 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a282e-4fcd-41c2-81cb-aaed32afde82 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:56.819236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a282e-4fcd-41c2-81cb-aaed32afde82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:56.819509 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a282e-4fcd-41c2-81cb-aaed32afde82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:56.820293 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a282e-4fcd-41c2-81cb-aaed32afde82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:56.821867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a282e-4fcd-41c2-81cb-aaed32afde82 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:56.833410 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1184/2413] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:56.837539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804f896-02c3-40a9-a53f-201b1a89f92d admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:56.847931 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804f896-02c3-40a9-a53f-201b1a89f92d admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:56.852578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c6a83-5bbc-48f7-9915-c581a65e86d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:56.853446 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c6a83-5bbc-48f7-9915-c581a65e86d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:56.853726 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c6a83-5bbc-48f7-9915-c581a65e86d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:56.854000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c6a83-5bbc-48f7-9915-c581a65e86d0 admin admin] PATH_INFO: `/v3/projects/5d54eeec5cd04fa3a92da300e0492538/users/e90106a04801474184b04f28986fff78/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:56.868677 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c6a83-5bbc-48f7-9915-c581a65e86d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d54eeec5cd04fa3a92da300e0492538, user_id=e90106a04801474184b04f28986fff78, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:56.871296 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c6a83-5bbc-48f7-9915-c581a65e86d0 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:56.885807 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1230/2414] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:05:56 2022] PUT /identity/v3/projects/5d54eeec5cd04fa3a92da300e0492538/users/e90106a04801474184b04f28986fff78/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:05:56.896628 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc423d4e-f933-45a0-95a5-507d412248c5 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:56.896918 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc423d4e-f933-45a0-95a5-507d412248c5 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:56.897253 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc423d4e-f933-45a0-95a5-507d412248c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:56.925282 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-cc423d4e-f933-45a0-95a5-507d412248c5 None None] MFA Rules not processed for user `e90106a04801474184b04f28986fff78`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:56.926515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-cc423d4e-f933-45a0-95a5-507d412248c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:56.995738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1185/2415] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:57.000441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c6a83-5bbc-48f7-9915-c581a65e86d0 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:57.086400 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c6a83-5bbc-48f7-9915-c581a65e86d0 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:57.093304 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb8cb4-5d6a-4477-84ce-e35e12a9a494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:57.094025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb8cb4-5d6a-4477-84ce-e35e12a9a494 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:57.094444 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb8cb4-5d6a-4477-84ce-e35e12a9a494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:57.094621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb8cb4-5d6a-4477-84ce-e35e12a9a494 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:57.095455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb8cb4-5d6a-4477-84ce-e35e12a9a494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:57.099213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb8cb4-5d6a-4477-84ce-e35e12a9a494 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:57.135653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1231/2416] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:05:56 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:05:57.137228 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc423d4e-f933-45a0-95a5-507d412248c5 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:57.149611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc423d4e-f933-45a0-95a5-507d412248c5 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:57.218210 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf73455-754f-4352-b9b0-58a1867af54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:57.218876 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf73455-754f-4352-b9b0-58a1867af54f admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:57.219164 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf73455-754f-4352-b9b0-58a1867af54f admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:57.219436 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf73455-754f-4352-b9b0-58a1867af54f admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:57.220120 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf73455-754f-4352-b9b0-58a1867af54f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:57.222614 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf73455-754f-4352-b9b0-58a1867af54f admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:57.246436 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1186/2417] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:05:57 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:05:57.247859 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb8cb4-5d6a-4477-84ce-e35e12a9a494 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:57.259600 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb8cb4-5d6a-4477-84ce-e35e12a9a494 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:57.264855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3de3fa-9fd4-4d77-846e-94acc36b42c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:57.265571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de3fa-9fd4-4d77-846e-94acc36b42c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:57.265893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de3fa-9fd4-4d77-846e-94acc36b42c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:57.266181 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3de3fa-9fd4-4d77-846e-94acc36b42c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:57.267228 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3de3fa-9fd4-4d77-846e-94acc36b42c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:57.269665 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3de3fa-9fd4-4d77-846e-94acc36b42c3 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:57.281975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1232/2418] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:57.286597 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf73455-754f-4352-b9b0-58a1867af54f admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:57.302295 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf73455-754f-4352-b9b0-58a1867af54f admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:57.307871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734342b-53f4-456d-80e0-4f19436423cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:57.308825 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734342b-53f4-456d-80e0-4f19436423cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:57.309092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734342b-53f4-456d-80e0-4f19436423cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:57.309507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734342b-53f4-456d-80e0-4f19436423cf admin admin] PATH_INFO: `/v3/projects/1f0efe79770f44159b2ed55b682f810e/users/51face6e2f75496cbcafbf4e2b3b19c8/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:57.326525 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734342b-53f4-456d-80e0-4f19436423cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0efe79770f44159b2ed55b682f810e, user_id=51face6e2f75496cbcafbf4e2b3b19c8, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:57.329215 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734342b-53f4-456d-80e0-4f19436423cf admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:57.342845 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1187/2419] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:05:57 2022] PUT /identity/v3/projects/1f0efe79770f44159b2ed55b682f810e/users/51face6e2f75496cbcafbf4e2b3b19c8/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:57.347391 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3de3fa-9fd4-4d77-846e-94acc36b42c3 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:57.357242 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3de3fa-9fd4-4d77-846e-94acc36b42c3 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:57.412813 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcdc38-12cb-477e-bbde-7bfc403f9e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:57.413496 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcdc38-12cb-477e-bbde-7bfc403f9e0c admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:57.413745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcdc38-12cb-477e-bbde-7bfc403f9e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:57.414060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcdc38-12cb-477e-bbde-7bfc403f9e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:57.414767 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcdc38-12cb-477e-bbde-7bfc403f9e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:57.416370 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcdc38-12cb-477e-bbde-7bfc403f9e0c admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:57.426190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1233/2420] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:05:57.430056 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734342b-53f4-456d-80e0-4f19436423cf admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:57.440110 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734342b-53f4-456d-80e0-4f19436423cf admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:57.445029 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd12536-0540-46fe-8b77-c4bd1a3a5bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:57.446115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd12536-0540-46fe-8b77-c4bd1a3a5bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:57.446386 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd12536-0540-46fe-8b77-c4bd1a3a5bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:57.446659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd12536-0540-46fe-8b77-c4bd1a3a5bb7 admin admin] PATH_INFO: `/v3/projects/1f0efe79770f44159b2ed55b682f810e/users/51face6e2f75496cbcafbf4e2b3b19c8/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:57.448656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd12536-0540-46fe-8b77-c4bd1a3a5bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0efe79770f44159b2ed55b682f810e, user_id=51face6e2f75496cbcafbf4e2b3b19c8, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:57.451288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd12536-0540-46fe-8b77-c4bd1a3a5bb7 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:57.461851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1188/2421] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:05:57 2022] PUT /identity/v3/projects/1f0efe79770f44159b2ed55b682f810e/users/51face6e2f75496cbcafbf4e2b3b19c8/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:05:57.472690 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13d3aa-a9ae-41db-8397-f71cd98f1f9c None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:57.472999 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13d3aa-a9ae-41db-8397-f71cd98f1f9c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:57.473276 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13d3aa-a9ae-41db-8397-f71cd98f1f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:57.499357 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-ee13d3aa-a9ae-41db-8397-f71cd98f1f9c None None] MFA Rules not processed for user `51face6e2f75496cbcafbf4e2b3b19c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:57.500581 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ee13d3aa-a9ae-41db-8397-f71cd98f1f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:57.570182 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1234/2422] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:05:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:05:57.583372 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd12536-0540-46fe-8b77-c4bd1a3a5bb7 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:57.585174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-6cd12536-0540-46fe-8b77-c4bd1a3a5bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:57.641341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd12536-0540-46fe-8b77-c4bd1a3a5bb7 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:57.645885 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c7508-0d29-4f16-b367-74961dc8c613 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:57.646552 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c7508-0d29-4f16-b367-74961dc8c613 service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:57.646830 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c7508-0d29-4f16-b367-74961dc8c613 service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:57.647098 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c7508-0d29-4f16-b367-74961dc8c613 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:57.656386 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c7508-0d29-4f16-b367-74961dc8c613 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:57.657805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c7508-0d29-4f16-b367-74961dc8c613 service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:57.667324 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1189/2423] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:57.711260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13d3aa-a9ae-41db-8397-f71cd98f1f9c None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:57.721408 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13d3aa-a9ae-41db-8397-f71cd98f1f9c None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:57.725050 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a792a-cfac-4ca1-a42b-fc3a159e1ef4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:57.725685 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a792a-cfac-4ca1-a42b-fc3a159e1ef4 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:57.725962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a792a-cfac-4ca1-a42b-fc3a159e1ef4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:57.726232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a792a-cfac-4ca1-a42b-fc3a159e1ef4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:57.783319 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a792a-cfac-4ca1-a42b-fc3a159e1ef4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:57.784777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a792a-cfac-4ca1-a42b-fc3a159e1ef4 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:57.795479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1235/2424] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:05:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:05:57.942466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1bb53-2633-4bac-96b4-e1d45d9451d8 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:57.942757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1bb53-2633-4bac-96b4-e1d45d9451d8 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:57.943035 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1bb53-2633-4bac-96b4-e1d45d9451d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:57.964127 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-96f1bb53-2633-4bac-96b4-e1d45d9451d8 None None] MFA Rules not processed for user `df5dcdfb4eda417ebc0af2432497617d`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:05:57.965369 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-96f1bb53-2633-4bac-96b4-e1d45d9451d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:58.027530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1190/2425] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 14:05:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:05:58.042517 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a792a-cfac-4ca1-a42b-fc3a159e1ef4 service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:05:58.044225 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e25a792a-cfac-4ca1-a42b-fc3a159e1ef4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:05:58.123172 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a792a-cfac-4ca1-a42b-fc3a159e1ef4 service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:05:58.139374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25f8d1-d9de-4ed9-8bc4-c1a194e52b36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd102155cd1bd4368ad272668da1651f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:05:58.139374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25f8d1-d9de-4ed9-8bc4-c1a194e52b36 service swift] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:05:58.139374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25f8d1-d9de-4ed9-8bc4-c1a194e52b36 service swift] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:05:58.139374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25f8d1-d9de-4ed9-8bc4-c1a194e52b36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:05:58.144547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25f8d1-d9de-4ed9-8bc4-c1a194e52b36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:05:58.146865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25f8d1-d9de-4ed9-8bc4-c1a194e52b36 service swift] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:05:58.159840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1236/2426] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 14:05:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:06:00.835047 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1bb53-2633-4bac-96b4-e1d45d9451d8 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:00.931409 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1bb53-2633-4bac-96b4-e1d45d9451d8 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:00.935925 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5836d-1b4f-4b12-a840-47d7f2d0f681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:00.936881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5836d-1b4f-4b12-a840-47d7f2d0f681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:00.937229 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5836d-1b4f-4b12-a840-47d7f2d0f681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:00.937606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5836d-1b4f-4b12-a840-47d7f2d0f681 admin admin] PATH_INFO: `/v3/users/2cb7c0ccf0da49279744b9a65ef489a5` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:00.938819 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5836d-1b4f-4b12-a840-47d7f2d0f681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb7c0ccf0da49279744b9a65ef489a5)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:00.940811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5836d-1b4f-4b12-a840-47d7f2d0f681 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:01.009988 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d2b5836d-1b4f-4b12-a840-47d7f2d0f681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb7c0ccf0da49279744b9a65ef489a5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:01.010634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d2b5836d-1b4f-4b12-a840-47d7f2d0f681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb7c0ccf0da49279744b9a65ef489a5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:01.023924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d2b5836d-1b4f-4b12-a840-47d7f2d0f681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb7c0ccf0da49279744b9a65ef489a5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:01.032802 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d2b5836d-1b4f-4b12-a840-47d7f2d0f681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb7c0ccf0da49279744b9a65ef489a5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:01.034004 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d2b5836d-1b4f-4b12-a840-47d7f2d0f681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb7c0ccf0da49279744b9a65ef489a5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:01.046327 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1191/2427] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:06:00 2022] DELETE /identity/v3/users/2cb7c0ccf0da49279744b9a65ef489a5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:01.050900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d486749-2b57-4188-b401-c43d2a9f8bec None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:01.051358 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d486749-2b57-4188-b401-c43d2a9f8bec None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:01.051563 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d486749-2b57-4188-b401-c43d2a9f8bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:01.074704 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-4d486749-2b57-4188-b401-c43d2a9f8bec None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:01.075897 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-4d486749-2b57-4188-b401-c43d2a9f8bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:01.137994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1237/2428] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:01.148610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5836d-1b4f-4b12-a840-47d7f2d0f681 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:01.149998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d2b5836d-1b4f-4b12-a840-47d7f2d0f681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:01.219073 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5836d-1b4f-4b12-a840-47d7f2d0f681 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:01.223613 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12538f00-e1df-4bfa-bba8-6cbe007d887b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:01.224485 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12538f00-e1df-4bfa-bba8-6cbe007d887b service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:01.224769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12538f00-e1df-4bfa-bba8-6cbe007d887b service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:01.225044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12538f00-e1df-4bfa-bba8-6cbe007d887b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:01.235014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12538f00-e1df-4bfa-bba8-6cbe007d887b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:01.236486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12538f00-e1df-4bfa-bba8-6cbe007d887b service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:01.247337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1192/2429] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:06:01.549905 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d486749-2b57-4188-b401-c43d2a9f8bec None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:01.551706 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-4d486749-2b57-4188-b401-c43d2a9f8bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:01.567424 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d486749-2b57-4188-b401-c43d2a9f8bec None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:01.573956 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e0d39-19dd-49d4-8f40-efe7534b9852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:01.575027 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e0d39-19dd-49d4-8f40-efe7534b9852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:01.575474 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e0d39-19dd-49d4-8f40-efe7534b9852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:01.575865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e0d39-19dd-49d4-8f40-efe7534b9852 admin admin] PATH_INFO: `/v3/projects/a24ede3e62824431af8ad805392153ee` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:01.577716 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e0d39-19dd-49d4-8f40-efe7534b9852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a24ede3e62824431af8ad805392153ee)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:01.580372 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e0d39-19dd-49d4-8f40-efe7534b9852 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:01.632290 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-517e0d39-19dd-49d4-8f40-efe7534b9852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24ede3e62824431af8ad805392153ee', 'request_id': 'req-517e0d39-19dd-49d4-8f40-efe7534b9852'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:01.640682 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-517e0d39-19dd-49d4-8f40-efe7534b9852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24ede3e62824431af8ad805392153ee', 'request_id': 'req-517e0d39-19dd-49d4-8f40-efe7534b9852'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:01.646769 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-517e0d39-19dd-49d4-8f40-efe7534b9852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24ede3e62824431af8ad805392153ee', 'request_id': 'req-517e0d39-19dd-49d4-8f40-efe7534b9852'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:01.659235 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-517e0d39-19dd-49d4-8f40-efe7534b9852 admin admin] The token cache is being invalidate because project a24ede3e62824431af8ad805392153ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:06:01.659551 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-517e0d39-19dd-49d4-8f40-efe7534b9852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:01.660324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-517e0d39-19dd-49d4-8f40-efe7534b9852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:01.664248 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1238/2430] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:06:01 2022] DELETE /identity/v3/projects/a24ede3e62824431af8ad805392153ee => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:01.666243 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12538f00-e1df-4bfa-bba8-6cbe007d887b service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:01.676464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12538f00-e1df-4bfa-bba8-6cbe007d887b service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:01.735109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550d2f9-586b-4ba5-8159-ba9ac78f5893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:01.735982 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550d2f9-586b-4ba5-8159-ba9ac78f5893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:01.736319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550d2f9-586b-4ba5-8159-ba9ac78f5893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:01.736586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550d2f9-586b-4ba5-8159-ba9ac78f5893 admin admin] PATH_INFO: `/v3/users/e90106a04801474184b04f28986fff78` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:01.737768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550d2f9-586b-4ba5-8159-ba9ac78f5893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e90106a04801474184b04f28986fff78)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:01.739676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550d2f9-586b-4ba5-8159-ba9ac78f5893 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:01.788116 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b550d2f9-586b-4ba5-8159-ba9ac78f5893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e90106a04801474184b04f28986fff78'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:01.788791 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b550d2f9-586b-4ba5-8159-ba9ac78f5893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e90106a04801474184b04f28986fff78'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:01.802971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b550d2f9-586b-4ba5-8159-ba9ac78f5893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e90106a04801474184b04f28986fff78'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:01.811465 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b550d2f9-586b-4ba5-8159-ba9ac78f5893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e90106a04801474184b04f28986fff78'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:01.812695 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b550d2f9-586b-4ba5-8159-ba9ac78f5893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e90106a04801474184b04f28986fff78'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:01.825676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1193/2431] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:06:01 2022] DELETE /identity/v3/users/e90106a04801474184b04f28986fff78 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:02.177652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e0d39-19dd-49d4-8f40-efe7534b9852 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:02.179785 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-517e0d39-19dd-49d4-8f40-efe7534b9852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:02.208201 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e0d39-19dd-49d4-8f40-efe7534b9852 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:02.297424 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85019a4f-220d-44cf-81a8-7be6a1fe57b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:02.298552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85019a4f-220d-44cf-81a8-7be6a1fe57b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:02.299527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85019a4f-220d-44cf-81a8-7be6a1fe57b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:02.299887 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85019a4f-220d-44cf-81a8-7be6a1fe57b8 admin admin] PATH_INFO: `/v3/projects/5d54eeec5cd04fa3a92da300e0492538` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:02.301238 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85019a4f-220d-44cf-81a8-7be6a1fe57b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d54eeec5cd04fa3a92da300e0492538)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:02.303203 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85019a4f-220d-44cf-81a8-7be6a1fe57b8 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:02.358312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-85019a4f-220d-44cf-81a8-7be6a1fe57b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d54eeec5cd04fa3a92da300e0492538', 'request_id': 'req-85019a4f-220d-44cf-81a8-7be6a1fe57b8'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:02.366252 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-85019a4f-220d-44cf-81a8-7be6a1fe57b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d54eeec5cd04fa3a92da300e0492538', 'request_id': 'req-85019a4f-220d-44cf-81a8-7be6a1fe57b8'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:02.372641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-85019a4f-220d-44cf-81a8-7be6a1fe57b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d54eeec5cd04fa3a92da300e0492538', 'request_id': 'req-85019a4f-220d-44cf-81a8-7be6a1fe57b8'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:02.386223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-85019a4f-220d-44cf-81a8-7be6a1fe57b8 admin admin] The token cache is being invalidate because project 5d54eeec5cd04fa3a92da300e0492538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:06:02.387018 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-85019a4f-220d-44cf-81a8-7be6a1fe57b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:02.388599 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-85019a4f-220d-44cf-81a8-7be6a1fe57b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:02.396152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1239/2432] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:06:02 2022] DELETE /identity/v3/projects/5d54eeec5cd04fa3a92da300e0492538 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:02.397173 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550d2f9-586b-4ba5-8159-ba9ac78f5893 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:02.399201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b550d2f9-586b-4ba5-8159-ba9ac78f5893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:02.422744 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550d2f9-586b-4ba5-8159-ba9ac78f5893 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:02.509535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4cda9-8ce8-43c5-ae92-7ab0ab3308f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:02.510691 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4cda9-8ce8-43c5-ae92-7ab0ab3308f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:02.511256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4cda9-8ce8-43c5-ae92-7ab0ab3308f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:02.511676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4cda9-8ce8-43c5-ae92-7ab0ab3308f5 admin admin] PATH_INFO: `/v3/users/51face6e2f75496cbcafbf4e2b3b19c8` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:02.515645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4cda9-8ce8-43c5-ae92-7ab0ab3308f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51face6e2f75496cbcafbf4e2b3b19c8)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:02.518610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4cda9-8ce8-43c5-ae92-7ab0ab3308f5 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:02.567298 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-f0e4cda9-8ce8-43c5-ae92-7ab0ab3308f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51face6e2f75496cbcafbf4e2b3b19c8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:02.568052 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-f0e4cda9-8ce8-43c5-ae92-7ab0ab3308f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51face6e2f75496cbcafbf4e2b3b19c8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:02.580781 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-f0e4cda9-8ce8-43c5-ae92-7ab0ab3308f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51face6e2f75496cbcafbf4e2b3b19c8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:02.589757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-f0e4cda9-8ce8-43c5-ae92-7ab0ab3308f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51face6e2f75496cbcafbf4e2b3b19c8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:02.590595 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-f0e4cda9-8ce8-43c5-ae92-7ab0ab3308f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51face6e2f75496cbcafbf4e2b3b19c8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:02.605472 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1194/2433] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:06:02 2022] DELETE /identity/v3/users/51face6e2f75496cbcafbf4e2b3b19c8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:02.904123 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85019a4f-220d-44cf-81a8-7be6a1fe57b8 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:02.909678 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-85019a4f-220d-44cf-81a8-7be6a1fe57b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:02.929280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85019a4f-220d-44cf-81a8-7be6a1fe57b8 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:02.997809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ec846-6033-4ccc-9d1a-35cc243f81e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:02.998991 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ec846-6033-4ccc-9d1a-35cc243f81e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:02.999306 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ec846-6033-4ccc-9d1a-35cc243f81e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:02.999538 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ec846-6033-4ccc-9d1a-35cc243f81e9 admin admin] PATH_INFO: `/v3/projects/1f0efe79770f44159b2ed55b682f810e` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:03.000771 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ec846-6033-4ccc-9d1a-35cc243f81e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0efe79770f44159b2ed55b682f810e)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:03.003235 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ec846-6033-4ccc-9d1a-35cc243f81e9 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:03.055133 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c27ec846-6033-4ccc-9d1a-35cc243f81e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0efe79770f44159b2ed55b682f810e', 'request_id': 'req-c27ec846-6033-4ccc-9d1a-35cc243f81e9'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:03.062775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c27ec846-6033-4ccc-9d1a-35cc243f81e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0efe79770f44159b2ed55b682f810e', 'request_id': 'req-c27ec846-6033-4ccc-9d1a-35cc243f81e9'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:03.069048 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c27ec846-6033-4ccc-9d1a-35cc243f81e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0efe79770f44159b2ed55b682f810e', 'request_id': 'req-c27ec846-6033-4ccc-9d1a-35cc243f81e9'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:03.081079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c27ec846-6033-4ccc-9d1a-35cc243f81e9 admin admin] The token cache is being invalidate because project 1f0efe79770f44159b2ed55b682f810e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:06:03.081354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c27ec846-6033-4ccc-9d1a-35cc243f81e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:03.082008 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c27ec846-6033-4ccc-9d1a-35cc243f81e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:03.083558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1240/2434] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:06:02 2022] DELETE /identity/v3/projects/1f0efe79770f44159b2ed55b682f810e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:03.089639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400760c-acb7-46e3-b70a-c1170dede242 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:03.090056 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400760c-acb7-46e3-b70a-c1170dede242 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:03.090402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400760c-acb7-46e3-b70a-c1170dede242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:03.110102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-0400760c-acb7-46e3-b70a-c1170dede242 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:03.111406 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0400760c-acb7-46e3-b70a-c1170dede242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:03.179606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1195/2435] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:03.188037 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3a54-759c-4b49-ba42-9bf0410f3515 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:03.188574 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3a54-759c-4b49-ba42-9bf0410f3515 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:03.188671 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3a54-759c-4b49-ba42-9bf0410f3515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:03.207505 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-8dca3a54-759c-4b49-ba42-9bf0410f3515 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:03.208762 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-8dca3a54-759c-4b49-ba42-9bf0410f3515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:03.217182 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1241/2436] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:03.221909 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400760c-acb7-46e3-b70a-c1170dede242 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:03.231721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400760c-acb7-46e3-b70a-c1170dede242 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:03.237608 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6f98d-2e87-4077-98a3-7e8e67a2beda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:03.238257 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6f98d-2e87-4077-98a3-7e8e67a2beda admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:03.238536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6f98d-2e87-4077-98a3-7e8e67a2beda admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:03.238874 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6f98d-2e87-4077-98a3-7e8e67a2beda admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:03.239601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6f98d-2e87-4077-98a3-7e8e67a2beda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:06:03.240043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6f98d-2e87-4077-98a3-7e8e67a2beda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:03.241670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6f98d-2e87-4077-98a3-7e8e67a2beda admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:03.254376 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1196/2437] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:06:03.259325 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca3a54-759c-4b49-ba42-9bf0410f3515 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:03.270876 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca3a54-759c-4b49-ba42-9bf0410f3515 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:03.276615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e2a37-c8f1-40fc-bdb6-c4f4ef48b360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:03.277397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e2a37-c8f1-40fc-bdb6-c4f4ef48b360 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:03.277776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e2a37-c8f1-40fc-bdb6-c4f4ef48b360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:03.278273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e2a37-c8f1-40fc-bdb6-c4f4ef48b360 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:03.278981 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e2a37-c8f1-40fc-bdb6-c4f4ef48b360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:03.281084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e2a37-c8f1-40fc-bdb6-c4f4ef48b360 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:03.312734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1242/2438] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:06:03 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:06:03.313918 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6f98d-2e87-4077-98a3-7e8e67a2beda admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:03.325048 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6f98d-2e87-4077-98a3-7e8e67a2beda admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:03.383346 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c3e5b-e100-49ae-9cd9-ff1b12cf4318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:03.384027 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c3e5b-e100-49ae-9cd9-ff1b12cf4318 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:03.384336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c3e5b-e100-49ae-9cd9-ff1b12cf4318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:03.384617 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c3e5b-e100-49ae-9cd9-ff1b12cf4318 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:03.385313 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c3e5b-e100-49ae-9cd9-ff1b12cf4318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:03.387261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c3e5b-e100-49ae-9cd9-ff1b12cf4318 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:03.413532 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1197/2439] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:06:03 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:06:03.417708 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e2a37-c8f1-40fc-bdb6-c4f4ef48b360 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:03.429369 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e2a37-c8f1-40fc-bdb6-c4f4ef48b360 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:03.435262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bef789-dade-4abe-9579-96b7f7bd034e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:03.436241 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bef789-dade-4abe-9579-96b7f7bd034e admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:03.436709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bef789-dade-4abe-9579-96b7f7bd034e admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:03.437082 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bef789-dade-4abe-9579-96b7f7bd034e admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:03.438072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bef789-dade-4abe-9579-96b7f7bd034e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:03.440722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bef789-dade-4abe-9579-96b7f7bd034e admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:03.457404 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1243/2440] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:06:03.460623 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c3e5b-e100-49ae-9cd9-ff1b12cf4318 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:03.474871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c3e5b-e100-49ae-9cd9-ff1b12cf4318 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:03.480052 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30f92b-4956-4348-9f07-a405eb17054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:03.480809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30f92b-4956-4348-9f07-a405eb17054a admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:03.481158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30f92b-4956-4348-9f07-a405eb17054a admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:03.481503 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30f92b-4956-4348-9f07-a405eb17054a admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:03.482323 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30f92b-4956-4348-9f07-a405eb17054a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:03.484268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30f92b-4956-4348-9f07-a405eb17054a admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:03.499962 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1198/2441] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:06:03.500811 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bef789-dade-4abe-9579-96b7f7bd034e admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:03.511353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bef789-dade-4abe-9579-96b7f7bd034e admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:03.516375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72cf0a-d2d9-439a-9734-afbf199b2aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:03.517275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72cf0a-d2d9-439a-9734-afbf199b2aed admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:03.517585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72cf0a-d2d9-439a-9734-afbf199b2aed admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:03.517858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72cf0a-d2d9-439a-9734-afbf199b2aed admin admin] PATH_INFO: `/v3/projects/7a263551cedd420db2fb5b24a60835b8/users/2ff9c506880e45bd87a16af67e107eec/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:03.534997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72cf0a-d2d9-439a-9734-afbf199b2aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a263551cedd420db2fb5b24a60835b8, user_id=2ff9c506880e45bd87a16af67e107eec, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:03.537754 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72cf0a-d2d9-439a-9734-afbf199b2aed admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:03.563126 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1244/2442] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:06:03 2022] PUT /identity/v3/projects/7a263551cedd420db2fb5b24a60835b8/users/2ff9c506880e45bd87a16af67e107eec/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:06:03.568700 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3a0f-8988-482c-9dca-20a6c67cb654 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:03.569112 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3a0f-8988-482c-9dca-20a6c67cb654 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:03.569491 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3a0f-8988-482c-9dca-20a6c67cb654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:03.588311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-41ff3a0f-8988-482c-9dca-20a6c67cb654 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:03.589527 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-41ff3a0f-8988-482c-9dca-20a6c67cb654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:03.650402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1199/2443] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:06:03.661165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72cf0a-d2d9-439a-9734-afbf199b2aed admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:03.663094 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ce72cf0a-d2d9-439a-9734-afbf199b2aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:03.724791 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72cf0a-d2d9-439a-9734-afbf199b2aed admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:03.728756 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7d484-76ea-41dd-bda4-ea8fd45846fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:03.729406 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7d484-76ea-41dd-bda4-ea8fd45846fc service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:03.729688 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7d484-76ea-41dd-bda4-ea8fd45846fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:03.729966 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7d484-76ea-41dd-bda4-ea8fd45846fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:03.740200 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7d484-76ea-41dd-bda4-ea8fd45846fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:03.741679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7d484-76ea-41dd-bda4-ea8fd45846fc service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:03.751348 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1245/2444] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:06:04.463852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb88cd7-0438-4add-8f2f-9308dd01cda4 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:04.464443 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb88cd7-0438-4add-8f2f-9308dd01cda4 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:04.464443 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb88cd7-0438-4add-8f2f-9308dd01cda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:04.494783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-dcb88cd7-0438-4add-8f2f-9308dd01cda4 None None] MFA Rules not processed for user `2ff9c506880e45bd87a16af67e107eec`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:04.496003 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-dcb88cd7-0438-4add-8f2f-9308dd01cda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:04.617654 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1200/2445] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:04.621239 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7d484-76ea-41dd-bda4-ea8fd45846fc service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:04.622950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-17d7d484-76ea-41dd-bda4-ea8fd45846fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:04.725377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7d484-76ea-41dd-bda4-ea8fd45846fc service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:04.729315 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24b29f-e8bf-41e1-91d8-243298771450 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:04.730104 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b29f-e8bf-41e1-91d8-243298771450 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:04.730484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b29f-e8bf-41e1-91d8-243298771450 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:04.730853 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b29f-e8bf-41e1-91d8-243298771450 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:04.760506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24b29f-e8bf-41e1-91d8-243298771450 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:04.762364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24b29f-e8bf-41e1-91d8-243298771450 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:04.772988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1246/2446] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:06:06.244183 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd9d97-1db1-4b12-b77d-c5610c0da6fd None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:06.244783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd9d97-1db1-4b12-b77d-c5610c0da6fd None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:06.244783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd9d97-1db1-4b12-b77d-c5610c0da6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:06.263126 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-a0bd9d97-1db1-4b12-b77d-c5610c0da6fd None None] MFA Rules not processed for user `2ff9c506880e45bd87a16af67e107eec`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:06.264366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a0bd9d97-1db1-4b12-b77d-c5610c0da6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:06.271620 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1201/2447] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:15.076690 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ad218-f5bb-4de0-9587-04a8a43712e3 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:15.078700 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ad218-f5bb-4de0-9587-04a8a43712e3 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:15.080157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ad218-f5bb-4de0-9587-04a8a43712e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:15.100070 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-dc7ad218-f5bb-4de0-9587-04a8a43712e3 None None] MFA Rules not processed for user `df5dcdfb4eda417ebc0af2432497617d`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:15.101552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-dc7ad218-f5bb-4de0-9587-04a8a43712e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:15.167331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1247/2448] 10.222.0.49 () {58 vars in 967 bytes} [Tue May 10 14:06:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:15.180932 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd9d97-1db1-4b12-b77d-c5610c0da6fd None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:15.182985 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a0bd9d97-1db1-4b12-b77d-c5610c0da6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:15.252132 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd9d97-1db1-4b12-b77d-c5610c0da6fd None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:15.259860 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60b72e-987c-4fb3-8744-ce2e5d895573 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd102155cd1bd4368ad272668da1651f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:15.260658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b72e-987c-4fb3-8744-ce2e5d895573 service swift] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:15.260838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b72e-987c-4fb3-8744-ce2e5d895573 service swift] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:15.261107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b72e-987c-4fb3-8744-ce2e5d895573 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:15.270787 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60b72e-987c-4fb3-8744-ce2e5d895573 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:15.272425 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60b72e-987c-4fb3-8744-ce2e5d895573 service swift] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:15.281030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1202/2449] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 14:06:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:06:23.406818 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e06f6f-68e4-4237-b197-89c6c5d48c52 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:23.407397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e06f6f-68e4-4237-b197-89c6c5d48c52 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:23.407517 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e06f6f-68e4-4237-b197-89c6c5d48c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:23.425568 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-44e06f6f-68e4-4237-b197-89c6c5d48c52 None None] MFA Rules not processed for user `2ff9c506880e45bd87a16af67e107eec`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:23.426729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-44e06f6f-68e4-4237-b197-89c6c5d48c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:23.433639 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1248/2450] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:26.663446 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60b72e-987c-4fb3-8744-ce2e5d895573 service swift] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:26.675576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60b72e-987c-4fb3-8744-ce2e5d895573 service swift] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:26.681252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3273363-fd92-4786-b71a-2b086b7804a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:26.682355 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3273363-fd92-4786-b71a-2b086b7804a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:26.683006 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3273363-fd92-4786-b71a-2b086b7804a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:26.683785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3273363-fd92-4786-b71a-2b086b7804a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:26.685877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-e3273363-fd92-4786-b71a-2b086b7804a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:26.702723 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3273363-fd92-4786-b71a-2b086b7804a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:26.704730 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3273363-fd92-4786-b71a-2b086b7804a5 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:26.715868 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1203/2451] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:06:32.038862 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e06f6f-68e4-4237-b197-89c6c5d48c52 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:32.040308 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-44e06f6f-68e4-4237-b197-89c6c5d48c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:32.054563 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e06f6f-68e4-4237-b197-89c6c5d48c52 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:32.059173 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b835f14-9482-4c96-a6b0-1695d02ae511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:32.060039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b835f14-9482-4c96-a6b0-1695d02ae511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:32.060349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b835f14-9482-4c96-a6b0-1695d02ae511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:32.060625 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b835f14-9482-4c96-a6b0-1695d02ae511 admin admin] PATH_INFO: `/v3/users/def10f42c8744e1d8526087c874ceedd` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:32.061997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b835f14-9482-4c96-a6b0-1695d02ae511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=def10f42c8744e1d8526087c874ceedd)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:32.064577 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b835f14-9482-4c96-a6b0-1695d02ae511 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:32.109657 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-1b835f14-9482-4c96-a6b0-1695d02ae511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def10f42c8744e1d8526087c874ceedd'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:32.120978 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-1b835f14-9482-4c96-a6b0-1695d02ae511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def10f42c8744e1d8526087c874ceedd'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:32.128260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-1b835f14-9482-4c96-a6b0-1695d02ae511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def10f42c8744e1d8526087c874ceedd'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:32.128858 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-1b835f14-9482-4c96-a6b0-1695d02ae511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def10f42c8744e1d8526087c874ceedd'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:32.136192 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-1b835f14-9482-4c96-a6b0-1695d02ae511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def10f42c8744e1d8526087c874ceedd'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:32.143381 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1249/2452] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:06:32 2022] DELETE /identity/v3/users/def10f42c8744e1d8526087c874ceedd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:32.314840 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3273363-fd92-4786-b71a-2b086b7804a5 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:32.333952 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3273363-fd92-4786-b71a-2b086b7804a5 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:32.398181 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce256c-2803-4e51-bc8f-f76354d01597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:32.399212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce256c-2803-4e51-bc8f-f76354d01597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:32.399501 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce256c-2803-4e51-bc8f-f76354d01597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:32.399790 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce256c-2803-4e51-bc8f-f76354d01597 admin admin] PATH_INFO: `/v3/projects/d19ea52173a04c8e8624b91ac0e3eb48` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:32.401019 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce256c-2803-4e51-bc8f-f76354d01597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d19ea52173a04c8e8624b91ac0e3eb48)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:32.403209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce256c-2803-4e51-bc8f-f76354d01597 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:32.462780 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-9bce256c-2803-4e51-bc8f-f76354d01597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd19ea52173a04c8e8624b91ac0e3eb48', 'request_id': 'req-9bce256c-2803-4e51-bc8f-f76354d01597'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:32.468947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-9bce256c-2803-4e51-bc8f-f76354d01597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd19ea52173a04c8e8624b91ac0e3eb48', 'request_id': 'req-9bce256c-2803-4e51-bc8f-f76354d01597'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:32.475631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-9bce256c-2803-4e51-bc8f-f76354d01597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd19ea52173a04c8e8624b91ac0e3eb48', 'request_id': 'req-9bce256c-2803-4e51-bc8f-f76354d01597'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:32.490999 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-9bce256c-2803-4e51-bc8f-f76354d01597 admin admin] The token cache is being invalidate because project d19ea52173a04c8e8624b91ac0e3eb48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:06:32.492143 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-9bce256c-2803-4e51-bc8f-f76354d01597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:32.493058 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-9bce256c-2803-4e51-bc8f-f76354d01597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:32.494606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1204/2453] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:06:32 2022] DELETE /identity/v3/projects/d19ea52173a04c8e8624b91ac0e3eb48 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:32.499384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683482c-d69c-4f04-bad8-7c6cb0dd79bd None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:32.499672 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683482c-d69c-4f04-bad8-7c6cb0dd79bd None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:32.499951 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683482c-d69c-4f04-bad8-7c6cb0dd79bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:32.518495 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-5683482c-d69c-4f04-bad8-7c6cb0dd79bd None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:32.519677 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-5683482c-d69c-4f04-bad8-7c6cb0dd79bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:32.588096 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1250/2454] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:32.595699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae55bbe-728e-41a1-b450-2c3b7026174c None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:32.596099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae55bbe-728e-41a1-b450-2c3b7026174c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:32.596406 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae55bbe-728e-41a1-b450-2c3b7026174c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:32.615270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-aae55bbe-728e-41a1-b450-2c3b7026174c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:32.616524 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-aae55bbe-728e-41a1-b450-2c3b7026174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:32.624639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1205/2455] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:32.629500 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683482c-d69c-4f04-bad8-7c6cb0dd79bd None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:32.639301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683482c-d69c-4f04-bad8-7c6cb0dd79bd None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:32.644410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba04beb-f9fb-4e16-8e9a-b9a98261d9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:32.645160 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04beb-f9fb-4e16-8e9a-b9a98261d9ca admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:32.645506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04beb-f9fb-4e16-8e9a-b9a98261d9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:32.645848 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04beb-f9fb-4e16-8e9a-b9a98261d9ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:32.646640 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba04beb-f9fb-4e16-8e9a-b9a98261d9ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:06:32.647019 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba04beb-f9fb-4e16-8e9a-b9a98261d9ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:32.648616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba04beb-f9fb-4e16-8e9a-b9a98261d9ca admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:32.660757 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1251/2456] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:06:32.665292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae55bbe-728e-41a1-b450-2c3b7026174c None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:32.675180 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae55bbe-728e-41a1-b450-2c3b7026174c None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:32.680015 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0288a3-ae28-4e3c-b325-b861794ac9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:32.680767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0288a3-ae28-4e3c-b325-b861794ac9bd admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:32.681051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0288a3-ae28-4e3c-b325-b861794ac9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:32.681325 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0288a3-ae28-4e3c-b325-b861794ac9bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:32.682003 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0288a3-ae28-4e3c-b325-b861794ac9bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:32.683967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0288a3-ae28-4e3c-b325-b861794ac9bd admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:32.718819 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1206/2457] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:06:32 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:06:32.722949 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba04beb-f9fb-4e16-8e9a-b9a98261d9ca admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:32.733720 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba04beb-f9fb-4e16-8e9a-b9a98261d9ca admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:32.792758 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139d976-6ea9-4a4e-a624-64337d3cda22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:32.793430 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139d976-6ea9-4a4e-a624-64337d3cda22 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:32.793712 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139d976-6ea9-4a4e-a624-64337d3cda22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:32.794016 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139d976-6ea9-4a4e-a624-64337d3cda22 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:32.794719 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139d976-6ea9-4a4e-a624-64337d3cda22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:32.796652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139d976-6ea9-4a4e-a624-64337d3cda22 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:32.815813 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1252/2458] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:06:32 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:06:32.820122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0288a3-ae28-4e3c-b325-b861794ac9bd admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:32.830791 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0288a3-ae28-4e3c-b325-b861794ac9bd admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:32.835486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879da48-c635-4280-93c5-4439bc9f0a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:32.836135 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879da48-c635-4280-93c5-4439bc9f0a1a admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:32.836449 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879da48-c635-4280-93c5-4439bc9f0a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:32.836724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879da48-c635-4280-93c5-4439bc9f0a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:32.837438 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879da48-c635-4280-93c5-4439bc9f0a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:32.839056 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879da48-c635-4280-93c5-4439bc9f0a1a admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:32.849531 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1207/2459] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:06:32.853527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139d976-6ea9-4a4e-a624-64337d3cda22 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:32.864127 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139d976-6ea9-4a4e-a624-64337d3cda22 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:32.868839 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95968eb8-b2a5-4d8d-88c9-0da3eb698519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:32.869549 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95968eb8-b2a5-4d8d-88c9-0da3eb698519 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:32.869832 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95968eb8-b2a5-4d8d-88c9-0da3eb698519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:32.870106 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95968eb8-b2a5-4d8d-88c9-0da3eb698519 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:32.870847 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95968eb8-b2a5-4d8d-88c9-0da3eb698519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:32.872966 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95968eb8-b2a5-4d8d-88c9-0da3eb698519 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:32.883270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1253/2460] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:06:32.887414 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879da48-c635-4280-93c5-4439bc9f0a1a admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:32.897706 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879da48-c635-4280-93c5-4439bc9f0a1a admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:32.902299 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2d634-a587-4092-98da-bf437818a1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:32.903161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2d634-a587-4092-98da-bf437818a1b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:32.903436 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2d634-a587-4092-98da-bf437818a1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:32.903704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2d634-a587-4092-98da-bf437818a1b1 admin admin] PATH_INFO: `/v3/projects/8fc4e3c9ae794504925e03a6e1466801/users/cd398bc729024cc3926518da8d57a436/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:32.919157 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2d634-a587-4092-98da-bf437818a1b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fc4e3c9ae794504925e03a6e1466801, user_id=cd398bc729024cc3926518da8d57a436, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:32.921801 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2d634-a587-4092-98da-bf437818a1b1 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:32.934945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1208/2461] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:06:32 2022] PUT /identity/v3/projects/8fc4e3c9ae794504925e03a6e1466801/users/cd398bc729024cc3926518da8d57a436/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:06:32.945822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2903605-bfc8-45bf-8788-7c634e56c17a None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:32.946215 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2903605-bfc8-45bf-8788-7c634e56c17a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:32.946590 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2903605-bfc8-45bf-8788-7c634e56c17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:32.973019 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f2903605-bfc8-45bf-8788-7c634e56c17a None None] MFA Rules not processed for user `cd398bc729024cc3926518da8d57a436`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:32.974202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f2903605-bfc8-45bf-8788-7c634e56c17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:33.035859 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1254/2462] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:33.040286 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2d634-a587-4092-98da-bf437818a1b1 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:33.100966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2d634-a587-4092-98da-bf437818a1b1 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:33.105549 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b344b4-0c3e-4a5b-9959-563dc5e883c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:33.106193 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b344b4-0c3e-4a5b-9959-563dc5e883c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:33.106468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b344b4-0c3e-4a5b-9959-563dc5e883c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:33.106741 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b344b4-0c3e-4a5b-9959-563dc5e883c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:33.107432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b344b4-0c3e-4a5b-9959-563dc5e883c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:33.109336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b344b4-0c3e-4a5b-9959-563dc5e883c4 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:33.136729 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1209/2463] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:06:33 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:06:33.140863 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2903605-bfc8-45bf-8788-7c634e56c17a None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:33.151959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2903605-bfc8-45bf-8788-7c634e56c17a None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:33.213486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557a2ac-5948-4a28-8981-463c46ba579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:33.214282 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557a2ac-5948-4a28-8981-463c46ba579d admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:33.214678 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557a2ac-5948-4a28-8981-463c46ba579d admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:33.215019 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557a2ac-5948-4a28-8981-463c46ba579d admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:33.215777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557a2ac-5948-4a28-8981-463c46ba579d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:33.217839 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557a2ac-5948-4a28-8981-463c46ba579d admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:33.237898 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1255/2464] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:06:33 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:06:33.241920 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b344b4-0c3e-4a5b-9959-563dc5e883c4 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:33.252569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b344b4-0c3e-4a5b-9959-563dc5e883c4 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:33.257309 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e82b15-8207-470e-85b5-8d04a876f07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:33.257959 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e82b15-8207-470e-85b5-8d04a876f07d admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:33.258236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e82b15-8207-470e-85b5-8d04a876f07d admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:33.258512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e82b15-8207-470e-85b5-8d04a876f07d admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:33.259361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e82b15-8207-470e-85b5-8d04a876f07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:33.260837 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e82b15-8207-470e-85b5-8d04a876f07d admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:33.272335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1210/2465] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:06:33.276444 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557a2ac-5948-4a28-8981-463c46ba579d admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:33.287119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557a2ac-5948-4a28-8981-463c46ba579d admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:33.291835 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777facaa-8194-45ba-bc59-ef11cf75ef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:33.292745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777facaa-8194-45ba-bc59-ef11cf75ef5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:33.293027 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777facaa-8194-45ba-bc59-ef11cf75ef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:33.293302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777facaa-8194-45ba-bc59-ef11cf75ef5d admin admin] PATH_INFO: `/v3/projects/61f99d4458304266ac78f8e6402d0cd0/users/f3801b4d636546b3964aa6f0d9bfdf2f/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:33.307353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777facaa-8194-45ba-bc59-ef11cf75ef5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f99d4458304266ac78f8e6402d0cd0, user_id=f3801b4d636546b3964aa6f0d9bfdf2f, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:33.310038 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777facaa-8194-45ba-bc59-ef11cf75ef5d admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:33.322220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1256/2466] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:06:33 2022] PUT /identity/v3/projects/61f99d4458304266ac78f8e6402d0cd0/users/f3801b4d636546b3964aa6f0d9bfdf2f/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:33.326152 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e82b15-8207-470e-85b5-8d04a876f07d admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:33.336938 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e82b15-8207-470e-85b5-8d04a876f07d admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:33.391513 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc34a15-0560-4b37-a429-c6c69a2fb2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:33.392178 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc34a15-0560-4b37-a429-c6c69a2fb2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:33.392732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc34a15-0560-4b37-a429-c6c69a2fb2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:33.393106 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc34a15-0560-4b37-a429-c6c69a2fb2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:33.393821 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc34a15-0560-4b37-a429-c6c69a2fb2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:33.395393 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc34a15-0560-4b37-a429-c6c69a2fb2e5 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:33.406293 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1211/2467] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:06:33.409768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777facaa-8194-45ba-bc59-ef11cf75ef5d admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:33.420000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777facaa-8194-45ba-bc59-ef11cf75ef5d admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:33.424814 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3450f45-2e31-4b94-86a8-e348e453a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:33.425690 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3450f45-2e31-4b94-86a8-e348e453a41a admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:33.425966 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3450f45-2e31-4b94-86a8-e348e453a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:33.426238 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3450f45-2e31-4b94-86a8-e348e453a41a admin admin] PATH_INFO: `/v3/projects/61f99d4458304266ac78f8e6402d0cd0/users/f3801b4d636546b3964aa6f0d9bfdf2f/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:33.428279 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3450f45-2e31-4b94-86a8-e348e453a41a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f99d4458304266ac78f8e6402d0cd0, user_id=f3801b4d636546b3964aa6f0d9bfdf2f, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:33.430924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3450f45-2e31-4b94-86a8-e348e453a41a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:33.441098 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1257/2468] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:06:33 2022] PUT /identity/v3/projects/61f99d4458304266ac78f8e6402d0cd0/users/f3801b4d636546b3964aa6f0d9bfdf2f/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:33.451019 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5881ad9-10f1-4d66-a023-6d6dd17621f1 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:33.451301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5881ad9-10f1-4d66-a023-6d6dd17621f1 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:33.451574 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5881ad9-10f1-4d66-a023-6d6dd17621f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:33.477365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-f5881ad9-10f1-4d66-a023-6d6dd17621f1 None None] MFA Rules not processed for user `f3801b4d636546b3964aa6f0d9bfdf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:33.478541 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-f5881ad9-10f1-4d66-a023-6d6dd17621f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:33.543823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1212/2469] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:33.555005 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3450f45-2e31-4b94-86a8-e348e453a41a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:33.556801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e3450f45-2e31-4b94-86a8-e348e453a41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:33.619048 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3450f45-2e31-4b94-86a8-e348e453a41a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:33.623407 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195b982-5d20-46bc-8d98-af64cae14ad3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:33.624062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195b982-5d20-46bc-8d98-af64cae14ad3 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:33.624370 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195b982-5d20-46bc-8d98-af64cae14ad3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:33.624689 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195b982-5d20-46bc-8d98-af64cae14ad3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:33.634959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195b982-5d20-46bc-8d98-af64cae14ad3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:33.636422 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195b982-5d20-46bc-8d98-af64cae14ad3 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:33.648899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1258/2470] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:06:33.703387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5881ad9-10f1-4d66-a023-6d6dd17621f1 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:33.705379 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-f5881ad9-10f1-4d66-a023-6d6dd17621f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:33.772560 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5881ad9-10f1-4d66-a023-6d6dd17621f1 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:33.776212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d57cd1-672b-4125-9eae-06e30258b443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:33.777280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d57cd1-672b-4125-9eae-06e30258b443 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:33.777567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d57cd1-672b-4125-9eae-06e30258b443 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:33.777851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d57cd1-672b-4125-9eae-06e30258b443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:33.779694 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-16d57cd1-672b-4125-9eae-06e30258b443 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:33.849143 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d57cd1-672b-4125-9eae-06e30258b443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:33.850904 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d57cd1-672b-4125-9eae-06e30258b443 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:33.863269 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1213/2471] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:06:34.064836 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195b982-5d20-46bc-8d98-af64cae14ad3 service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:34.075792 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195b982-5d20-46bc-8d98-af64cae14ad3 service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:34.080725 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb97b81-1a86-47fd-b0b4-69ccd1a6c88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:34.081593 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb97b81-1a86-47fd-b0b4-69ccd1a6c88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:34.081874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb97b81-1a86-47fd-b0b4-69ccd1a6c88b admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:34.082145 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb97b81-1a86-47fd-b0b4-69ccd1a6c88b admin admin] PATH_INFO: `/v3/users/cd398bc729024cc3926518da8d57a436` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:34.083360 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb97b81-1a86-47fd-b0b4-69ccd1a6c88b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd398bc729024cc3926518da8d57a436)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:34.085313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb97b81-1a86-47fd-b0b4-69ccd1a6c88b admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:34.132073 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-0eb97b81-1a86-47fd-b0b4-69ccd1a6c88b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd398bc729024cc3926518da8d57a436'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:34.144649 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-0eb97b81-1a86-47fd-b0b4-69ccd1a6c88b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd398bc729024cc3926518da8d57a436'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:34.151338 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-0eb97b81-1a86-47fd-b0b4-69ccd1a6c88b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd398bc729024cc3926518da8d57a436'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:34.152089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-0eb97b81-1a86-47fd-b0b4-69ccd1a6c88b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd398bc729024cc3926518da8d57a436'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:34.159958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-0eb97b81-1a86-47fd-b0b4-69ccd1a6c88b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd398bc729024cc3926518da8d57a436'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:34.166203 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1259/2472] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:06:34 2022] DELETE /identity/v3/users/cd398bc729024cc3926518da8d57a436 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:34.170768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1c91-00a0-40d5-81a6-e184f491c792 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:34.171059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1c91-00a0-40d5-81a6-e184f491c792 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:34.171338 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1c91-00a0-40d5-81a6-e184f491c792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:34.189075 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-618f1c91-00a0-40d5-81a6-e184f491c792 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:34.190263 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-618f1c91-00a0-40d5-81a6-e184f491c792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:34.246426 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1214/2473] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:34.256601 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb97b81-1a86-47fd-b0b4-69ccd1a6c88b admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:34.257990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-0eb97b81-1a86-47fd-b0b4-69ccd1a6c88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:34.320929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb97b81-1a86-47fd-b0b4-69ccd1a6c88b admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:34.324588 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1205a5-6538-407d-b647-5fcf03d8921b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:34.325257 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1205a5-6538-407d-b647-5fcf03d8921b service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:34.325533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1205a5-6538-407d-b647-5fcf03d8921b service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:34.325802 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1205a5-6538-407d-b647-5fcf03d8921b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:34.334896 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1205a5-6538-407d-b647-5fcf03d8921b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:34.336344 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1205a5-6538-407d-b647-5fcf03d8921b service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:34.346439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1260/2474] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:06:34.894706 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1c91-00a0-40d5-81a6-e184f491c792 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:34.896471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-618f1c91-00a0-40d5-81a6-e184f491c792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:34.909406 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1c91-00a0-40d5-81a6-e184f491c792 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:34.920797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea4df5-8098-4232-93b4-725cec14ccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:34.922569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea4df5-8098-4232-93b4-725cec14ccc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:34.924557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea4df5-8098-4232-93b4-725cec14ccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:34.925376 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea4df5-8098-4232-93b4-725cec14ccc9 admin admin] PATH_INFO: `/v3/projects/8fc4e3c9ae794504925e03a6e1466801` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:34.930291 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea4df5-8098-4232-93b4-725cec14ccc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fc4e3c9ae794504925e03a6e1466801)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:34.932525 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea4df5-8098-4232-93b4-725cec14ccc9 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:34.982988 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-79ea4df5-8098-4232-93b4-725cec14ccc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fc4e3c9ae794504925e03a6e1466801', 'request_id': 'req-79ea4df5-8098-4232-93b4-725cec14ccc9'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:34.988873 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-79ea4df5-8098-4232-93b4-725cec14ccc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fc4e3c9ae794504925e03a6e1466801', 'request_id': 'req-79ea4df5-8098-4232-93b4-725cec14ccc9'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:34.995029 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-79ea4df5-8098-4232-93b4-725cec14ccc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fc4e3c9ae794504925e03a6e1466801', 'request_id': 'req-79ea4df5-8098-4232-93b4-725cec14ccc9'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:35.007524 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-79ea4df5-8098-4232-93b4-725cec14ccc9 admin admin] The token cache is being invalidate because project 8fc4e3c9ae794504925e03a6e1466801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:06:35.007850 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-79ea4df5-8098-4232-93b4-725cec14ccc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:35.008460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-79ea4df5-8098-4232-93b4-725cec14ccc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:35.010042 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1215/2475] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:06:34 2022] DELETE /identity/v3/projects/8fc4e3c9ae794504925e03a6e1466801 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:35.013949 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1205a5-6538-407d-b647-5fcf03d8921b service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:35.025481 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1205a5-6538-407d-b647-5fcf03d8921b service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:35.090817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e864f-791e-480f-856b-ce85f890d607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:35.091819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e864f-791e-480f-856b-ce85f890d607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:35.092161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e864f-791e-480f-856b-ce85f890d607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:35.092514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e864f-791e-480f-856b-ce85f890d607 admin admin] PATH_INFO: `/v3/users/f3801b4d636546b3964aa6f0d9bfdf2f` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:35.094373 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e864f-791e-480f-856b-ce85f890d607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3801b4d636546b3964aa6f0d9bfdf2f)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:35.096830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e864f-791e-480f-856b-ce85f890d607 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:35.167385 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c30e864f-791e-480f-856b-ce85f890d607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3801b4d636546b3964aa6f0d9bfdf2f'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:35.206703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c30e864f-791e-480f-856b-ce85f890d607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3801b4d636546b3964aa6f0d9bfdf2f'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:35.221257 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c30e864f-791e-480f-856b-ce85f890d607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3801b4d636546b3964aa6f0d9bfdf2f'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:35.222300 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c30e864f-791e-480f-856b-ce85f890d607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3801b4d636546b3964aa6f0d9bfdf2f'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:35.233773 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c30e864f-791e-480f-856b-ce85f890d607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3801b4d636546b3964aa6f0d9bfdf2f'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:35.244611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1261/2476] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:06:35 2022] DELETE /identity/v3/users/f3801b4d636546b3964aa6f0d9bfdf2f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:35.626970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea4df5-8098-4232-93b4-725cec14ccc9 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:35.628506 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-79ea4df5-8098-4232-93b4-725cec14ccc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:35.644512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea4df5-8098-4232-93b4-725cec14ccc9 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:35.709800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15883492-8882-4021-b216-9c7d2ee3d8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:35.710683 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15883492-8882-4021-b216-9c7d2ee3d8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:35.710965 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15883492-8882-4021-b216-9c7d2ee3d8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:35.711248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15883492-8882-4021-b216-9c7d2ee3d8ca admin admin] PATH_INFO: `/v3/projects/61f99d4458304266ac78f8e6402d0cd0` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:35.712470 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15883492-8882-4021-b216-9c7d2ee3d8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f99d4458304266ac78f8e6402d0cd0)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:35.714408 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15883492-8882-4021-b216-9c7d2ee3d8ca admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:35.762285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-15883492-8882-4021-b216-9c7d2ee3d8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f99d4458304266ac78f8e6402d0cd0', 'request_id': 'req-15883492-8882-4021-b216-9c7d2ee3d8ca'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:35.772451 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-15883492-8882-4021-b216-9c7d2ee3d8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f99d4458304266ac78f8e6402d0cd0', 'request_id': 'req-15883492-8882-4021-b216-9c7d2ee3d8ca'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:35.778705 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-15883492-8882-4021-b216-9c7d2ee3d8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f99d4458304266ac78f8e6402d0cd0', 'request_id': 'req-15883492-8882-4021-b216-9c7d2ee3d8ca'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:35.795802 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-15883492-8882-4021-b216-9c7d2ee3d8ca admin admin] The token cache is being invalidate because project 61f99d4458304266ac78f8e6402d0cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:06:35.796285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-15883492-8882-4021-b216-9c7d2ee3d8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:35.797153 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-15883492-8882-4021-b216-9c7d2ee3d8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:35.802719 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1216/2477] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:06:35 2022] DELETE /identity/v3/projects/61f99d4458304266ac78f8e6402d0cd0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:06:35.804458 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1fcf2-8bf6-4dcd-be16-777ef07bcfbf None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:35.804841 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1fcf2-8bf6-4dcd-be16-777ef07bcfbf None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:35.805226 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1fcf2-8bf6-4dcd-be16-777ef07bcfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:35.825178 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f3e1fcf2-8bf6-4dcd-be16-777ef07bcfbf None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:35.826418 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f3e1fcf2-8bf6-4dcd-be16-777ef07bcfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:35.894048 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1262/2478] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:35.902124 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb1e20-057e-4106-95ad-ec61c629168d None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:35.902670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb1e20-057e-4106-95ad-ec61c629168d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:35.902670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb1e20-057e-4106-95ad-ec61c629168d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:35.923388 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-38bb1e20-057e-4106-95ad-ec61c629168d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:35.925016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-38bb1e20-057e-4106-95ad-ec61c629168d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:35.933319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1217/2479] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:35.937416 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1fcf2-8bf6-4dcd-be16-777ef07bcfbf None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:35.947432 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1fcf2-8bf6-4dcd-be16-777ef07bcfbf None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:35.952518 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18758f0e-e072-48b1-8217-da5858cfc924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:35.953071 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18758f0e-e072-48b1-8217-da5858cfc924 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:35.953843 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18758f0e-e072-48b1-8217-da5858cfc924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:35.953843 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18758f0e-e072-48b1-8217-da5858cfc924 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:35.954533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18758f0e-e072-48b1-8217-da5858cfc924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:06:35.955542 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18758f0e-e072-48b1-8217-da5858cfc924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:35.957298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18758f0e-e072-48b1-8217-da5858cfc924 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:35.973962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1263/2480] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:06:35.975694 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb1e20-057e-4106-95ad-ec61c629168d None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:35.987283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb1e20-057e-4106-95ad-ec61c629168d None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:35.992859 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c3b78-210e-4748-8ab8-f61cd2e5544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:35.994224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c3b78-210e-4748-8ab8-f61cd2e5544d admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:35.995310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c3b78-210e-4748-8ab8-f61cd2e5544d admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:35.995910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c3b78-210e-4748-8ab8-f61cd2e5544d admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:35.996898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c3b78-210e-4748-8ab8-f61cd2e5544d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:35.998975 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c3b78-210e-4748-8ab8-f61cd2e5544d admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:36.030763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1218/2481] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:06:35 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:06:36.036028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18758f0e-e072-48b1-8217-da5858cfc924 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:36.048247 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18758f0e-e072-48b1-8217-da5858cfc924 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:36.108922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90be1e-fdf8-4fc5-b876-70eb11143513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:36.110361 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90be1e-fdf8-4fc5-b876-70eb11143513 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:36.110828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90be1e-fdf8-4fc5-b876-70eb11143513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:36.111432 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90be1e-fdf8-4fc5-b876-70eb11143513 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:36.112482 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90be1e-fdf8-4fc5-b876-70eb11143513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:36.114594 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90be1e-fdf8-4fc5-b876-70eb11143513 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:36.135967 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1264/2482] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:06:36 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:06:36.140231 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c3b78-210e-4748-8ab8-f61cd2e5544d admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:36.150772 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c3b78-210e-4748-8ab8-f61cd2e5544d admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:36.157195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fe176-82b4-4480-a592-cff3f01d6730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:36.157967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fe176-82b4-4480-a592-cff3f01d6730 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:36.158249 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fe176-82b4-4480-a592-cff3f01d6730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:36.158523 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fe176-82b4-4480-a592-cff3f01d6730 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:36.159241 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638fe176-82b4-4480-a592-cff3f01d6730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:36.160889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638fe176-82b4-4480-a592-cff3f01d6730 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:36.171397 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1219/2483] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:06:36.175995 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90be1e-fdf8-4fc5-b876-70eb11143513 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:36.186746 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90be1e-fdf8-4fc5-b876-70eb11143513 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:36.194924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373be023-e6b4-4306-82f7-6137afeb0535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:36.196617 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373be023-e6b4-4306-82f7-6137afeb0535 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:36.200019 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373be023-e6b4-4306-82f7-6137afeb0535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:36.201339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373be023-e6b4-4306-82f7-6137afeb0535 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:36.202216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373be023-e6b4-4306-82f7-6137afeb0535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:36.204561 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373be023-e6b4-4306-82f7-6137afeb0535 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:36.218886 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1265/2484] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:06:36.222977 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fe176-82b4-4480-a592-cff3f01d6730 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:36.233319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fe176-82b4-4480-a592-cff3f01d6730 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:36.238618 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549fdba-4fc9-406b-8afd-4ec1e9f64b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:36.239512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549fdba-4fc9-406b-8afd-4ec1e9f64b8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:36.239792 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549fdba-4fc9-406b-8afd-4ec1e9f64b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:36.240062 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549fdba-4fc9-406b-8afd-4ec1e9f64b8f admin admin] PATH_INFO: `/v3/projects/cfd4337045164a92a74bf4964581fc97/users/42f15130196546b6b6e092573a7953dd/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:36.256938 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549fdba-4fc9-406b-8afd-4ec1e9f64b8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd4337045164a92a74bf4964581fc97, user_id=42f15130196546b6b6e092573a7953dd, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:36.259593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549fdba-4fc9-406b-8afd-4ec1e9f64b8f admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:36.276216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1220/2485] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:06:36 2022] PUT /identity/v3/projects/cfd4337045164a92a74bf4964581fc97/users/42f15130196546b6b6e092573a7953dd/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:36.288538 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc73ed7-8c6a-4c58-a28e-8f10544e91c1 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:36.288825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc73ed7-8c6a-4c58-a28e-8f10544e91c1 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:36.289097 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc73ed7-8c6a-4c58-a28e-8f10544e91c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:36.330377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-7dc73ed7-8c6a-4c58-a28e-8f10544e91c1 None None] MFA Rules not processed for user `42f15130196546b6b6e092573a7953dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:36.331592 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-7dc73ed7-8c6a-4c58-a28e-8f10544e91c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:36.406202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1266/2486] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:36.411325 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549fdba-4fc9-406b-8afd-4ec1e9f64b8f admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:36.477373 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549fdba-4fc9-406b-8afd-4ec1e9f64b8f admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:36.482164 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e526d3e-3be6-4db9-a755-f8740eab3065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:36.482811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e526d3e-3be6-4db9-a755-f8740eab3065 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:36.483093 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e526d3e-3be6-4db9-a755-f8740eab3065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:36.483363 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e526d3e-3be6-4db9-a755-f8740eab3065 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:36.484043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e526d3e-3be6-4db9-a755-f8740eab3065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:36.487003 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e526d3e-3be6-4db9-a755-f8740eab3065 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:36.513805 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1221/2487] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:06:36 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:06:36.518732 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc73ed7-8c6a-4c58-a28e-8f10544e91c1 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:36.530733 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc73ed7-8c6a-4c58-a28e-8f10544e91c1 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:36.591765 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52be07-6ef9-44fb-b4d7-caded399d79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:36.592478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52be07-6ef9-44fb-b4d7-caded399d79f admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:36.592829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52be07-6ef9-44fb-b4d7-caded399d79f admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:36.593173 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52be07-6ef9-44fb-b4d7-caded399d79f admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:36.593958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52be07-6ef9-44fb-b4d7-caded399d79f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:36.596765 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52be07-6ef9-44fb-b4d7-caded399d79f admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:36.624530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1267/2488] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:06:36 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:06:36.626528 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e526d3e-3be6-4db9-a755-f8740eab3065 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:36.638821 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e526d3e-3be6-4db9-a755-f8740eab3065 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:36.644972 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9dcea-c5ff-4c65-9713-2d0ba121fe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:36.645726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9dcea-c5ff-4c65-9713-2d0ba121fe1d admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:36.646083 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9dcea-c5ff-4c65-9713-2d0ba121fe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:36.646499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9dcea-c5ff-4c65-9713-2d0ba121fe1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:36.647436 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9dcea-c5ff-4c65-9713-2d0ba121fe1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:36.649198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9dcea-c5ff-4c65-9713-2d0ba121fe1d admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:36.669709 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1222/2489] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:06:36.673791 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52be07-6ef9-44fb-b4d7-caded399d79f admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:36.687187 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52be07-6ef9-44fb-b4d7-caded399d79f admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:36.692810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98add2c7-307a-4dc3-89f2-1e2818c6db81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:36.693524 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98add2c7-307a-4dc3-89f2-1e2818c6db81 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:36.693807 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98add2c7-307a-4dc3-89f2-1e2818c6db81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:36.694086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98add2c7-307a-4dc3-89f2-1e2818c6db81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:36.694903 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98add2c7-307a-4dc3-89f2-1e2818c6db81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:36.696663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98add2c7-307a-4dc3-89f2-1e2818c6db81 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:36.708655 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1268/2490] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:06:36.712773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9dcea-c5ff-4c65-9713-2d0ba121fe1d admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:36.723500 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9dcea-c5ff-4c65-9713-2d0ba121fe1d admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:36.729420 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861092f0-84a2-4bbf-8b14-f528257f2aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:36.730017 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861092f0-84a2-4bbf-8b14-f528257f2aac admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:36.730362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861092f0-84a2-4bbf-8b14-f528257f2aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:36.730702 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861092f0-84a2-4bbf-8b14-f528257f2aac admin admin] PATH_INFO: `/v3/projects/f9a357fbd6914a31bd04ace122205a14/users/3e631109ac174cee8602043370dc5484/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:36.747031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861092f0-84a2-4bbf-8b14-f528257f2aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a357fbd6914a31bd04ace122205a14, user_id=3e631109ac174cee8602043370dc5484, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:36.749768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861092f0-84a2-4bbf-8b14-f528257f2aac admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:36.775754 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1223/2491] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:06:36 2022] PUT /identity/v3/projects/f9a357fbd6914a31bd04ace122205a14/users/3e631109ac174cee8602043370dc5484/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:36.785926 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b76c97-3062-4cc1-be06-a1f7c732f7c7 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:36.786316 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b76c97-3062-4cc1-be06-a1f7c732f7c7 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:36.786668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b76c97-3062-4cc1-be06-a1f7c732f7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:36.813258 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-e4b76c97-3062-4cc1-be06-a1f7c732f7c7 None None] MFA Rules not processed for user `3e631109ac174cee8602043370dc5484`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:36.814540 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e4b76c97-3062-4cc1-be06-a1f7c732f7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:36.878418 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1269/2492] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:36.882835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861092f0-84a2-4bbf-8b14-f528257f2aac admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:36.949966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861092f0-84a2-4bbf-8b14-f528257f2aac admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:36.957125 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d06890-c22a-466c-afac-08af9b136f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:36.958356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d06890-c22a-466c-afac-08af9b136f8b admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:36.958356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d06890-c22a-466c-afac-08af9b136f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:36.958356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d06890-c22a-466c-afac-08af9b136f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:36.959021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d06890-c22a-466c-afac-08af9b136f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:36.961020 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d06890-c22a-466c-afac-08af9b136f8b admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:36.987983 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1224/2493] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:06:36 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:06:36.991995 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b76c97-3062-4cc1-be06-a1f7c732f7c7 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:37.004011 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b76c97-3062-4cc1-be06-a1f7c732f7c7 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:37.095249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe443a-dc42-418f-a785-6402dbb8c7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:37.102285 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe443a-dc42-418f-a785-6402dbb8c7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:37.102568 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe443a-dc42-418f-a785-6402dbb8c7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:37.102840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe443a-dc42-418f-a785-6402dbb8c7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:37.103580 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe443a-dc42-418f-a785-6402dbb8c7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:37.105585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe443a-dc42-418f-a785-6402dbb8c7a8 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:37.133741 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1270/2494] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:06:36 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:06:37.137413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d06890-c22a-466c-afac-08af9b136f8b admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:37.148539 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d06890-c22a-466c-afac-08af9b136f8b admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:37.153760 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d2c31-a334-44e3-b824-d9b981440db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:37.154423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d2c31-a334-44e3-b824-d9b981440db7 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:37.154704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d2c31-a334-44e3-b824-d9b981440db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:37.154976 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d2c31-a334-44e3-b824-d9b981440db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:37.155693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d2c31-a334-44e3-b824-d9b981440db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:37.157380 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d2c31-a334-44e3-b824-d9b981440db7 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:37.168710 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1225/2495] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:06:37.174480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe443a-dc42-418f-a785-6402dbb8c7a8 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:37.186343 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe443a-dc42-418f-a785-6402dbb8c7a8 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:37.208448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe09d63-d1e1-4947-9d63-8c9d2599bbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:37.209370 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe09d63-d1e1-4947-9d63-8c9d2599bbfe admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:37.209650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe09d63-d1e1-4947-9d63-8c9d2599bbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:37.209923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe09d63-d1e1-4947-9d63-8c9d2599bbfe admin admin] PATH_INFO: `/v3/projects/38cd954098d846f2850f182426937846/users/4d1cc97191df402aa555aab660e1841a/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:37.229420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe09d63-d1e1-4947-9d63-8c9d2599bbfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=38cd954098d846f2850f182426937846, user_id=4d1cc97191df402aa555aab660e1841a, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:37.232452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe09d63-d1e1-4947-9d63-8c9d2599bbfe admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:37.265174 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1271/2496] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:06:37 2022] PUT /identity/v3/projects/38cd954098d846f2850f182426937846/users/4d1cc97191df402aa555aab660e1841a/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:37.265730 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d2c31-a334-44e3-b824-d9b981440db7 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:37.281356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d2c31-a334-44e3-b824-d9b981440db7 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:37.369486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072aa10-5eb1-4f89-9ade-69138f5167d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:37.370299 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072aa10-5eb1-4f89-9ade-69138f5167d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:37.370692 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072aa10-5eb1-4f89-9ade-69138f5167d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:37.371096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072aa10-5eb1-4f89-9ade-69138f5167d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:37.371948 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072aa10-5eb1-4f89-9ade-69138f5167d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:37.384295 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072aa10-5eb1-4f89-9ade-69138f5167d6 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:37.401893 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1226/2497] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:06:37.405569 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe09d63-d1e1-4947-9d63-8c9d2599bbfe admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:37.425535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe09d63-d1e1-4947-9d63-8c9d2599bbfe admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:37.430837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690781be-7932-4bbf-9b73-9df343630b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:37.431751 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690781be-7932-4bbf-9b73-9df343630b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:37.432272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690781be-7932-4bbf-9b73-9df343630b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:37.432615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690781be-7932-4bbf-9b73-9df343630b31 admin admin] PATH_INFO: `/v3/projects/38cd954098d846f2850f182426937846/users/4d1cc97191df402aa555aab660e1841a/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:37.434739 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690781be-7932-4bbf-9b73-9df343630b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38cd954098d846f2850f182426937846, user_id=4d1cc97191df402aa555aab660e1841a, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:37.437968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690781be-7932-4bbf-9b73-9df343630b31 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:37.453948 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1272/2498] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:06:37 2022] PUT /identity/v3/projects/38cd954098d846f2850f182426937846/users/4d1cc97191df402aa555aab660e1841a/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:06:37.465486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d544e-c60e-4ef3-9352-1577f41468c7 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:37.465486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d544e-c60e-4ef3-9352-1577f41468c7 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:37.466530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d544e-c60e-4ef3-9352-1577f41468c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:37.524922 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-561d544e-c60e-4ef3-9352-1577f41468c7 None None] MFA Rules not processed for user `4d1cc97191df402aa555aab660e1841a`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:37.526641 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-561d544e-c60e-4ef3-9352-1577f41468c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:37.605490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1227/2499] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:37.616911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690781be-7932-4bbf-9b73-9df343630b31 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:37.618690 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-690781be-7932-4bbf-9b73-9df343630b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:37.675903 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d544e-c60e-4ef3-9352-1577f41468c7 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:37.677448 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-561d544e-c60e-4ef3-9352-1577f41468c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:37.693069 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690781be-7932-4bbf-9b73-9df343630b31 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:37.697725 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cd6c5-7dbe-4953-93f3-ba60e966529f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:37.698388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cd6c5-7dbe-4953-93f3-ba60e966529f service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:37.698670 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cd6c5-7dbe-4953-93f3-ba60e966529f service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:37.698946 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cd6c5-7dbe-4953-93f3-ba60e966529f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:37.709552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cd6c5-7dbe-4953-93f3-ba60e966529f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:37.711142 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cd6c5-7dbe-4953-93f3-ba60e966529f service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:37.722350 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1273/2500] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:06:37.748494 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d544e-c60e-4ef3-9352-1577f41468c7 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:37.754845 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e12c3-9491-4595-8e08-b20ff682d2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:37.755755 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e12c3-9491-4595-8e08-b20ff682d2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:37.756032 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e12c3-9491-4595-8e08-b20ff682d2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:37.756411 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e12c3-9491-4595-8e08-b20ff682d2b2 admin admin] PATH_INFO: `/v3/users/8c563c6a229b4e619992ccfb0da1a748` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:37.757584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e12c3-9491-4595-8e08-b20ff682d2b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c563c6a229b4e619992ccfb0da1a748)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:37.759557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e12c3-9491-4595-8e08-b20ff682d2b2 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:37.809736 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cf5e12c3-9491-4595-8e08-b20ff682d2b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c563c6a229b4e619992ccfb0da1a748'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:37.810384 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cf5e12c3-9491-4595-8e08-b20ff682d2b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c563c6a229b4e619992ccfb0da1a748'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:37.823220 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cf5e12c3-9491-4595-8e08-b20ff682d2b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c563c6a229b4e619992ccfb0da1a748'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:37.831454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cf5e12c3-9491-4595-8e08-b20ff682d2b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c563c6a229b4e619992ccfb0da1a748'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:37.832395 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cf5e12c3-9491-4595-8e08-b20ff682d2b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c563c6a229b4e619992ccfb0da1a748'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:37.845657 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1228/2501] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:06:37 2022] DELETE /identity/v3/users/8c563c6a229b4e619992ccfb0da1a748 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:06:38.053379 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cd6c5-7dbe-4953-93f3-ba60e966529f service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:38.066560 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cd6c5-7dbe-4953-93f3-ba60e966529f service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:38.126306 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d0182-6abe-473c-b4a9-c6372659157e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:38.127329 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d0182-6abe-473c-b4a9-c6372659157e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:38.127673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d0182-6abe-473c-b4a9-c6372659157e admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:38.128035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d0182-6abe-473c-b4a9-c6372659157e admin admin] PATH_INFO: `/v3/projects/e296ee60cdee4a6b9ca754c83b8c9ffd` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:38.129306 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d0182-6abe-473c-b4a9-c6372659157e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e296ee60cdee4a6b9ca754c83b8c9ffd)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:38.131299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d0182-6abe-473c-b4a9-c6372659157e admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:38.180737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-097d0182-6abe-473c-b4a9-c6372659157e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'request_id': 'req-097d0182-6abe-473c-b4a9-c6372659157e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:38.189439 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-097d0182-6abe-473c-b4a9-c6372659157e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'request_id': 'req-097d0182-6abe-473c-b4a9-c6372659157e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:38.195210 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-097d0182-6abe-473c-b4a9-c6372659157e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e296ee60cdee4a6b9ca754c83b8c9ffd', 'request_id': 'req-097d0182-6abe-473c-b4a9-c6372659157e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:38.207092 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-097d0182-6abe-473c-b4a9-c6372659157e admin admin] The token cache is being invalidate because project e296ee60cdee4a6b9ca754c83b8c9ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:06:38.207376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-097d0182-6abe-473c-b4a9-c6372659157e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:38.208018 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-097d0182-6abe-473c-b4a9-c6372659157e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:38.210750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1274/2502] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:06:38 2022] DELETE /identity/v3/projects/e296ee60cdee4a6b9ca754c83b8c9ffd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:38.215757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cd5ae-3c44-4232-b27d-12841870ff04 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:38.216302 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cd5ae-3c44-4232-b27d-12841870ff04 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:38.216411 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cd5ae-3c44-4232-b27d-12841870ff04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:38.235807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-d09cd5ae-3c44-4232-b27d-12841870ff04 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:38.237036 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d09cd5ae-3c44-4232-b27d-12841870ff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:38.293512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d0182-6abe-473c-b4a9-c6372659157e admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:38.294872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-097d0182-6abe-473c-b4a9-c6372659157e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:38.302815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1229/2503] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:38.310250 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cb6c3-e2ef-4c76-b2cf-5229b49fbd42 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:38.310545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cb6c3-e2ef-4c76-b2cf-5229b49fbd42 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:38.310826 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cb6c3-e2ef-4c76-b2cf-5229b49fbd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:38.330612 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-923cb6c3-e2ef-4c76-b2cf-5229b49fbd42 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:38.332264 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-923cb6c3-e2ef-4c76-b2cf-5229b49fbd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:38.346926 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1230/2504] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:06:38.351758 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cb6c3-e2ef-4c76-b2cf-5229b49fbd42 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:38.354666 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d0182-6abe-473c-b4a9-c6372659157e admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:38.358987 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf98f74-fce0-429a-bdd6-82445ad580fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:38.359868 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf98f74-fce0-429a-bdd6-82445ad580fe service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:38.360144 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf98f74-fce0-429a-bdd6-82445ad580fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:38.360467 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf98f74-fce0-429a-bdd6-82445ad580fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:38.362531 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-4bf98f74-fce0-429a-bdd6-82445ad580fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:38.362761 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cb6c3-e2ef-4c76-b2cf-5229b49fbd42 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:38.367874 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad1f7a-aa82-43fa-a9e8-b9b92bbdf68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:38.368585 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad1f7a-aa82-43fa-a9e8-b9b92bbdf68f admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:38.368890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad1f7a-aa82-43fa-a9e8-b9b92bbdf68f admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:38.369167 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad1f7a-aa82-43fa-a9e8-b9b92bbdf68f admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:38.369896 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad1f7a-aa82-43fa-a9e8-b9b92bbdf68f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:06:38.370213 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad1f7a-aa82-43fa-a9e8-b9b92bbdf68f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:38.371809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad1f7a-aa82-43fa-a9e8-b9b92bbdf68f admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:38.386880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1231/2505] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:06:38.394027 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad1f7a-aa82-43fa-a9e8-b9b92bbdf68f admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:38.407089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad1f7a-aa82-43fa-a9e8-b9b92bbdf68f admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:38.413056 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40834a-d751-4964-a3ce-c4a3e2de0ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:38.413834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40834a-d751-4964-a3ce-c4a3e2de0ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:38.414219 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40834a-d751-4964-a3ce-c4a3e2de0ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:38.414903 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40834a-d751-4964-a3ce-c4a3e2de0ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:38.415351 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40834a-d751-4964-a3ce-c4a3e2de0ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:38.417331 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40834a-d751-4964-a3ce-c4a3e2de0ea3 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:38.435995 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf98f74-fce0-429a-bdd6-82445ad580fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:38.438343 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf98f74-fce0-429a-bdd6-82445ad580fe service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:38.448119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1275/2506] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:06:38.449837 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1232/2507] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:06:38 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:06:38.454201 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf98f74-fce0-429a-bdd6-82445ad580fe service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:38.466784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf98f74-fce0-429a-bdd6-82445ad580fe service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:38.532239 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5689d-73c0-4244-be2c-0d4ec0644342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:38.532919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5689d-73c0-4244-be2c-0d4ec0644342 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:38.533200 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5689d-73c0-4244-be2c-0d4ec0644342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:38.534346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5689d-73c0-4244-be2c-0d4ec0644342 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:38.535527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5689d-73c0-4244-be2c-0d4ec0644342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:38.537791 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5689d-73c0-4244-be2c-0d4ec0644342 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:38.565137 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1276/2508] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:06:38 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:06:38.569811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40834a-d751-4964-a3ce-c4a3e2de0ea3 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:38.582531 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40834a-d751-4964-a3ce-c4a3e2de0ea3 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:38.587929 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182e59f-5d12-429a-b987-a2ba3d5032c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:38.588656 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182e59f-5d12-429a-b987-a2ba3d5032c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:38.588934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182e59f-5d12-429a-b987-a2ba3d5032c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:38.589203 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182e59f-5d12-429a-b987-a2ba3d5032c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:38.589997 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182e59f-5d12-429a-b987-a2ba3d5032c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:38.592268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182e59f-5d12-429a-b987-a2ba3d5032c6 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:38.604639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1233/2509] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:06:38.608495 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5689d-73c0-4244-be2c-0d4ec0644342 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:38.619621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5689d-73c0-4244-be2c-0d4ec0644342 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:38.624323 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08334977-bd1c-46b0-be08-3dacad3dea8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:38.624971 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08334977-bd1c-46b0-be08-3dacad3dea8a admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:38.625874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08334977-bd1c-46b0-be08-3dacad3dea8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:38.626146 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08334977-bd1c-46b0-be08-3dacad3dea8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:38.626855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08334977-bd1c-46b0-be08-3dacad3dea8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:38.628553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08334977-bd1c-46b0-be08-3dacad3dea8a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:38.640205 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1277/2510] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:06:38.643050 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182e59f-5d12-429a-b987-a2ba3d5032c6 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:38.661009 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182e59f-5d12-429a-b987-a2ba3d5032c6 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:38.666151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76aaee4-13ed-45b6-a20f-d62dee422f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:38.667143 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76aaee4-13ed-45b6-a20f-d62dee422f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:38.667423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76aaee4-13ed-45b6-a20f-d62dee422f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:38.667693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76aaee4-13ed-45b6-a20f-d62dee422f30 admin admin] PATH_INFO: `/v3/projects/1d109b97714b4d8faba191eae7f2c68c/users/0679bb29f1624fc69dbbbcffdd846a6e/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:38.698174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76aaee4-13ed-45b6-a20f-d62dee422f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d109b97714b4d8faba191eae7f2c68c, user_id=0679bb29f1624fc69dbbbcffdd846a6e, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:38.701555 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76aaee4-13ed-45b6-a20f-d62dee422f30 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:38.716816 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1234/2511] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:06:38 2022] PUT /identity/v3/projects/1d109b97714b4d8faba191eae7f2c68c/users/0679bb29f1624fc69dbbbcffdd846a6e/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:38.727130 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605afde5-ff8d-454a-83ab-dcbd42d48d9e None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:38.727473 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605afde5-ff8d-454a-83ab-dcbd42d48d9e None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:38.727782 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605afde5-ff8d-454a-83ab-dcbd42d48d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:38.757899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-605afde5-ff8d-454a-83ab-dcbd42d48d9e None None] MFA Rules not processed for user `0679bb29f1624fc69dbbbcffdd846a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:38.759131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-605afde5-ff8d-454a-83ab-dcbd42d48d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:38.823786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1278/2512] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:38.834707 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76aaee4-13ed-45b6-a20f-d62dee422f30 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:38.836422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d76aaee4-13ed-45b6-a20f-d62dee422f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:38.907370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76aaee4-13ed-45b6-a20f-d62dee422f30 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:38.912877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2b9c1-1095-4f09-a499-6a1649a7efb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:38.913505 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2b9c1-1095-4f09-a499-6a1649a7efb3 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:38.913782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2b9c1-1095-4f09-a499-6a1649a7efb3 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:38.914053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2b9c1-1095-4f09-a499-6a1649a7efb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:38.921524 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2b9c1-1095-4f09-a499-6a1649a7efb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:38.923630 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2b9c1-1095-4f09-a499-6a1649a7efb3 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:38.932163 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1235/2513] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:06:44.520442 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605afde5-ff8d-454a-83ab-dcbd42d48d9e None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:44.521969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-605afde5-ff8d-454a-83ab-dcbd42d48d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:44.579570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605afde5-ff8d-454a-83ab-dcbd42d48d9e None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:44.583625 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945df58-6cc3-4ffc-974a-20c4573ea868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:44.584287 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945df58-6cc3-4ffc-974a-20c4573ea868 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:44.584563 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945df58-6cc3-4ffc-974a-20c4573ea868 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:44.584830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945df58-6cc3-4ffc-974a-20c4573ea868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:44.586580 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b945df58-6cc3-4ffc-974a-20c4573ea868 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:44.646103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945df58-6cc3-4ffc-974a-20c4573ea868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:44.647533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945df58-6cc3-4ffc-974a-20c4573ea868 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:44.656438 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1279/2514] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:06:48.668552 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607c070-a38e-4be4-9e01-3c42148478df None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:48.669028 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607c070-a38e-4be4-9e01-3c42148478df None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:48.669251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607c070-a38e-4be4-9e01-3c42148478df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:48.686301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-8607c070-a38e-4be4-9e01-3c42148478df None None] MFA Rules not processed for user `df5dcdfb4eda417ebc0af2432497617d`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:48.687500 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8607c070-a38e-4be4-9e01-3c42148478df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:48.742661 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1236/2515] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 14:06:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:06:48.755236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945df58-6cc3-4ffc-974a-20c4573ea868 service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:48.756719 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b945df58-6cc3-4ffc-974a-20c4573ea868 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:48.791561 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607c070-a38e-4be4-9e01-3c42148478df None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:48.792982 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8607c070-a38e-4be4-9e01-3c42148478df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:48.827376 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945df58-6cc3-4ffc-974a-20c4573ea868 service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:48.833164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55731f3-9db2-49ae-acfc-ff2818e3307f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd102155cd1bd4368ad272668da1651f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:48.833855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55731f3-9db2-49ae-acfc-ff2818e3307f service swift] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:48.834103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55731f3-9db2-49ae-acfc-ff2818e3307f service swift] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:48.834434 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55731f3-9db2-49ae-acfc-ff2818e3307f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:48.842745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55731f3-9db2-49ae-acfc-ff2818e3307f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:48.844346 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55731f3-9db2-49ae-acfc-ff2818e3307f service swift] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:48.852869 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1280/2516] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 14:06:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:06:48.863714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607c070-a38e-4be4-9e01-3c42148478df None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:48.869292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1c80b-fb52-401a-85d1-6222f75b4ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:48.870376 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1c80b-fb52-401a-85d1-6222f75b4ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:48.870658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1c80b-fb52-401a-85d1-6222f75b4ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:48.870931 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1c80b-fb52-401a-85d1-6222f75b4ad3 admin admin] PATH_INFO: `/v3/users/42f15130196546b6b6e092573a7953dd` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:48.872146 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1c80b-fb52-401a-85d1-6222f75b4ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f15130196546b6b6e092573a7953dd)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:48.874093 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1c80b-fb52-401a-85d1-6222f75b4ad3 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:48.943914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-1cf1c80b-fb52-401a-85d1-6222f75b4ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f15130196546b6b6e092573a7953dd'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:48.944674 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-1cf1c80b-fb52-401a-85d1-6222f75b4ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f15130196546b6b6e092573a7953dd'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:48.958210 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-1cf1c80b-fb52-401a-85d1-6222f75b4ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f15130196546b6b6e092573a7953dd'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:48.967116 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-1cf1c80b-fb52-401a-85d1-6222f75b4ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f15130196546b6b6e092573a7953dd'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:48.967607 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-1cf1c80b-fb52-401a-85d1-6222f75b4ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f15130196546b6b6e092573a7953dd'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:48.981408 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1237/2517] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:06:48 2022] DELETE /identity/v3/users/42f15130196546b6b6e092573a7953dd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:06:48.986133 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3704473-490c-48b0-88b3-a253ca3a1770 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:48.986595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3704473-490c-48b0-88b3-a253ca3a1770 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:48.986959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3704473-490c-48b0-88b3-a253ca3a1770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:49.007380 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f3704473-490c-48b0-88b3-a253ca3a1770 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:49.008985 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f3704473-490c-48b0-88b3-a253ca3a1770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:49.080214 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1281/2518] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:49.090940 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1c80b-fb52-401a-85d1-6222f75b4ad3 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:49.092509 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-1cf1c80b-fb52-401a-85d1-6222f75b4ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:49.158835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1c80b-fb52-401a-85d1-6222f75b4ad3 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:49.162810 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856823a0-5697-4544-b7bd-1240c13deab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:49.163447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856823a0-5697-4544-b7bd-1240c13deab0 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:49.163768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856823a0-5697-4544-b7bd-1240c13deab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:49.163988 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856823a0-5697-4544-b7bd-1240c13deab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:49.174741 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856823a0-5697-4544-b7bd-1240c13deab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:49.176427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856823a0-5697-4544-b7bd-1240c13deab0 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:49.186942 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1238/2519] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:06:49.421402 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3704473-490c-48b0-88b3-a253ca3a1770 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:49.422835 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f3704473-490c-48b0-88b3-a253ca3a1770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:49.437259 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3704473-490c-48b0-88b3-a253ca3a1770 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:49.447388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2a4be-77e0-4ad3-9cc4-ada3432dab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:49.448767 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2a4be-77e0-4ad3-9cc4-ada3432dab93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:49.449196 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2a4be-77e0-4ad3-9cc4-ada3432dab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:49.449873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2a4be-77e0-4ad3-9cc4-ada3432dab93 admin admin] PATH_INFO: `/v3/users/0679bb29f1624fc69dbbbcffdd846a6e` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:49.451738 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2a4be-77e0-4ad3-9cc4-ada3432dab93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0679bb29f1624fc69dbbbcffdd846a6e)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:49.454569 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2a4be-77e0-4ad3-9cc4-ada3432dab93 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:49.537178 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-7cd2a4be-77e0-4ad3-9cc4-ada3432dab93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0679bb29f1624fc69dbbbcffdd846a6e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:49.564100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-7cd2a4be-77e0-4ad3-9cc4-ada3432dab93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0679bb29f1624fc69dbbbcffdd846a6e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:49.578200 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856823a0-5697-4544-b7bd-1240c13deab0 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:49.580971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-856823a0-5697-4544-b7bd-1240c13deab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:49.585089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-7cd2a4be-77e0-4ad3-9cc4-ada3432dab93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0679bb29f1624fc69dbbbcffdd846a6e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:49.586341 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-7cd2a4be-77e0-4ad3-9cc4-ada3432dab93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0679bb29f1624fc69dbbbcffdd846a6e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:49.595723 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856823a0-5697-4544-b7bd-1240c13deab0 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:49.602458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100d5e7-03aa-4130-9bf0-591a5b77d33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:49.603515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100d5e7-03aa-4130-9bf0-591a5b77d33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:49.604013 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100d5e7-03aa-4130-9bf0-591a5b77d33f admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:49.604378 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100d5e7-03aa-4130-9bf0-591a5b77d33f admin admin] PATH_INFO: `/v3/projects/cfd4337045164a92a74bf4964581fc97` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:49.605769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100d5e7-03aa-4130-9bf0-591a5b77d33f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfd4337045164a92a74bf4964581fc97)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:49.606063 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-7cd2a4be-77e0-4ad3-9cc4-ada3432dab93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0679bb29f1624fc69dbbbcffdd846a6e'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:49.608160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100d5e7-03aa-4130-9bf0-591a5b77d33f admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:49.622942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1282/2520] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:06:49 2022] DELETE /identity/v3/users/0679bb29f1624fc69dbbbcffdd846a6e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:49.628549 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9a06-7b76-44bd-9ce7-cd2626f77d98 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:49.628830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9a06-7b76-44bd-9ce7-cd2626f77d98 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:49.629181 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9a06-7b76-44bd-9ce7-cd2626f77d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:49.649922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-791d9a06-7b76-44bd-9ce7-cd2626f77d98 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:49.651221 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-791d9a06-7b76-44bd-9ce7-cd2626f77d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:49.676834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d100d5e7-03aa-4130-9bf0-591a5b77d33f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd4337045164a92a74bf4964581fc97', 'request_id': 'req-d100d5e7-03aa-4130-9bf0-591a5b77d33f'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:49.689287 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d100d5e7-03aa-4130-9bf0-591a5b77d33f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd4337045164a92a74bf4964581fc97', 'request_id': 'req-d100d5e7-03aa-4130-9bf0-591a5b77d33f'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:49.698496 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d100d5e7-03aa-4130-9bf0-591a5b77d33f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd4337045164a92a74bf4964581fc97', 'request_id': 'req-d100d5e7-03aa-4130-9bf0-591a5b77d33f'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:49.717529 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d100d5e7-03aa-4130-9bf0-591a5b77d33f admin admin] The token cache is being invalidate because project cfd4337045164a92a74bf4964581fc97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:06:49.718079 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d100d5e7-03aa-4130-9bf0-591a5b77d33f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:49.719023 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d100d5e7-03aa-4130-9bf0-591a5b77d33f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:49.721381 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1239/2521] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:06:49 2022] DELETE /identity/v3/projects/cfd4337045164a92a74bf4964581fc97 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:49.725475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100d5e7-03aa-4130-9bf0-591a5b77d33f admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:49.726994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d100d5e7-03aa-4130-9bf0-591a5b77d33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:49.730106 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1283/2522] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:49.741124 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d9a06-7b76-44bd-9ce7-cd2626f77d98 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:49.741996 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-791d9a06-7b76-44bd-9ce7-cd2626f77d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:49.804680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d9a06-7b76-44bd-9ce7-cd2626f77d98 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:49.810031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100d5e7-03aa-4130-9bf0-591a5b77d33f admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:49.816765 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72823529-f34d-431f-8fda-7b182ff08978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:49.818017 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72823529-f34d-431f-8fda-7b182ff08978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:49.818309 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72823529-f34d-431f-8fda-7b182ff08978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:49.818765 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72823529-f34d-431f-8fda-7b182ff08978 admin admin] PATH_INFO: `/v3/users/3e631109ac174cee8602043370dc5484` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:49.820629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72823529-f34d-431f-8fda-7b182ff08978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e631109ac174cee8602043370dc5484)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:49.822558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72823529-f34d-431f-8fda-7b182ff08978 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:49.861398 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c64e1-baf3-4506-92c7-93fa49fc59a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:49.862094 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c64e1-baf3-4506-92c7-93fa49fc59a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:49.862407 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c64e1-baf3-4506-92c7-93fa49fc59a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:49.862636 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c64e1-baf3-4506-92c7-93fa49fc59a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:49.874020 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c64e1-baf3-4506-92c7-93fa49fc59a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:49.875660 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c64e1-baf3-4506-92c7-93fa49fc59a7 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:49.889255 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-72823529-f34d-431f-8fda-7b182ff08978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e631109ac174cee8602043370dc5484'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:49.890323 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-72823529-f34d-431f-8fda-7b182ff08978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e631109ac174cee8602043370dc5484'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:49.901967 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1284/2523] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:06:49.904847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-72823529-f34d-431f-8fda-7b182ff08978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e631109ac174cee8602043370dc5484'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:49.913294 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-72823529-f34d-431f-8fda-7b182ff08978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e631109ac174cee8602043370dc5484'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:49.913979 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-72823529-f34d-431f-8fda-7b182ff08978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e631109ac174cee8602043370dc5484'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:49.943030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1240/2524] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:06:49 2022] DELETE /identity/v3/users/3e631109ac174cee8602043370dc5484 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:50.365539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c64e1-baf3-4506-92c7-93fa49fc59a7 service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:50.367364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-865c64e1-baf3-4506-92c7-93fa49fc59a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:50.398854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c64e1-baf3-4506-92c7-93fa49fc59a7 service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:50.466888 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72823529-f34d-431f-8fda-7b182ff08978 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:50.468381 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-72823529-f34d-431f-8fda-7b182ff08978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:50.504203 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab04cc-d036-4f1c-9bbe-b9deb801deff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:50.505200 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab04cc-d036-4f1c-9bbe-b9deb801deff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:50.505544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab04cc-d036-4f1c-9bbe-b9deb801deff admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:50.505889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab04cc-d036-4f1c-9bbe-b9deb801deff admin admin] PATH_INFO: `/v3/projects/1d109b97714b4d8faba191eae7f2c68c` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:50.507175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab04cc-d036-4f1c-9bbe-b9deb801deff admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d109b97714b4d8faba191eae7f2c68c)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:50.509231 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab04cc-d036-4f1c-9bbe-b9deb801deff admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:50.565241 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72823529-f34d-431f-8fda-7b182ff08978 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:50.572335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-51ab04cc-d036-4f1c-9bbe-b9deb801deff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d109b97714b4d8faba191eae7f2c68c', 'request_id': 'req-51ab04cc-d036-4f1c-9bbe-b9deb801deff'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:50.586712 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-51ab04cc-d036-4f1c-9bbe-b9deb801deff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d109b97714b4d8faba191eae7f2c68c', 'request_id': 'req-51ab04cc-d036-4f1c-9bbe-b9deb801deff'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:50.595116 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-51ab04cc-d036-4f1c-9bbe-b9deb801deff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d109b97714b4d8faba191eae7f2c68c', 'request_id': 'req-51ab04cc-d036-4f1c-9bbe-b9deb801deff'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:50.620640 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-51ab04cc-d036-4f1c-9bbe-b9deb801deff admin admin] The token cache is being invalidate because project 1d109b97714b4d8faba191eae7f2c68c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:06:50.621819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-51ab04cc-d036-4f1c-9bbe-b9deb801deff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:50.623129 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-51ab04cc-d036-4f1c-9bbe-b9deb801deff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:50.625531 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1285/2525] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:06:50 2022] DELETE /identity/v3/projects/1d109b97714b4d8faba191eae7f2c68c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:50.631678 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d2fbf-075a-4de3-886f-c4c8557c25f7 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:50.632049 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d2fbf-075a-4de3-886f-c4c8557c25f7 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:50.632503 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d2fbf-075a-4de3-886f-c4c8557c25f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:50.637547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b724c6-d181-4541-aab2-8863bdca0237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:50.638703 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b724c6-d181-4541-aab2-8863bdca0237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:50.639215 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b724c6-d181-4541-aab2-8863bdca0237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:50.639501 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b724c6-d181-4541-aab2-8863bdca0237 admin admin] PATH_INFO: `/v3/projects/f9a357fbd6914a31bd04ace122205a14` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:50.641502 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b724c6-d181-4541-aab2-8863bdca0237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a357fbd6914a31bd04ace122205a14)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:50.643882 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b724c6-d181-4541-aab2-8863bdca0237 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:50.665967 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-824d2fbf-075a-4de3-886f-c4c8557c25f7 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:50.667652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-824d2fbf-075a-4de3-886f-c4c8557c25f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:50.688499 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1286/2526] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:50.692342 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac16241-8700-412c-b78a-5b4b923585be None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:50.692637 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac16241-8700-412c-b78a-5b4b923585be None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:50.692964 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac16241-8700-412c-b78a-5b4b923585be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:50.700227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-48b724c6-d181-4541-aab2-8863bdca0237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a357fbd6914a31bd04ace122205a14', 'request_id': 'req-48b724c6-d181-4541-aab2-8863bdca0237'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:50.709951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-48b724c6-d181-4541-aab2-8863bdca0237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a357fbd6914a31bd04ace122205a14', 'request_id': 'req-48b724c6-d181-4541-aab2-8863bdca0237'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:50.716475 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-4ac16241-8700-412c-b78a-5b4b923585be None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:50.717535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-48b724c6-d181-4541-aab2-8863bdca0237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a357fbd6914a31bd04ace122205a14', 'request_id': 'req-48b724c6-d181-4541-aab2-8863bdca0237'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:50.717880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-4ac16241-8700-412c-b78a-5b4b923585be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:50.732751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-48b724c6-d181-4541-aab2-8863bdca0237 admin admin] The token cache is being invalidate because project f9a357fbd6914a31bd04ace122205a14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:06:50.733324 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-48b724c6-d181-4541-aab2-8863bdca0237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:50.734041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-48b724c6-d181-4541-aab2-8863bdca0237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:50.737916 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1241/2527] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:06:50 2022] DELETE /identity/v3/projects/f9a357fbd6914a31bd04ace122205a14 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:50.743283 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b724c6-d181-4541-aab2-8863bdca0237 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:50.745262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-48b724c6-d181-4541-aab2-8863bdca0237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:50.787293 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1287/2528] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:50.791645 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac16241-8700-412c-b78a-5b4b923585be None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:50.801744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac16241-8700-412c-b78a-5b4b923585be None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:50.809369 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392f8c2-a145-44c1-88f8-dd21e0576638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:50.811698 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392f8c2-a145-44c1-88f8-dd21e0576638 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:50.811982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392f8c2-a145-44c1-88f8-dd21e0576638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:50.812644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392f8c2-a145-44c1-88f8-dd21e0576638 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:50.813374 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392f8c2-a145-44c1-88f8-dd21e0576638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:06:50.813710 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392f8c2-a145-44c1-88f8-dd21e0576638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:50.815848 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392f8c2-a145-44c1-88f8-dd21e0576638 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:50.835561 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1288/2529] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:06:50.836525 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392f8c2-a145-44c1-88f8-dd21e0576638 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:50.847008 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392f8c2-a145-44c1-88f8-dd21e0576638 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:50.847801 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b724c6-d181-4541-aab2-8863bdca0237 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:50.852320 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216710a-16d5-48ca-93a7-0ce3981aadf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:50.853308 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216710a-16d5-48ca-93a7-0ce3981aadf9 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:50.853590 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216710a-16d5-48ca-93a7-0ce3981aadf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:50.854120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216710a-16d5-48ca-93a7-0ce3981aadf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:50.854576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cae25-2abf-41f3-a210-25736ee4912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:50.854865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216710a-16d5-48ca-93a7-0ce3981aadf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:50.856101 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cae25-2abf-41f3-a210-25736ee4912e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:50.856480 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cae25-2abf-41f3-a210-25736ee4912e admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:50.856874 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216710a-16d5-48ca-93a7-0ce3981aadf9 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:50.857111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cae25-2abf-41f3-a210-25736ee4912e admin admin] PATH_INFO: `/v3/users/4d1cc97191df402aa555aab660e1841a` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:50.859804 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8cae25-2abf-41f3-a210-25736ee4912e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d1cc97191df402aa555aab660e1841a)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:50.863165 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8cae25-2abf-41f3-a210-25736ee4912e admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:50.896222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1289/2530] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:06:50 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:06:50.899601 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216710a-16d5-48ca-93a7-0ce3981aadf9 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:50.935868 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-aa8cae25-2abf-41f3-a210-25736ee4912e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1cc97191df402aa555aab660e1841a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:50.937115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-aa8cae25-2abf-41f3-a210-25736ee4912e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1cc97191df402aa555aab660e1841a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:50.957245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-aa8cae25-2abf-41f3-a210-25736ee4912e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1cc97191df402aa555aab660e1841a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:50.968055 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-aa8cae25-2abf-41f3-a210-25736ee4912e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1cc97191df402aa555aab660e1841a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:50.968689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-aa8cae25-2abf-41f3-a210-25736ee4912e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1cc97191df402aa555aab660e1841a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:50.987587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1242/2531] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:06:50 2022] DELETE /identity/v3/users/4d1cc97191df402aa555aab660e1841a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:50.995712 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216710a-16d5-48ca-93a7-0ce3981aadf9 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:51.066859 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c3f95-a6df-483d-90a4-f0cecafc045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:51.067186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c3f95-a6df-483d-90a4-f0cecafc045a admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:51.067910 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c3f95-a6df-483d-90a4-f0cecafc045a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:51.067910 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c3f95-a6df-483d-90a4-f0cecafc045a admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:51.068691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c3f95-a6df-483d-90a4-f0cecafc045a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:51.070667 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c3f95-a6df-483d-90a4-f0cecafc045a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:51.099012 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1290/2532] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:06:50 2022] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:06:51.100400 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cae25-2abf-41f3-a210-25736ee4912e admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:51.102193 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-aa8cae25-2abf-41f3-a210-25736ee4912e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:51.121787 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cae25-2abf-41f3-a210-25736ee4912e admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:51.135638 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e95ff2-0cb9-4d4e-a907-af9fb1630458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:51.136651 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e95ff2-0cb9-4d4e-a907-af9fb1630458 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:51.137910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e95ff2-0cb9-4d4e-a907-af9fb1630458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:51.139995 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e95ff2-0cb9-4d4e-a907-af9fb1630458 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:51.141247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e95ff2-0cb9-4d4e-a907-af9fb1630458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:51.143887 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e95ff2-0cb9-4d4e-a907-af9fb1630458 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:51.155487 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1243/2533] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:06:51.161964 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c3f95-a6df-483d-90a4-f0cecafc045a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:51.176281 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c3f95-a6df-483d-90a4-f0cecafc045a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:51.182058 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f3715-52e1-49c1-a17e-0f1855f75cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:51.182755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f3715-52e1-49c1-a17e-0f1855f75cdc admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:51.183030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f3715-52e1-49c1-a17e-0f1855f75cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:51.183456 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f3715-52e1-49c1-a17e-0f1855f75cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:51.184214 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f3715-52e1-49c1-a17e-0f1855f75cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:51.185963 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f3715-52e1-49c1-a17e-0f1855f75cdc admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:51.201612 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1291/2534] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:06:51.202313 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e95ff2-0cb9-4d4e-a907-af9fb1630458 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:51.216496 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e95ff2-0cb9-4d4e-a907-af9fb1630458 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:51.222260 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884801b7-8d2a-4893-9a43-6d38b71d023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:51.223161 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884801b7-8d2a-4893-9a43-6d38b71d023a admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:51.223494 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884801b7-8d2a-4893-9a43-6d38b71d023a admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:51.223776 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884801b7-8d2a-4893-9a43-6d38b71d023a admin admin] PATH_INFO: `/v3/projects/d47a2c56d6eb4fee9f90d141f4a28f78/users/325d1a72613c44f7810cf5b42fc52e62/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:51.240553 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884801b7-8d2a-4893-9a43-6d38b71d023a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47a2c56d6eb4fee9f90d141f4a28f78, user_id=325d1a72613c44f7810cf5b42fc52e62, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:51.243743 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884801b7-8d2a-4893-9a43-6d38b71d023a admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:51.261508 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1244/2535] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:06:51 2022] PUT /identity/v3/projects/d47a2c56d6eb4fee9f90d141f4a28f78/users/325d1a72613c44f7810cf5b42fc52e62/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:51.271222 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef549a7a-c07c-4f95-a57b-d78e83b9430f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:51.271513 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef549a7a-c07c-4f95-a57b-d78e83b9430f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:51.271793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef549a7a-c07c-4f95-a57b-d78e83b9430f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:51.304111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-ef549a7a-c07c-4f95-a57b-d78e83b9430f None None] MFA Rules not processed for user `325d1a72613c44f7810cf5b42fc52e62`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:51.305625 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ef549a7a-c07c-4f95-a57b-d78e83b9430f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:51.366070 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884801b7-8d2a-4893-9a43-6d38b71d023a admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:51.368857 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-884801b7-8d2a-4893-9a43-6d38b71d023a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:51.403727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1292/2536] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:51.418895 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef549a7a-c07c-4f95-a57b-d78e83b9430f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:51.420681 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ef549a7a-c07c-4f95-a57b-d78e83b9430f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:51.474326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884801b7-8d2a-4893-9a43-6d38b71d023a admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:51.483117 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa829c94-dbcc-4cfe-bbaf-b059a19c16d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:51.484290 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa829c94-dbcc-4cfe-bbaf-b059a19c16d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:51.484632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa829c94-dbcc-4cfe-bbaf-b059a19c16d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:51.485005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa829c94-dbcc-4cfe-bbaf-b059a19c16d6 admin admin] PATH_INFO: `/v3/projects/38cd954098d846f2850f182426937846` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:51.487321 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa829c94-dbcc-4cfe-bbaf-b059a19c16d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38cd954098d846f2850f182426937846)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:51.489883 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa829c94-dbcc-4cfe-bbaf-b059a19c16d6 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:51.492158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef549a7a-c07c-4f95-a57b-d78e83b9430f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:51.495996 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688237a-569e-4a22-bc53-53309041d0e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:51.496758 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688237a-569e-4a22-bc53-53309041d0e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:51.497126 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688237a-569e-4a22-bc53-53309041d0e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:51.497476 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688237a-569e-4a22-bc53-53309041d0e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:51.507072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688237a-569e-4a22-bc53-53309041d0e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:51.508668 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688237a-569e-4a22-bc53-53309041d0e5 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:51.523875 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1293/2537] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:06:51.552268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-aa829c94-dbcc-4cfe-bbaf-b059a19c16d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38cd954098d846f2850f182426937846', 'request_id': 'req-aa829c94-dbcc-4cfe-bbaf-b059a19c16d6'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:51.560412 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-aa829c94-dbcc-4cfe-bbaf-b059a19c16d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38cd954098d846f2850f182426937846', 'request_id': 'req-aa829c94-dbcc-4cfe-bbaf-b059a19c16d6'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:51.570074 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-aa829c94-dbcc-4cfe-bbaf-b059a19c16d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38cd954098d846f2850f182426937846', 'request_id': 'req-aa829c94-dbcc-4cfe-bbaf-b059a19c16d6'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:51.593253 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-aa829c94-dbcc-4cfe-bbaf-b059a19c16d6 admin admin] The token cache is being invalidate because project 38cd954098d846f2850f182426937846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:06:51.596207 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-aa829c94-dbcc-4cfe-bbaf-b059a19c16d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:51.600717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-aa829c94-dbcc-4cfe-bbaf-b059a19c16d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:51.602681 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1245/2538] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:06:51 2022] DELETE /identity/v3/projects/38cd954098d846f2850f182426937846 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:51.610147 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bab1fd-23e4-425a-b69c-fdf7068b5e96 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:51.610483 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bab1fd-23e4-425a-b69c-fdf7068b5e96 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:51.610740 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bab1fd-23e4-425a-b69c-fdf7068b5e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:51.631189 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-c7bab1fd-23e4-425a-b69c-fdf7068b5e96 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:51.632552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c7bab1fd-23e4-425a-b69c-fdf7068b5e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:51.761243 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1294/2539] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:06:51.763664 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490c345-388f-432a-b5d0-37ce152a5b29 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:51.764218 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490c345-388f-432a-b5d0-37ce152a5b29 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:51.764309 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490c345-388f-432a-b5d0-37ce152a5b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:51.797525 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-a490c345-388f-432a-b5d0-37ce152a5b29 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:51.798783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a490c345-388f-432a-b5d0-37ce152a5b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:51.807353 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1246/2540] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:51.811699 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bab1fd-23e4-425a-b69c-fdf7068b5e96 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:51.822958 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bab1fd-23e4-425a-b69c-fdf7068b5e96 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:51.827969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa49c38-3fa4-4b22-baa4-22b49a738f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:51.828871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa49c38-3fa4-4b22-baa4-22b49a738f86 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:51.829371 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa49c38-3fa4-4b22-baa4-22b49a738f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:51.829843 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa49c38-3fa4-4b22-baa4-22b49a738f86 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:51.831542 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa49c38-3fa4-4b22-baa4-22b49a738f86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:06:51.832152 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa49c38-3fa4-4b22-baa4-22b49a738f86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:51.834128 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa49c38-3fa4-4b22-baa4-22b49a738f86 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:51.853033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490c345-388f-432a-b5d0-37ce152a5b29 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:51.857526 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1295/2541] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:06:51.863046 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490c345-388f-432a-b5d0-37ce152a5b29 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:51.875122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28103e1-3fd8-44ff-be22-a4ceff40d2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:51.875994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28103e1-3fd8-44ff-be22-a4ceff40d2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:51.876443 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28103e1-3fd8-44ff-be22-a4ceff40d2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:51.877445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28103e1-3fd8-44ff-be22-a4ceff40d2b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:51.878222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28103e1-3fd8-44ff-be22-a4ceff40d2b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:51.880748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28103e1-3fd8-44ff-be22-a4ceff40d2b1 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:51.927946 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1247/2542] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:06:51 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:06:51.932352 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa49c38-3fa4-4b22-baa4-22b49a738f86 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:51.954016 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa49c38-3fa4-4b22-baa4-22b49a738f86 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:52.081070 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3af7a5-8fb1-4740-aecb-0b357cadaa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:52.081880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3af7a5-8fb1-4740-aecb-0b357cadaa7a admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:52.082160 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3af7a5-8fb1-4740-aecb-0b357cadaa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:52.082425 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3af7a5-8fb1-4740-aecb-0b357cadaa7a admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:52.083107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3af7a5-8fb1-4740-aecb-0b357cadaa7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:52.085144 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3af7a5-8fb1-4740-aecb-0b357cadaa7a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:52.108293 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1296/2543] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:06:51 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:06:52.118468 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28103e1-3fd8-44ff-be22-a4ceff40d2b1 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:52.140429 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28103e1-3fd8-44ff-be22-a4ceff40d2b1 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:52.147350 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c3845-2260-45a9-a295-f10e8c07c116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:52.148093 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c3845-2260-45a9-a295-f10e8c07c116 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:52.148478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c3845-2260-45a9-a295-f10e8c07c116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:52.148755 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c3845-2260-45a9-a295-f10e8c07c116 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:52.149514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c3845-2260-45a9-a295-f10e8c07c116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:52.151195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c3845-2260-45a9-a295-f10e8c07c116 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:52.162709 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1248/2544] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:06:52.166464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3af7a5-8fb1-4740-aecb-0b357cadaa7a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:52.177792 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3af7a5-8fb1-4740-aecb-0b357cadaa7a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:52.182775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491935f-8030-4eea-bc6e-f4f629c2bc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:52.183441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491935f-8030-4eea-bc6e-f4f629c2bc5c admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:52.183796 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491935f-8030-4eea-bc6e-f4f629c2bc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:52.184066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491935f-8030-4eea-bc6e-f4f629c2bc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:52.184824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491935f-8030-4eea-bc6e-f4f629c2bc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:52.186635 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491935f-8030-4eea-bc6e-f4f629c2bc5c admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:52.197528 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1297/2545] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:06:52.201534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c3845-2260-45a9-a295-f10e8c07c116 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:52.212875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c3845-2260-45a9-a295-f10e8c07c116 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:52.217650 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dff25-9086-42f1-baab-5f0eebe3b339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:52.218800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dff25-9086-42f1-baab-5f0eebe3b339 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:52.219279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dff25-9086-42f1-baab-5f0eebe3b339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:52.219653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dff25-9086-42f1-baab-5f0eebe3b339 admin admin] PATH_INFO: `/v3/projects/cd8d8c1a2bae418282f32c845c418eca/users/417f80653e234a64b14edffbea67a8ee/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:52.236912 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dff25-9086-42f1-baab-5f0eebe3b339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8d8c1a2bae418282f32c845c418eca, user_id=417f80653e234a64b14edffbea67a8ee, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:52.239969 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dff25-9086-42f1-baab-5f0eebe3b339 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:52.256198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1249/2546] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:06:52 2022] PUT /identity/v3/projects/cd8d8c1a2bae418282f32c845c418eca/users/417f80653e234a64b14edffbea67a8ee/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:52.268315 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073b423-7f60-4d51-9884-1ee3c8ca35b7 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:52.268604 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073b423-7f60-4d51-9884-1ee3c8ca35b7 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:52.268886 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073b423-7f60-4d51-9884-1ee3c8ca35b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:52.298147 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-5073b423-7f60-4d51-9884-1ee3c8ca35b7 None None] MFA Rules not processed for user `417f80653e234a64b14edffbea67a8ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:52.299480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-5073b423-7f60-4d51-9884-1ee3c8ca35b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:52.367550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1298/2547] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:52.373391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dff25-9086-42f1-baab-5f0eebe3b339 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:52.450237 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dff25-9086-42f1-baab-5f0eebe3b339 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:52.455576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b87de-91e4-493a-885b-e6db40e90bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:52.456253 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b87de-91e4-493a-885b-e6db40e90bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:52.456537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b87de-91e4-493a-885b-e6db40e90bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:52.456810 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b87de-91e4-493a-885b-e6db40e90bc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:52.457498 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b87de-91e4-493a-885b-e6db40e90bc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:52.459557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b87de-91e4-493a-885b-e6db40e90bc0 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:52.490782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1250/2548] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:06:52 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:06:52.495428 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073b423-7f60-4d51-9884-1ee3c8ca35b7 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:52.508786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073b423-7f60-4d51-9884-1ee3c8ca35b7 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:52.570545 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a0787-8e76-4d7f-9cdf-0d8d754b381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:52.571298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a0787-8e76-4d7f-9cdf-0d8d754b381b admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:52.571589 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a0787-8e76-4d7f-9cdf-0d8d754b381b admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:52.571973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a0787-8e76-4d7f-9cdf-0d8d754b381b admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:52.572757 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a0787-8e76-4d7f-9cdf-0d8d754b381b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:52.574629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a0787-8e76-4d7f-9cdf-0d8d754b381b admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:52.597101 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1299/2549] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:06:52 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:06:52.600999 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b87de-91e4-493a-885b-e6db40e90bc0 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:52.615585 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b87de-91e4-493a-885b-e6db40e90bc0 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:52.620950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684cb01-26d9-479f-a89d-6d27bc899d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:52.621647 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684cb01-26d9-479f-a89d-6d27bc899d12 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:52.622000 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684cb01-26d9-479f-a89d-6d27bc899d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:52.622344 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684cb01-26d9-479f-a89d-6d27bc899d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:52.623251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684cb01-26d9-479f-a89d-6d27bc899d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:52.625031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684cb01-26d9-479f-a89d-6d27bc899d12 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:52.637434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1251/2550] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:06:52.641244 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a0787-8e76-4d7f-9cdf-0d8d754b381b admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:52.655736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a0787-8e76-4d7f-9cdf-0d8d754b381b admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:52.662006 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a9f0d-77fe-4826-a4e4-3844905896c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:52.663025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a9f0d-77fe-4826-a4e4-3844905896c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:52.663394 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a9f0d-77fe-4826-a4e4-3844905896c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:52.663672 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a9f0d-77fe-4826-a4e4-3844905896c5 admin admin] PATH_INFO: `/v3/projects/70d26bf70d3045469bc2a3b5f52b841c/users/7bd2d36aa5af4f9fadda4c6554c6f0cc/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:52.690090 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a9f0d-77fe-4826-a4e4-3844905896c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d26bf70d3045469bc2a3b5f52b841c, user_id=7bd2d36aa5af4f9fadda4c6554c6f0cc, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:52.693260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a9f0d-77fe-4826-a4e4-3844905896c5 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:52.708127 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1300/2551] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:06:52 2022] PUT /identity/v3/projects/70d26bf70d3045469bc2a3b5f52b841c/users/7bd2d36aa5af4f9fadda4c6554c6f0cc/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:52.712372 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684cb01-26d9-479f-a89d-6d27bc899d12 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:52.726344 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684cb01-26d9-479f-a89d-6d27bc899d12 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:52.792797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0236d3a-9bf4-4678-a207-228904c0224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:52.794212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0236d3a-9bf4-4678-a207-228904c0224c admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:52.794653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0236d3a-9bf4-4678-a207-228904c0224c admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:52.795071 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0236d3a-9bf4-4678-a207-228904c0224c admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:52.796029 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0236d3a-9bf4-4678-a207-228904c0224c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:52.797875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0236d3a-9bf4-4678-a207-228904c0224c admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:52.809701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1252/2552] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:06:52.814028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a9f0d-77fe-4826-a4e4-3844905896c5 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:52.828585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a9f0d-77fe-4826-a4e4-3844905896c5 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:52.833730 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ec426-ddc4-4e87-b0e9-d9b134b2026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:52.834690 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ec426-ddc4-4e87-b0e9-d9b134b2026a admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:52.834978 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ec426-ddc4-4e87-b0e9-d9b134b2026a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:52.835486 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ec426-ddc4-4e87-b0e9-d9b134b2026a admin admin] PATH_INFO: `/v3/projects/70d26bf70d3045469bc2a3b5f52b841c/users/7bd2d36aa5af4f9fadda4c6554c6f0cc/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:52.837985 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ec426-ddc4-4e87-b0e9-d9b134b2026a admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d26bf70d3045469bc2a3b5f52b841c, user_id=7bd2d36aa5af4f9fadda4c6554c6f0cc, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:52.840994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ec426-ddc4-4e87-b0e9-d9b134b2026a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:52.854604 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1301/2553] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:06:52 2022] PUT /identity/v3/projects/70d26bf70d3045469bc2a3b5f52b841c/users/7bd2d36aa5af4f9fadda4c6554c6f0cc/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:52.865872 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27853c-3359-439d-a590-19e71a4415d9 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:52.866159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27853c-3359-439d-a590-19e71a4415d9 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:52.866445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27853c-3359-439d-a590-19e71a4415d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:52.895005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-5f27853c-3359-439d-a590-19e71a4415d9 None None] MFA Rules not processed for user `7bd2d36aa5af4f9fadda4c6554c6f0cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:52.896256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-5f27853c-3359-439d-a590-19e71a4415d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:52.975989 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1253/2554] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:06:52.987260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ec426-ddc4-4e87-b0e9-d9b134b2026a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:52.989742 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-695ec426-ddc4-4e87-b0e9-d9b134b2026a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:53.089417 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ec426-ddc4-4e87-b0e9-d9b134b2026a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:53.096241 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b353b-17cb-4f57-92ea-32dc03092ff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:53.096944 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b353b-17cb-4f57-92ea-32dc03092ff7 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:53.097193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b353b-17cb-4f57-92ea-32dc03092ff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:53.097468 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b353b-17cb-4f57-92ea-32dc03092ff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:53.107865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b353b-17cb-4f57-92ea-32dc03092ff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:53.109616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b353b-17cb-4f57-92ea-32dc03092ff7 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:53.121608 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1302/2555] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:06:53.287832 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27853c-3359-439d-a590-19e71a4415d9 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:53.372984 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27853c-3359-439d-a590-19e71a4415d9 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:53.378423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfd5c8-226c-48b9-b791-f0403ab85444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:53.379307 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfd5c8-226c-48b9-b791-f0403ab85444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:53.379591 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfd5c8-226c-48b9-b791-f0403ab85444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:53.380042 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfd5c8-226c-48b9-b791-f0403ab85444 admin admin] PATH_INFO: `/v3/users/417f80653e234a64b14edffbea67a8ee` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:53.381404 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfd5c8-226c-48b9-b791-f0403ab85444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=417f80653e234a64b14edffbea67a8ee)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:53.383356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfd5c8-226c-48b9-b791-f0403ab85444 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:53.465072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-61cfd5c8-226c-48b9-b791-f0403ab85444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '417f80653e234a64b14edffbea67a8ee'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:53.467323 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-61cfd5c8-226c-48b9-b791-f0403ab85444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '417f80653e234a64b14edffbea67a8ee'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:53.492929 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-61cfd5c8-226c-48b9-b791-f0403ab85444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '417f80653e234a64b14edffbea67a8ee'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:53.512992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-61cfd5c8-226c-48b9-b791-f0403ab85444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '417f80653e234a64b14edffbea67a8ee'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:53.515450 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-61cfd5c8-226c-48b9-b791-f0403ab85444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '417f80653e234a64b14edffbea67a8ee'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:53.540212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1254/2556] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:06:53 2022] DELETE /identity/v3/users/417f80653e234a64b14edffbea67a8ee => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:53.544711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56432b-528a-488b-ae08-a3c3a3b940b7 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:53.545001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56432b-528a-488b-ae08-a3c3a3b940b7 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:53.545281 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56432b-528a-488b-ae08-a3c3a3b940b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:53.566256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-af56432b-528a-488b-ae08-a3c3a3b940b7 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:53.567728 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-af56432b-528a-488b-ae08-a3c3a3b940b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:53.637520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1303/2557] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:53.648610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfd5c8-226c-48b9-b791-f0403ab85444 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:53.650401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-61cfd5c8-226c-48b9-b791-f0403ab85444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:53.713130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfd5c8-226c-48b9-b791-f0403ab85444 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:53.716599 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9428138-ddd3-4de4-98aa-4d502ac4dc82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:53.717226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9428138-ddd3-4de4-98aa-4d502ac4dc82 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:53.717501 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9428138-ddd3-4de4-98aa-4d502ac4dc82 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:53.717769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9428138-ddd3-4de4-98aa-4d502ac4dc82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:53.726478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9428138-ddd3-4de4-98aa-4d502ac4dc82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:53.727884 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9428138-ddd3-4de4-98aa-4d502ac4dc82 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:53.737439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1255/2558] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:06:54.021467 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56432b-528a-488b-ae08-a3c3a3b940b7 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:54.024491 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-af56432b-528a-488b-ae08-a3c3a3b940b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:54.047569 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56432b-528a-488b-ae08-a3c3a3b940b7 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:54.055556 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d51cb-7aa0-497e-88d0-d4748f505c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:54.056624 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d51cb-7aa0-497e-88d0-d4748f505c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:54.056720 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d51cb-7aa0-497e-88d0-d4748f505c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:54.057161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d51cb-7aa0-497e-88d0-d4748f505c0b admin admin] PATH_INFO: `/v3/projects/cd8d8c1a2bae418282f32c845c418eca` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:54.058553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d51cb-7aa0-497e-88d0-d4748f505c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8d8c1a2bae418282f32c845c418eca)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:54.060817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d51cb-7aa0-497e-88d0-d4748f505c0b admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:54.120512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-197d51cb-7aa0-497e-88d0-d4748f505c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8d8c1a2bae418282f32c845c418eca', 'request_id': 'req-197d51cb-7aa0-497e-88d0-d4748f505c0b'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:54.130163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-197d51cb-7aa0-497e-88d0-d4748f505c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8d8c1a2bae418282f32c845c418eca', 'request_id': 'req-197d51cb-7aa0-497e-88d0-d4748f505c0b'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:54.138300 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-197d51cb-7aa0-497e-88d0-d4748f505c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8d8c1a2bae418282f32c845c418eca', 'request_id': 'req-197d51cb-7aa0-497e-88d0-d4748f505c0b'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:54.151656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-197d51cb-7aa0-497e-88d0-d4748f505c0b admin admin] The token cache is being invalidate because project cd8d8c1a2bae418282f32c845c418eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:06:54.152254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-197d51cb-7aa0-497e-88d0-d4748f505c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:54.153225 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-197d51cb-7aa0-497e-88d0-d4748f505c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:54.155568 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1304/2559] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:06:54 2022] DELETE /identity/v3/projects/cd8d8c1a2bae418282f32c845c418eca => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:54.160162 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9428138-ddd3-4de4-98aa-4d502ac4dc82 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:54.171279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9428138-ddd3-4de4-98aa-4d502ac4dc82 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:54.234630 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3d348-8d70-4cc9-94d3-4ffeadd83781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:54.235644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3d348-8d70-4cc9-94d3-4ffeadd83781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:54.235951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3d348-8d70-4cc9-94d3-4ffeadd83781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:54.236281 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3d348-8d70-4cc9-94d3-4ffeadd83781 admin admin] PATH_INFO: `/v3/users/7bd2d36aa5af4f9fadda4c6554c6f0cc` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:54.238139 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3d348-8d70-4cc9-94d3-4ffeadd83781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bd2d36aa5af4f9fadda4c6554c6f0cc)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:54.240279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3d348-8d70-4cc9-94d3-4ffeadd83781 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:54.299907 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-69c3d348-8d70-4cc9-94d3-4ffeadd83781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bd2d36aa5af4f9fadda4c6554c6f0cc'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:54.301315 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-69c3d348-8d70-4cc9-94d3-4ffeadd83781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bd2d36aa5af4f9fadda4c6554c6f0cc'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:54.317618 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-69c3d348-8d70-4cc9-94d3-4ffeadd83781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bd2d36aa5af4f9fadda4c6554c6f0cc'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:54.326775 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-69c3d348-8d70-4cc9-94d3-4ffeadd83781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bd2d36aa5af4f9fadda4c6554c6f0cc'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:54.327720 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-69c3d348-8d70-4cc9-94d3-4ffeadd83781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bd2d36aa5af4f9fadda4c6554c6f0cc'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:54.342503 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1256/2560] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:06:54 2022] DELETE /identity/v3/users/7bd2d36aa5af4f9fadda4c6554c6f0cc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:54.668206 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d51cb-7aa0-497e-88d0-d4748f505c0b admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:54.669731 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-197d51cb-7aa0-497e-88d0-d4748f505c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:54.695441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d51cb-7aa0-497e-88d0-d4748f505c0b admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:54.763808 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c4f5d-3aca-47a4-a501-fa99210e0f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:54.764749 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c4f5d-3aca-47a4-a501-fa99210e0f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:54.765137 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c4f5d-3aca-47a4-a501-fa99210e0f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:54.765414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c4f5d-3aca-47a4-a501-fa99210e0f6b admin admin] PATH_INFO: `/v3/projects/70d26bf70d3045469bc2a3b5f52b841c` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:54.767349 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c4f5d-3aca-47a4-a501-fa99210e0f6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d26bf70d3045469bc2a3b5f52b841c)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:54.769270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c4f5d-3aca-47a4-a501-fa99210e0f6b admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:54.822315 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8e4c4f5d-3aca-47a4-a501-fa99210e0f6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d26bf70d3045469bc2a3b5f52b841c', 'request_id': 'req-8e4c4f5d-3aca-47a4-a501-fa99210e0f6b'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:54.831929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8e4c4f5d-3aca-47a4-a501-fa99210e0f6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d26bf70d3045469bc2a3b5f52b841c', 'request_id': 'req-8e4c4f5d-3aca-47a4-a501-fa99210e0f6b'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:54.839352 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8e4c4f5d-3aca-47a4-a501-fa99210e0f6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d26bf70d3045469bc2a3b5f52b841c', 'request_id': 'req-8e4c4f5d-3aca-47a4-a501-fa99210e0f6b'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:54.853147 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8e4c4f5d-3aca-47a4-a501-fa99210e0f6b admin admin] The token cache is being invalidate because project 70d26bf70d3045469bc2a3b5f52b841c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:06:54.853478 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8e4c4f5d-3aca-47a4-a501-fa99210e0f6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:54.854168 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-8e4c4f5d-3aca-47a4-a501-fa99210e0f6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:54.856205 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1305/2561] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:06:54 2022] DELETE /identity/v3/projects/70d26bf70d3045469bc2a3b5f52b841c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:54.861895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf069b-d8e7-4e7a-b43d-080f14ad47dd None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:54.862554 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf069b-d8e7-4e7a-b43d-080f14ad47dd None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:54.863024 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf069b-d8e7-4e7a-b43d-080f14ad47dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:54.883705 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-ebdf069b-d8e7-4e7a-b43d-080f14ad47dd None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:54.884986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ebdf069b-d8e7-4e7a-b43d-080f14ad47dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:54.950569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1257/2562] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:54.958556 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808410c8-d2f3-455c-827a-bcf22a53b970 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:54.958729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808410c8-d2f3-455c-827a-bcf22a53b970 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:54.958959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808410c8-d2f3-455c-827a-bcf22a53b970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:54.983535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-808410c8-d2f3-455c-827a-bcf22a53b970 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:54.984811 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-808410c8-d2f3-455c-827a-bcf22a53b970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:54.994250 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1306/2563] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:54.998338 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf069b-d8e7-4e7a-b43d-080f14ad47dd None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:55.009742 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf069b-d8e7-4e7a-b43d-080f14ad47dd None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:55.015249 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bb6e2-f5b5-4d2a-940d-c8bd1fbd9f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:55.015813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bb6e2-f5b5-4d2a-940d-c8bd1fbd9f05 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:55.016089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bb6e2-f5b5-4d2a-940d-c8bd1fbd9f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:55.016401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bb6e2-f5b5-4d2a-940d-c8bd1fbd9f05 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:55.017459 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bb6e2-f5b5-4d2a-940d-c8bd1fbd9f05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:06:55.017876 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bb6e2-f5b5-4d2a-940d-c8bd1fbd9f05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:55.019509 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bb6e2-f5b5-4d2a-940d-c8bd1fbd9f05 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:55.036212 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1258/2564] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:06:55.037768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808410c8-d2f3-455c-827a-bcf22a53b970 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:55.047818 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808410c8-d2f3-455c-827a-bcf22a53b970 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:55.054741 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cae779-9379-4f7c-b8bb-8a51dba3eae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:55.055066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cae779-9379-4f7c-b8bb-8a51dba3eae5 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:55.055412 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cae779-9379-4f7c-b8bb-8a51dba3eae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:55.055412 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cae779-9379-4f7c-b8bb-8a51dba3eae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:55.056919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cae779-9379-4f7c-b8bb-8a51dba3eae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:55.058642 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cae779-9379-4f7c-b8bb-8a51dba3eae5 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:55.113207 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1307/2565] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:06:55 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:06:55.120650 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bb6e2-f5b5-4d2a-940d-c8bd1fbd9f05 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:55.129701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bb6e2-f5b5-4d2a-940d-c8bd1fbd9f05 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:55.222967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f26be0-fd87-4b06-b717-91aacb271320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:55.223736 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f26be0-fd87-4b06-b717-91aacb271320 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:55.224031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f26be0-fd87-4b06-b717-91aacb271320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:55.224284 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f26be0-fd87-4b06-b717-91aacb271320 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:55.225966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f26be0-fd87-4b06-b717-91aacb271320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:55.227914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f26be0-fd87-4b06-b717-91aacb271320 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:55.257830 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1259/2566] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:06:55 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:06:55.263771 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cae779-9379-4f7c-b8bb-8a51dba3eae5 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:55.276135 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cae779-9379-4f7c-b8bb-8a51dba3eae5 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:55.291164 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1682725-92a0-4dc5-8295-500ddcf153bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:55.292733 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1682725-92a0-4dc5-8295-500ddcf153bc admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:55.296363 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1682725-92a0-4dc5-8295-500ddcf153bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:55.296793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1682725-92a0-4dc5-8295-500ddcf153bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:55.297802 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1682725-92a0-4dc5-8295-500ddcf153bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:55.299971 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1682725-92a0-4dc5-8295-500ddcf153bc admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:55.316383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1308/2567] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:06:55.320655 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f26be0-fd87-4b06-b717-91aacb271320 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:55.331634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f26be0-fd87-4b06-b717-91aacb271320 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:55.336828 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebef78b-4c38-4ac8-b8dd-28937de8164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:55.337806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebef78b-4c38-4ac8-b8dd-28937de8164b admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:55.338092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebef78b-4c38-4ac8-b8dd-28937de8164b admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:55.338370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebef78b-4c38-4ac8-b8dd-28937de8164b admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:55.339130 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebef78b-4c38-4ac8-b8dd-28937de8164b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:55.340764 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebef78b-4c38-4ac8-b8dd-28937de8164b admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:55.352206 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1260/2568] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:06:55.356344 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1682725-92a0-4dc5-8295-500ddcf153bc admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:55.367460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1682725-92a0-4dc5-8295-500ddcf153bc admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:55.372286 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3b2a3-c3b3-43aa-a5d2-304b93362ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:55.373169 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3b2a3-c3b3-43aa-a5d2-304b93362ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:55.373444 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3b2a3-c3b3-43aa-a5d2-304b93362ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:55.373717 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3b2a3-c3b3-43aa-a5d2-304b93362ce5 admin admin] PATH_INFO: `/v3/projects/e3a114eb0a7c4dcf8e94fcf3faa13720/users/0704be0f9aac4d0e8eaae5cd28b29cfb/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:55.388965 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3b2a3-c3b3-43aa-a5d2-304b93362ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a114eb0a7c4dcf8e94fcf3faa13720, user_id=0704be0f9aac4d0e8eaae5cd28b29cfb, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:55.393087 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3b2a3-c3b3-43aa-a5d2-304b93362ce5 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:55.409291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1309/2569] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:06:55 2022] PUT /identity/v3/projects/e3a114eb0a7c4dcf8e94fcf3faa13720/users/0704be0f9aac4d0e8eaae5cd28b29cfb/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:55.419261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7e986-f0f7-4d09-bf7f-1d9ad0b0b205 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:55.419551 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7e986-f0f7-4d09-bf7f-1d9ad0b0b205 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:55.419830 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7e986-f0f7-4d09-bf7f-1d9ad0b0b205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:55.447914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-a7c7e986-f0f7-4d09-bf7f-1d9ad0b0b205 None None] MFA Rules not processed for user `0704be0f9aac4d0e8eaae5cd28b29cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:55.449558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a7c7e986-f0f7-4d09-bf7f-1d9ad0b0b205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:55.515826 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1261/2570] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:06:55.528097 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3b2a3-c3b3-43aa-a5d2-304b93362ce5 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:55.529819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c6b3b2a3-c3b3-43aa-a5d2-304b93362ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:55.589802 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3b2a3-c3b3-43aa-a5d2-304b93362ce5 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:55.593614 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fb05d-3e7b-42c8-afaa-fe52f48b0172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:55.594256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fb05d-3e7b-42c8-afaa-fe52f48b0172 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:55.594538 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fb05d-3e7b-42c8-afaa-fe52f48b0172 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:55.594814 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fb05d-3e7b-42c8-afaa-fe52f48b0172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:55.604149 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fb05d-3e7b-42c8-afaa-fe52f48b0172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:55.605626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fb05d-3e7b-42c8-afaa-fe52f48b0172 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:55.615823 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1310/2571] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:06:55.635070 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7e986-f0f7-4d09-bf7f-1d9ad0b0b205 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:55.709597 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7e986-f0f7-4d09-bf7f-1d9ad0b0b205 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:55.714627 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b0a81-a9f6-4700-b498-de7a50b48490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:55.715541 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b0a81-a9f6-4700-b498-de7a50b48490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:55.715823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b0a81-a9f6-4700-b498-de7a50b48490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:55.716112 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b0a81-a9f6-4700-b498-de7a50b48490 admin admin] PATH_INFO: `/v3/users/0704be0f9aac4d0e8eaae5cd28b29cfb` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:55.717416 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b0a81-a9f6-4700-b498-de7a50b48490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0704be0f9aac4d0e8eaae5cd28b29cfb)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:55.719424 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b0a81-a9f6-4700-b498-de7a50b48490 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:55.770778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cb0b0a81-a9f6-4700-b498-de7a50b48490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0704be0f9aac4d0e8eaae5cd28b29cfb'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:55.771522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cb0b0a81-a9f6-4700-b498-de7a50b48490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0704be0f9aac4d0e8eaae5cd28b29cfb'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:55.785435 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cb0b0a81-a9f6-4700-b498-de7a50b48490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0704be0f9aac4d0e8eaae5cd28b29cfb'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:55.793356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cb0b0a81-a9f6-4700-b498-de7a50b48490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0704be0f9aac4d0e8eaae5cd28b29cfb'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:55.794001 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-cb0b0a81-a9f6-4700-b498-de7a50b48490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0704be0f9aac4d0e8eaae5cd28b29cfb'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:55.806533 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1262/2572] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:06:55 2022] DELETE /identity/v3/users/0704be0f9aac4d0e8eaae5cd28b29cfb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:55.811484 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d9ec9-e69c-49ef-b0c1-48cbba8ea0f2 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:55.811786 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d9ec9-e69c-49ef-b0c1-48cbba8ea0f2 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:55.812070 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d9ec9-e69c-49ef-b0c1-48cbba8ea0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:55.831158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-364d9ec9-e69c-49ef-b0c1-48cbba8ea0f2 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:55.832443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-364d9ec9-e69c-49ef-b0c1-48cbba8ea0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:55.908239 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1311/2573] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:06:55.917125 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b0a81-a9f6-4700-b498-de7a50b48490 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:55.918983 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-cb0b0a81-a9f6-4700-b498-de7a50b48490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:55.980127 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b0a81-a9f6-4700-b498-de7a50b48490 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:55.984228 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff50f9-9973-4f67-afc0-ee0306f29a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:55.984884 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff50f9-9973-4f67-afc0-ee0306f29a95 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:55.985239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff50f9-9973-4f67-afc0-ee0306f29a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:55.985417 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff50f9-9973-4f67-afc0-ee0306f29a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:55.995619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff50f9-9973-4f67-afc0-ee0306f29a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:55.997187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff50f9-9973-4f67-afc0-ee0306f29a95 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:56.007987 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1263/2574] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:06:56.369324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d9ec9-e69c-49ef-b0c1-48cbba8ea0f2 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:56.372000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-364d9ec9-e69c-49ef-b0c1-48cbba8ea0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:56.403472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d9ec9-e69c-49ef-b0c1-48cbba8ea0f2 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:56.437675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb58e17-a686-4fa6-8242-b48f9db11db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:56.438774 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb58e17-a686-4fa6-8242-b48f9db11db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:56.439057 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb58e17-a686-4fa6-8242-b48f9db11db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:56.439336 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb58e17-a686-4fa6-8242-b48f9db11db8 admin admin] PATH_INFO: `/v3/projects/e3a114eb0a7c4dcf8e94fcf3faa13720` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:56.440773 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb58e17-a686-4fa6-8242-b48f9db11db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a114eb0a7c4dcf8e94fcf3faa13720)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:56.442709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb58e17-a686-4fa6-8242-b48f9db11db8 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:56.517722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-0bb58e17-a686-4fa6-8242-b48f9db11db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a114eb0a7c4dcf8e94fcf3faa13720', 'request_id': 'req-0bb58e17-a686-4fa6-8242-b48f9db11db8'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:56.530990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-0bb58e17-a686-4fa6-8242-b48f9db11db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a114eb0a7c4dcf8e94fcf3faa13720', 'request_id': 'req-0bb58e17-a686-4fa6-8242-b48f9db11db8'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:56.540839 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-0bb58e17-a686-4fa6-8242-b48f9db11db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a114eb0a7c4dcf8e94fcf3faa13720', 'request_id': 'req-0bb58e17-a686-4fa6-8242-b48f9db11db8'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:56.555421 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-0bb58e17-a686-4fa6-8242-b48f9db11db8 admin admin] The token cache is being invalidate because project e3a114eb0a7c4dcf8e94fcf3faa13720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:06:56.556107 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-0bb58e17-a686-4fa6-8242-b48f9db11db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:56.557039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-0bb58e17-a686-4fa6-8242-b48f9db11db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:06:56.559295 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1312/2575] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:06:56 2022] DELETE /identity/v3/projects/e3a114eb0a7c4dcf8e94fcf3faa13720 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:56.567198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8cb3c-8f01-49c0-8ab4-fa627f8293dd None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:56.568813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8cb3c-8f01-49c0-8ab4-fa627f8293dd None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:56.569285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8cb3c-8f01-49c0-8ab4-fa627f8293dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:56.594778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-5af8cb3c-8f01-49c0-8ab4-fa627f8293dd None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:56.600262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-5af8cb3c-8f01-49c0-8ab4-fa627f8293dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:56.710724 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1264/2576] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:56.720088 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07550d-752c-426c-af40-0176d62c1811 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:56.721557 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07550d-752c-426c-af40-0176d62c1811 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:56.721936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07550d-752c-426c-af40-0176d62c1811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:56.750061 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-ad07550d-752c-426c-af40-0176d62c1811 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:56.752432 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ad07550d-752c-426c-af40-0176d62c1811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:56.774473 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1313/2577] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:56.778567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8cb3c-8f01-49c0-8ab4-fa627f8293dd None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:56.791230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8cb3c-8f01-49c0-8ab4-fa627f8293dd None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:56.804337 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c85ea-79dc-40dc-98f4-38518087ea78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:56.805070 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c85ea-79dc-40dc-98f4-38518087ea78 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:56.805441 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c85ea-79dc-40dc-98f4-38518087ea78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:56.805947 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c85ea-79dc-40dc-98f4-38518087ea78 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:56.806911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c85ea-79dc-40dc-98f4-38518087ea78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:06:56.807315 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c85ea-79dc-40dc-98f4-38518087ea78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:56.809900 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c85ea-79dc-40dc-98f4-38518087ea78 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:56.849171 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1265/2578] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:06:56.854936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07550d-752c-426c-af40-0176d62c1811 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:56.869689 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07550d-752c-426c-af40-0176d62c1811 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:56.876622 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74243ea4-2313-4cf0-9039-9ed48d245fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:56.878094 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74243ea4-2313-4cf0-9039-9ed48d245fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:56.878556 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74243ea4-2313-4cf0-9039-9ed48d245fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:56.879026 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74243ea4-2313-4cf0-9039-9ed48d245fc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:56.879921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74243ea4-2313-4cf0-9039-9ed48d245fc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:56.882406 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74243ea4-2313-4cf0-9039-9ed48d245fc8 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:56.924624 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1314/2579] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:06:56 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:06:56.929285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c85ea-79dc-40dc-98f4-38518087ea78 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:56.942935 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c85ea-79dc-40dc-98f4-38518087ea78 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:57.041268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2f2e3-fb59-4a13-94b4-36aec7c990c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:57.041949 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2f2e3-fb59-4a13-94b4-36aec7c990c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:57.042228 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2f2e3-fb59-4a13-94b4-36aec7c990c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:57.042496 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2f2e3-fb59-4a13-94b4-36aec7c990c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:57.043183 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2f2e3-fb59-4a13-94b4-36aec7c990c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:57.045169 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2f2e3-fb59-4a13-94b4-36aec7c990c6 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:57.077449 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1266/2580] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:06:56 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:06:57.081596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74243ea4-2313-4cf0-9039-9ed48d245fc8 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:57.096793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74243ea4-2313-4cf0-9039-9ed48d245fc8 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:57.102193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80903d-5e73-4d03-ad56-09d79398216a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:57.102939 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80903d-5e73-4d03-ad56-09d79398216a admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:57.103320 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80903d-5e73-4d03-ad56-09d79398216a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:57.103693 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80903d-5e73-4d03-ad56-09d79398216a admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:57.104548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80903d-5e73-4d03-ad56-09d79398216a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:57.106232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80903d-5e73-4d03-ad56-09d79398216a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:57.118848 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1315/2581] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:06:57.122607 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2f2e3-fb59-4a13-94b4-36aec7c990c6 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:57.137898 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2f2e3-fb59-4a13-94b4-36aec7c990c6 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:57.143736 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4d422-1a33-40ea-8d05-483a9d7e7a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:57.144535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4d422-1a33-40ea-8d05-483a9d7e7a24 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:57.144914 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4d422-1a33-40ea-8d05-483a9d7e7a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:57.145326 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4d422-1a33-40ea-8d05-483a9d7e7a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:57.146133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4d422-1a33-40ea-8d05-483a9d7e7a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:57.147829 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4d422-1a33-40ea-8d05-483a9d7e7a24 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:57.163847 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1267/2582] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:06:57.172553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80903d-5e73-4d03-ad56-09d79398216a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:57.190577 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80903d-5e73-4d03-ad56-09d79398216a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:57.196878 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07364fd4-5c35-4c78-b8d6-65b270a716bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:57.198348 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07364fd4-5c35-4c78-b8d6-65b270a716bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:57.199197 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07364fd4-5c35-4c78-b8d6-65b270a716bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:57.199600 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07364fd4-5c35-4c78-b8d6-65b270a716bc admin admin] PATH_INFO: `/v3/projects/24e11f2d6fef4260af44af7807ac0c9d/users/6da117e545bf40d1b02793cf7ad4a939/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:57.217341 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07364fd4-5c35-4c78-b8d6-65b270a716bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e11f2d6fef4260af44af7807ac0c9d, user_id=6da117e545bf40d1b02793cf7ad4a939, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:57.220131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07364fd4-5c35-4c78-b8d6-65b270a716bc admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:57.241950 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1316/2583] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:06:57 2022] PUT /identity/v3/projects/24e11f2d6fef4260af44af7807ac0c9d/users/6da117e545bf40d1b02793cf7ad4a939/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:06:57.252227 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cce73b-96e5-439d-b291-a2ca6109cad7 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:57.252722 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cce73b-96e5-439d-b291-a2ca6109cad7 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:57.253190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cce73b-96e5-439d-b291-a2ca6109cad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:57.291906 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-b9cce73b-96e5-439d-b291-a2ca6109cad7 None None] MFA Rules not processed for user `6da117e545bf40d1b02793cf7ad4a939`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:06:57.293391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b9cce73b-96e5-439d-b291-a2ca6109cad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:57.391770 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1268/2584] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:06:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:06:57.406127 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07364fd4-5c35-4c78-b8d6-65b270a716bc admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:06:57.410719 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-07364fd4-5c35-4c78-b8d6-65b270a716bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:06:57.484481 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07364fd4-5c35-4c78-b8d6-65b270a716bc admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:06:57.489848 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f48c99-aac5-41d8-82ae-89caf6ff1729 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:06:57.490683 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f48c99-aac5-41d8-82ae-89caf6ff1729 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:06:57.490968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f48c99-aac5-41d8-82ae-89caf6ff1729 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:06:57.492544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f48c99-aac5-41d8-82ae-89caf6ff1729 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:06:57.502887 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f48c99-aac5-41d8-82ae-89caf6ff1729 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:06:57.504522 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f48c99-aac5-41d8-82ae-89caf6ff1729 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:06:57.515877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1317/2585] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:06:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:02.980211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cce73b-96e5-439d-b291-a2ca6109cad7 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:02.981658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b9cce73b-96e5-439d-b291-a2ca6109cad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:03.054400 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cce73b-96e5-439d-b291-a2ca6109cad7 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:03.059782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f745654-9e4d-41af-b9f0-186e8ef0bd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:03.060722 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f745654-9e4d-41af-b9f0-186e8ef0bd0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:03.061008 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f745654-9e4d-41af-b9f0-186e8ef0bd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:03.061319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f745654-9e4d-41af-b9f0-186e8ef0bd0a admin admin] PATH_INFO: `/v3/users/325d1a72613c44f7810cf5b42fc52e62` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:03.062539 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f745654-9e4d-41af-b9f0-186e8ef0bd0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=325d1a72613c44f7810cf5b42fc52e62)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:03.064633 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f745654-9e4d-41af-b9f0-186e8ef0bd0a admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:03.118098 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-8f745654-9e4d-41af-b9f0-186e8ef0bd0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325d1a72613c44f7810cf5b42fc52e62'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:03.119230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-8f745654-9e4d-41af-b9f0-186e8ef0bd0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325d1a72613c44f7810cf5b42fc52e62'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:03.134746 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-8f745654-9e4d-41af-b9f0-186e8ef0bd0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325d1a72613c44f7810cf5b42fc52e62'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:03.146650 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-8f745654-9e4d-41af-b9f0-186e8ef0bd0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325d1a72613c44f7810cf5b42fc52e62'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:03.147367 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-8f745654-9e4d-41af-b9f0-186e8ef0bd0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325d1a72613c44f7810cf5b42fc52e62'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:03.162920 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1269/2586] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:07:02 2022] DELETE /identity/v3/users/325d1a72613c44f7810cf5b42fc52e62 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:07:03.167927 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0c5d9-880e-4170-bf2e-7bad86e5b783 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:03.168436 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0c5d9-880e-4170-bf2e-7bad86e5b783 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:03.168548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0c5d9-880e-4170-bf2e-7bad86e5b783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:03.193140 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-93b0c5d9-880e-4170-bf2e-7bad86e5b783 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:03.194424 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-93b0c5d9-880e-4170-bf2e-7bad86e5b783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:03.291717 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1318/2587] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:03.305216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f745654-9e4d-41af-b9f0-186e8ef0bd0a admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:03.306782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8f745654-9e4d-41af-b9f0-186e8ef0bd0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:03.432390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f745654-9e4d-41af-b9f0-186e8ef0bd0a admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:03.437320 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59152fa9-ec18-4614-bffc-a107f6e18bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:03.437510 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59152fa9-ec18-4614-bffc-a107f6e18bea service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:03.437878 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59152fa9-ec18-4614-bffc-a107f6e18bea service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:03.438360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59152fa9-ec18-4614-bffc-a107f6e18bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:03.451236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59152fa9-ec18-4614-bffc-a107f6e18bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:03.454714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59152fa9-ec18-4614-bffc-a107f6e18bea service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:03.470272 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1270/2588] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:07:04.353424 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0c5d9-880e-4170-bf2e-7bad86e5b783 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:04.354906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-93b0c5d9-880e-4170-bf2e-7bad86e5b783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:04.386363 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0c5d9-880e-4170-bf2e-7bad86e5b783 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:04.419831 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02f271-d5b8-4594-8d5a-e1155b8c3346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:04.422865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f271-d5b8-4594-8d5a-e1155b8c3346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:04.423307 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f271-d5b8-4594-8d5a-e1155b8c3346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:04.424336 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f271-d5b8-4594-8d5a-e1155b8c3346 admin admin] PATH_INFO: `/v3/projects/d47a2c56d6eb4fee9f90d141f4a28f78` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:04.425793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02f271-d5b8-4594-8d5a-e1155b8c3346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d47a2c56d6eb4fee9f90d141f4a28f78)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:04.428406 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02f271-d5b8-4594-8d5a-e1155b8c3346 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:04.498262 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-be02f271-d5b8-4594-8d5a-e1155b8c3346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd47a2c56d6eb4fee9f90d141f4a28f78', 'request_id': 'req-be02f271-d5b8-4594-8d5a-e1155b8c3346'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:04.507648 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-be02f271-d5b8-4594-8d5a-e1155b8c3346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd47a2c56d6eb4fee9f90d141f4a28f78', 'request_id': 'req-be02f271-d5b8-4594-8d5a-e1155b8c3346'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:04.514287 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-be02f271-d5b8-4594-8d5a-e1155b8c3346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd47a2c56d6eb4fee9f90d141f4a28f78', 'request_id': 'req-be02f271-d5b8-4594-8d5a-e1155b8c3346'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:04.528251 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-be02f271-d5b8-4594-8d5a-e1155b8c3346 admin admin] The token cache is being invalidate because project d47a2c56d6eb4fee9f90d141f4a28f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:07:04.532935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-be02f271-d5b8-4594-8d5a-e1155b8c3346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:04.534528 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-be02f271-d5b8-4594-8d5a-e1155b8c3346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:04.540450 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1319/2589] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:07:04 2022] DELETE /identity/v3/projects/d47a2c56d6eb4fee9f90d141f4a28f78 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:04.541986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2cad-428e-445f-9aa5-4c71d4ffe44c None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:04.542450 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2cad-428e-445f-9aa5-4c71d4ffe44c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:04.542577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2cad-428e-445f-9aa5-4c71d4ffe44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:04.584590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-b1ca2cad-428e-445f-9aa5-4c71d4ffe44c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:04.585428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b1ca2cad-428e-445f-9aa5-4c71d4ffe44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:04.698849 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36226d-0565-44a9-bebc-29d450addad6 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:04.699136 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36226d-0565-44a9-bebc-29d450addad6 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:04.699994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36226d-0565-44a9-bebc-29d450addad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:04.702832 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1271/2590] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:07:04.722105 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-5d36226d-0565-44a9-bebc-29d450addad6 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:04.723887 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-5d36226d-0565-44a9-bebc-29d450addad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:04.736216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1320/2591] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:04.737766 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca2cad-428e-445f-9aa5-4c71d4ffe44c None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:04.749357 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca2cad-428e-445f-9aa5-4c71d4ffe44c None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:04.755576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a7a82-405f-4b14-9f4c-2bb3b55ab469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:04.757578 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7a82-405f-4b14-9f4c-2bb3b55ab469 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:04.759381 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7a82-405f-4b14-9f4c-2bb3b55ab469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:04.760220 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7a82-405f-4b14-9f4c-2bb3b55ab469 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:04.761921 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a7a82-405f-4b14-9f4c-2bb3b55ab469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:07:04.762387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a7a82-405f-4b14-9f4c-2bb3b55ab469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:04.763961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a7a82-405f-4b14-9f4c-2bb3b55ab469 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:04.781330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1272/2592] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:07:04.785327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36226d-0565-44a9-bebc-29d450addad6 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:04.797632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36226d-0565-44a9-bebc-29d450addad6 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:04.803943 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1a1d6-b1fe-4fb5-a372-9d316292f2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:04.805156 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1a1d6-b1fe-4fb5-a372-9d316292f2b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:04.805493 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1a1d6-b1fe-4fb5-a372-9d316292f2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:04.805865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1a1d6-b1fe-4fb5-a372-9d316292f2b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:04.806663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1a1d6-b1fe-4fb5-a372-9d316292f2b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:04.808798 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1a1d6-b1fe-4fb5-a372-9d316292f2b7 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:04.849945 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1321/2593] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:07:04 2022] POST /identity/v3/projects => generated 405 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:07:04.853861 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a7a82-405f-4b14-9f4c-2bb3b55ab469 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:04.864993 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a7a82-405f-4b14-9f4c-2bb3b55ab469 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:04.945295 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875068ac-949c-4f49-9874-3ee1662e142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:04.945650 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875068ac-949c-4f49-9874-3ee1662e142d admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:04.946054 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875068ac-949c-4f49-9874-3ee1662e142d admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:04.948230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875068ac-949c-4f49-9874-3ee1662e142d admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:04.948230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875068ac-949c-4f49-9874-3ee1662e142d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:04.949549 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875068ac-949c-4f49-9874-3ee1662e142d admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:05.001291 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1273/2594] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:07:04 2022] POST /identity/v3/users => generated 303 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:05.005656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1a1d6-b1fe-4fb5-a372-9d316292f2b7 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:05.020603 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1a1d6-b1fe-4fb5-a372-9d316292f2b7 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:05.031203 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf14de9-54e4-49c1-bfe3-cf72130dde82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:05.031937 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf14de9-54e4-49c1-bfe3-cf72130dde82 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:05.032237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf14de9-54e4-49c1-bfe3-cf72130dde82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:05.032914 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf14de9-54e4-49c1-bfe3-cf72130dde82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:05.033697 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf14de9-54e4-49c1-bfe3-cf72130dde82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:05.039909 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf14de9-54e4-49c1-bfe3-cf72130dde82 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:05.062448 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1322/2595] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:05.063818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875068ac-949c-4f49-9874-3ee1662e142d admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:05.088477 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875068ac-949c-4f49-9874-3ee1662e142d admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:05.109478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253aba8-f69b-47e0-b7ea-3bb9ba4ba915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:05.110545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253aba8-f69b-47e0-b7ea-3bb9ba4ba915 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:05.111016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253aba8-f69b-47e0-b7ea-3bb9ba4ba915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:05.112499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253aba8-f69b-47e0-b7ea-3bb9ba4ba915 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:05.113469 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253aba8-f69b-47e0-b7ea-3bb9ba4ba915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:05.115466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253aba8-f69b-47e0-b7ea-3bb9ba4ba915 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:05.128406 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1274/2596] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:05.132585 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf14de9-54e4-49c1-bfe3-cf72130dde82 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:05.145114 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf14de9-54e4-49c1-bfe3-cf72130dde82 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:05.156496 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010853d-13be-4df6-bf62-ceb3f1e5cc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:05.157507 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010853d-13be-4df6-bf62-ceb3f1e5cc5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:05.158287 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010853d-13be-4df6-bf62-ceb3f1e5cc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:05.158606 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010853d-13be-4df6-bf62-ceb3f1e5cc5c admin admin] PATH_INFO: `/v3/projects/8065cc2197524aef947c304e894c1696/users/3022a04c3baa4635907cd8163b06da65/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:05.187718 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010853d-13be-4df6-bf62-ceb3f1e5cc5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8065cc2197524aef947c304e894c1696, user_id=3022a04c3baa4635907cd8163b06da65, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:05.191670 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010853d-13be-4df6-bf62-ceb3f1e5cc5c admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:05.218530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1323/2597] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:05 2022] PUT /identity/v3/projects/8065cc2197524aef947c304e894c1696/users/3022a04c3baa4635907cd8163b06da65/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:07:05.223615 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01864f2-83ba-4cad-b3cf-76ddb9b1b934 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:05.223978 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01864f2-83ba-4cad-b3cf-76ddb9b1b934 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:05.224361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01864f2-83ba-4cad-b3cf-76ddb9b1b934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:05.245529 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-d01864f2-83ba-4cad-b3cf-76ddb9b1b934 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:05.247014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d01864f2-83ba-4cad-b3cf-76ddb9b1b934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:05.337751 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1275/2598] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:05.348011 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010853d-13be-4df6-bf62-ceb3f1e5cc5c admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:05.350982 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-7010853d-13be-4df6-bf62-ceb3f1e5cc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:05.475871 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010853d-13be-4df6-bf62-ceb3f1e5cc5c admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:05.481660 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77965929-5b97-4ba0-9268-6ffe47da0d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:05.482667 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77965929-5b97-4ba0-9268-6ffe47da0d01 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:05.483214 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77965929-5b97-4ba0-9268-6ffe47da0d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:05.483651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77965929-5b97-4ba0-9268-6ffe47da0d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:05.500579 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77965929-5b97-4ba0-9268-6ffe47da0d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:05.511971 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77965929-5b97-4ba0-9268-6ffe47da0d01 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:05.540407 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1324/2599] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:07:06.583402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01864f2-83ba-4cad-b3cf-76ddb9b1b934 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:06.585110 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d01864f2-83ba-4cad-b3cf-76ddb9b1b934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:06.606105 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01864f2-83ba-4cad-b3cf-76ddb9b1b934 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:06.611866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a8c48-373c-4399-9d2d-d75c676006f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:06.612952 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a8c48-373c-4399-9d2d-d75c676006f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:06.613276 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a8c48-373c-4399-9d2d-d75c676006f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:06.613706 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a8c48-373c-4399-9d2d-d75c676006f4 admin admin] PATH_INFO: `/v3/users/6da117e545bf40d1b02793cf7ad4a939` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:06.615582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a8c48-373c-4399-9d2d-d75c676006f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da117e545bf40d1b02793cf7ad4a939)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:06.617806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a8c48-373c-4399-9d2d-d75c676006f4 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:06.717595 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d06a8c48-373c-4399-9d2d-d75c676006f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da117e545bf40d1b02793cf7ad4a939'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:06.718290 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d06a8c48-373c-4399-9d2d-d75c676006f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da117e545bf40d1b02793cf7ad4a939'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:06.736679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d0a1c-10db-4286-a0a7-e73941266f07 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:06.737223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d0a1c-10db-4286-a0a7-e73941266f07 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:06.737223 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d0a1c-10db-4286-a0a7-e73941266f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:06.752414 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d06a8c48-373c-4399-9d2d-d75c676006f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da117e545bf40d1b02793cf7ad4a939'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:06.769852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d06a8c48-373c-4399-9d2d-d75c676006f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da117e545bf40d1b02793cf7ad4a939'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:06.770632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d06a8c48-373c-4399-9d2d-d75c676006f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da117e545bf40d1b02793cf7ad4a939'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:06.780748 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-386d0a1c-10db-4286-a0a7-e73941266f07 None None] MFA Rules not processed for user `3022a04c3baa4635907cd8163b06da65`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:06.784534 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-386d0a1c-10db-4286-a0a7-e73941266f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:06.801030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1276/2600] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:07:06 2022] DELETE /identity/v3/users/6da117e545bf40d1b02793cf7ad4a939 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:06.806259 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad3206-047d-496a-93b6-4e6beac8e2d2 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:06.807302 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad3206-047d-496a-93b6-4e6beac8e2d2 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:06.807669 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad3206-047d-496a-93b6-4e6beac8e2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:06.833248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-40ad3206-047d-496a-93b6-4e6beac8e2d2 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:06.834488 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-40ad3206-047d-496a-93b6-4e6beac8e2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:06.899047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1325/2601] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:06 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:06.909270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d0a1c-10db-4286-a0a7-e73941266f07 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:06.915941 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-386d0a1c-10db-4286-a0a7-e73941266f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:06.938573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d0a1c-10db-4286-a0a7-e73941266f07 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:06.956971 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1277/2602] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:06.965998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad3206-047d-496a-93b6-4e6beac8e2d2 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:06.968198 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-40ad3206-047d-496a-93b6-4e6beac8e2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:07.029012 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23a3ff-99b6-4772-a4b1-43822583b0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:07.029990 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23a3ff-99b6-4772-a4b1-43822583b0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:07.030420 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23a3ff-99b6-4772-a4b1-43822583b0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:07.031082 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23a3ff-99b6-4772-a4b1-43822583b0f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:07.032060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23a3ff-99b6-4772-a4b1-43822583b0f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:07.034701 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23a3ff-99b6-4772-a4b1-43822583b0f2 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:07.085034 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad3206-047d-496a-93b6-4e6beac8e2d2 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:07.089416 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1326/2603] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:07:06 2022] POST /identity/v3/projects => generated 403 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:07.091098 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23a3ff-99b6-4772-a4b1-43822583b0f2 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:07.168570 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167fea4-7bec-4039-9fbd-5a15c8cafdd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:07.169217 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167fea4-7bec-4039-9fbd-5a15c8cafdd4 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:07.169497 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167fea4-7bec-4039-9fbd-5a15c8cafdd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:07.169768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167fea4-7bec-4039-9fbd-5a15c8cafdd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:07.226759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23a3ff-99b6-4772-a4b1-43822583b0f2 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:07.238267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2021b-44ca-4a39-9e7c-6ae53884903f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:07.239738 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2021b-44ca-4a39-9e7c-6ae53884903f admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:07.240017 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2021b-44ca-4a39-9e7c-6ae53884903f admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:07.240323 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2021b-44ca-4a39-9e7c-6ae53884903f admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:07.241023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2021b-44ca-4a39-9e7c-6ae53884903f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:07.242934 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2021b-44ca-4a39-9e7c-6ae53884903f admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:07.268717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167fea4-7bec-4039-9fbd-5a15c8cafdd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:07.272957 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167fea4-7bec-4039-9fbd-5a15c8cafdd4 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:07.280473 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1327/2604] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:07:07 2022] POST /identity/v3/users => generated 308 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:07.285171 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2021b-44ca-4a39-9e7c-6ae53884903f admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:07.299866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1278/2605] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:07:07.306549 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2021b-44ca-4a39-9e7c-6ae53884903f admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:07.311640 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685e352-86ce-4ab2-aeec-3a9d44903065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:07.312406 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685e352-86ce-4ab2-aeec-3a9d44903065 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:07.312687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685e352-86ce-4ab2-aeec-3a9d44903065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:07.312962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685e352-86ce-4ab2-aeec-3a9d44903065 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:07.313864 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685e352-86ce-4ab2-aeec-3a9d44903065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:07.315549 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685e352-86ce-4ab2-aeec-3a9d44903065 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:07.334194 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1328/2606] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:07.337059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167fea4-7bec-4039-9fbd-5a15c8cafdd4 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:07.349666 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167fea4-7bec-4039-9fbd-5a15c8cafdd4 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:07.363192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0ff89-f3e0-4405-ad6f-4b3524b1fb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:07.364270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0ff89-f3e0-4405-ad6f-4b3524b1fb36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:07.364662 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0ff89-f3e0-4405-ad6f-4b3524b1fb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:07.365154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0ff89-f3e0-4405-ad6f-4b3524b1fb36 admin admin] PATH_INFO: `/v3/projects/19f1e99571f84e1fa368545ded97da9d/users/af9ac4987d5a47d39417a43ca995c9ef/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:07.402238 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0ff89-f3e0-4405-ad6f-4b3524b1fb36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f1e99571f84e1fa368545ded97da9d, user_id=af9ac4987d5a47d39417a43ca995c9ef, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:07.405537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0ff89-f3e0-4405-ad6f-4b3524b1fb36 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:07.429453 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1279/2607] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:07 2022] PUT /identity/v3/projects/19f1e99571f84e1fa368545ded97da9d/users/af9ac4987d5a47d39417a43ca995c9ef/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:07.433725 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685e352-86ce-4ab2-aeec-3a9d44903065 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:07.447971 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685e352-86ce-4ab2-aeec-3a9d44903065 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:07.625298 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269717b-af51-495a-9f1b-b2cc038fbdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:07.625988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269717b-af51-495a-9f1b-b2cc038fbdfe admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:07.626263 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269717b-af51-495a-9f1b-b2cc038fbdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:07.626531 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269717b-af51-495a-9f1b-b2cc038fbdfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:07.628033 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269717b-af51-495a-9f1b-b2cc038fbdfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:07.629644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269717b-af51-495a-9f1b-b2cc038fbdfe admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:07.660240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1329/2608] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:07.664605 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0ff89-f3e0-4405-ad6f-4b3524b1fb36 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:07.679721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0ff89-f3e0-4405-ad6f-4b3524b1fb36 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:07.683520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269717b-af51-495a-9f1b-b2cc038fbdfe admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:07.685469 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-9269717b-af51-495a-9f1b-b2cc038fbdfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:07.700347 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fdecb-09d5-49f3-9666-79b019428187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:07.701590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fdecb-09d5-49f3-9666-79b019428187 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:07.702186 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269717b-af51-495a-9f1b-b2cc038fbdfe admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:07.708602 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bbc67-4bd5-4567-b872-c20256fab8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:07.710704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fdecb-09d5-49f3-9666-79b019428187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:07.711124 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fdecb-09d5-49f3-9666-79b019428187 admin admin] PATH_INFO: `/v3/projects/19f1e99571f84e1fa368545ded97da9d/users/af9ac4987d5a47d39417a43ca995c9ef/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:07.714158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fdecb-09d5-49f3-9666-79b019428187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f1e99571f84e1fa368545ded97da9d, user_id=af9ac4987d5a47d39417a43ca995c9ef, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:07.718432 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fdecb-09d5-49f3-9666-79b019428187 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:07.722245 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bbc67-4bd5-4567-b872-c20256fab8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:07.722597 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bbc67-4bd5-4567-b872-c20256fab8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:07.722887 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bbc67-4bd5-4567-b872-c20256fab8b4 admin admin] PATH_INFO: `/v3/projects/24e11f2d6fef4260af44af7807ac0c9d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:07.726158 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bbc67-4bd5-4567-b872-c20256fab8b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24e11f2d6fef4260af44af7807ac0c9d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:07.730101 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bbc67-4bd5-4567-b872-c20256fab8b4 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:07.758949 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1280/2609] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:07 2022] PUT /identity/v3/projects/19f1e99571f84e1fa368545ded97da9d/users/af9ac4987d5a47d39417a43ca995c9ef/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:07.809082 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b01bbc67-4bd5-4567-b872-c20256fab8b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24e11f2d6fef4260af44af7807ac0c9d', 'request_id': 'req-b01bbc67-4bd5-4567-b872-c20256fab8b4'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:07.818857 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b01bbc67-4bd5-4567-b872-c20256fab8b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24e11f2d6fef4260af44af7807ac0c9d', 'request_id': 'req-b01bbc67-4bd5-4567-b872-c20256fab8b4'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:07.828516 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b01bbc67-4bd5-4567-b872-c20256fab8b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24e11f2d6fef4260af44af7807ac0c9d', 'request_id': 'req-b01bbc67-4bd5-4567-b872-c20256fab8b4'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:07.846591 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b01bbc67-4bd5-4567-b872-c20256fab8b4 admin admin] The token cache is being invalidate because project 24e11f2d6fef4260af44af7807ac0c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:07:07.846904 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b01bbc67-4bd5-4567-b872-c20256fab8b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:07.858801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-b01bbc67-4bd5-4567-b872-c20256fab8b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:07.858801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1330/2610] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:07:07 2022] DELETE /identity/v3/projects/24e11f2d6fef4260af44af7807ac0c9d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:07.865243 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc8e15-5805-4e97-b72f-e07e5cb07598 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:07.865728 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc8e15-5805-4e97-b72f-e07e5cb07598 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:07.866179 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc8e15-5805-4e97-b72f-e07e5cb07598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:07.906039 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-d6dc8e15-5805-4e97-b72f-e07e5cb07598 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:07.906563 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d6dc8e15-5805-4e97-b72f-e07e5cb07598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:07.989034 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1281/2611] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:07.997552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c2af0-0bf2-4254-a7af-3110fbec869a None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:07.997843 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c2af0-0bf2-4254-a7af-3110fbec869a None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:07.998119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c2af0-0bf2-4254-a7af-3110fbec869a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:08.020053 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-274c2af0-0bf2-4254-a7af-3110fbec869a None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:08.022103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-274c2af0-0bf2-4254-a7af-3110fbec869a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:08.033828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1331/2612] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:08.038423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc8e15-5805-4e97-b72f-e07e5cb07598 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:08.050403 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc8e15-5805-4e97-b72f-e07e5cb07598 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:08.060864 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c6ef6-834e-494f-9cf2-2380448ca9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:08.061621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c6ef6-834e-494f-9cf2-2380448ca9dd admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:08.061973 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c6ef6-834e-494f-9cf2-2380448ca9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:08.062313 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c6ef6-834e-494f-9cf2-2380448ca9dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:08.063264 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c6ef6-834e-494f-9cf2-2380448ca9dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:07:08.063660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c6ef6-834e-494f-9cf2-2380448ca9dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:08.066475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c6ef6-834e-494f-9cf2-2380448ca9dd admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:08.083040 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1282/2613] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:07:08.084494 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c2af0-0bf2-4254-a7af-3110fbec869a None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:08.093709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c2af0-0bf2-4254-a7af-3110fbec869a None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:08.098638 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957d81e-1e24-44d1-ad59-a7bb5f5f9823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:08.099282 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957d81e-1e24-44d1-ad59-a7bb5f5f9823 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:08.099563 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957d81e-1e24-44d1-ad59-a7bb5f5f9823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:08.099837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957d81e-1e24-44d1-ad59-a7bb5f5f9823 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:08.100565 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957d81e-1e24-44d1-ad59-a7bb5f5f9823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:08.102441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957d81e-1e24-44d1-ad59-a7bb5f5f9823 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:08.137295 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1332/2614] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:07:08 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:07:08.147904 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c6ef6-834e-494f-9cf2-2380448ca9dd admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:08.157986 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c6ef6-834e-494f-9cf2-2380448ca9dd admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:08.214872 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dd8ca-3a9a-484a-8024-aacbcf9e628b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:08.215537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dd8ca-3a9a-484a-8024-aacbcf9e628b admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:08.216194 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dd8ca-3a9a-484a-8024-aacbcf9e628b admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:08.216194 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dd8ca-3a9a-484a-8024-aacbcf9e628b admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:08.216782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dd8ca-3a9a-484a-8024-aacbcf9e628b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:08.218706 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dd8ca-3a9a-484a-8024-aacbcf9e628b admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:08.243753 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1283/2615] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:07:08 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:07:08.248243 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957d81e-1e24-44d1-ad59-a7bb5f5f9823 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:08.259513 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957d81e-1e24-44d1-ad59-a7bb5f5f9823 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:08.264738 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d0160-49b8-4eea-8298-c54e30f0d9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:08.265475 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d0160-49b8-4eea-8298-c54e30f0d9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:08.265854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d0160-49b8-4eea-8298-c54e30f0d9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:08.266039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d0160-49b8-4eea-8298-c54e30f0d9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:08.267814 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d0160-49b8-4eea-8298-c54e30f0d9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:08.269653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d0160-49b8-4eea-8298-c54e30f0d9f0 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:08.280794 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1333/2616] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:07:08.284889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dd8ca-3a9a-484a-8024-aacbcf9e628b admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:08.295245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dd8ca-3a9a-484a-8024-aacbcf9e628b admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:08.295428 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d0160-49b8-4eea-8298-c54e30f0d9f0 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:08.298100 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-9f0d0160-49b8-4eea-8298-c54e30f0d9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:08.304761 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb52df6-0b5b-4014-90bf-b0fd2ce53aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:08.305901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb52df6-0b5b-4014-90bf-b0fd2ce53aad admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:08.306789 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb52df6-0b5b-4014-90bf-b0fd2ce53aad admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:08.307290 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb52df6-0b5b-4014-90bf-b0fd2ce53aad admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:08.308638 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb52df6-0b5b-4014-90bf-b0fd2ce53aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:08.310582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb52df6-0b5b-4014-90bf-b0fd2ce53aad admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:08.325236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1284/2617] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:08.326482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb52df6-0b5b-4014-90bf-b0fd2ce53aad admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:08.339196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb52df6-0b5b-4014-90bf-b0fd2ce53aad admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:08.343492 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935cbf5-08f9-4fea-a9b5-fe1d121b5828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:08.344505 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935cbf5-08f9-4fea-a9b5-fe1d121b5828 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:08.344878 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935cbf5-08f9-4fea-a9b5-fe1d121b5828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:08.345517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935cbf5-08f9-4fea-a9b5-fe1d121b5828 admin admin] PATH_INFO: `/v3/projects/b07e47f2bc3f455683e16c9f4ab1bf22/users/8c91278195ea4a91b999f2a9fa628b88/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:08.362525 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d0160-49b8-4eea-8298-c54e30f0d9f0 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:08.362843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935cbf5-08f9-4fea-a9b5-fe1d121b5828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07e47f2bc3f455683e16c9f4ab1bf22, user_id=8c91278195ea4a91b999f2a9fa628b88, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:08.365673 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935cbf5-08f9-4fea-a9b5-fe1d121b5828 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:08.366421 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc969ea-7ab2-4410-be5f-29785dcc00d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:08.367149 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc969ea-7ab2-4410-be5f-29785dcc00d5 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:08.367501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc969ea-7ab2-4410-be5f-29785dcc00d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:08.367849 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc969ea-7ab2-4410-be5f-29785dcc00d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:08.369779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-5fc969ea-7ab2-4410-be5f-29785dcc00d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:08.386388 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1285/2618] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:08 2022] PUT /identity/v3/projects/b07e47f2bc3f455683e16c9f4ab1bf22/users/8c91278195ea4a91b999f2a9fa628b88/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:08.396936 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ff6ad-ebbd-431f-a997-4cc77d6b62d0 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:08.397530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ff6ad-ebbd-431f-a997-4cc77d6b62d0 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:08.397714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ff6ad-ebbd-431f-a997-4cc77d6b62d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:08.428726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-091ff6ad-ebbd-431f-a997-4cc77d6b62d0 None None] MFA Rules not processed for user `8c91278195ea4a91b999f2a9fa628b88`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:08.430009 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-091ff6ad-ebbd-431f-a997-4cc77d6b62d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:08.451644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc969ea-7ab2-4410-be5f-29785dcc00d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:08.453302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc969ea-7ab2-4410-be5f-29785dcc00d5 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:08.463353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1334/2619] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:07:08.498896 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395a71b-d740-4fe5-bea3-409e9757886b None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:08.499246 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395a71b-d740-4fe5-bea3-409e9757886b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:08.499527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395a71b-d740-4fe5-bea3-409e9757886b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:08.518714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1286/2620] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:08.527428 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ff6ad-ebbd-431f-a997-4cc77d6b62d0 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:08.529062 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-091ff6ad-ebbd-431f-a997-4cc77d6b62d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:08.531229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-d395a71b-d740-4fe5-bea3-409e9757886b None None] MFA Rules not processed for user `af9ac4987d5a47d39417a43ca995c9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:08.533126 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-d395a71b-d740-4fe5-bea3-409e9757886b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:08.614050 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ff6ad-ebbd-431f-a997-4cc77d6b62d0 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:08.621156 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dff7a-abac-4c68-9c20-f0c0f9e6f32a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d674fd1d6ab43ab982b66bb2349b625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:08.622619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dff7a-abac-4c68-9c20-f0c0f9e6f32a service glance] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:08.623250 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dff7a-abac-4c68-9c20-f0c0f9e6f32a service glance] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:08.623820 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dff7a-abac-4c68-9c20-f0c0f9e6f32a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:08.631859 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1335/2621] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:08 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:07:08.638495 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2dff7a-abac-4c68-9c20-f0c0f9e6f32a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:08.641099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2dff7a-abac-4c68-9c20-f0c0f9e6f32a service glance] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:08.657560 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1287/2622] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:07:08.744723 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed7080-1b23-4f44-b1dd-80415f4d6ea5 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:08.745182 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed7080-1b23-4f44-b1dd-80415f4d6ea5 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:08.745674 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed7080-1b23-4f44-b1dd-80415f4d6ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:08.771265 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f8ed7080-1b23-4f44-b1dd-80415f4d6ea5 None None] MFA Rules not processed for user `df5dcdfb4eda417ebc0af2432497617d`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:08.772709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f8ed7080-1b23-4f44-b1dd-80415f4d6ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:08.846942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1336/2623] 10.222.0.49 () {58 vars in 967 bytes} [Tue May 10 14:07:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:08.860565 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dff7a-abac-4c68-9c20-f0c0f9e6f32a service glance] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:08.862086 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8a2dff7a-abac-4c68-9c20-f0c0f9e6f32a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:08.952577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dff7a-abac-4c68-9c20-f0c0f9e6f32a service glance] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:08.966403 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33012f7c-a91e-4afb-9aaf-644a0277a40b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd102155cd1bd4368ad272668da1651f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:08.967324 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33012f7c-a91e-4afb-9aaf-644a0277a40b service swift] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:08.967821 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33012f7c-a91e-4afb-9aaf-644a0277a40b service swift] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:08.968191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33012f7c-a91e-4afb-9aaf-644a0277a40b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:08.978133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33012f7c-a91e-4afb-9aaf-644a0277a40b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:08.979806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33012f7c-a91e-4afb-9aaf-644a0277a40b service swift] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:09.013202 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1288/2624] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 14:07:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 14:07:09.864533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed7080-1b23-4f44-b1dd-80415f4d6ea5 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:09.866108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f8ed7080-1b23-4f44-b1dd-80415f4d6ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:09.930022 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed7080-1b23-4f44-b1dd-80415f4d6ea5 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:09.934510 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003ce24-9f29-4afd-8ba1-e42b2159268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:09.935368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003ce24-9f29-4afd-8ba1-e42b2159268d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:09.935650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003ce24-9f29-4afd-8ba1-e42b2159268d admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:09.935923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003ce24-9f29-4afd-8ba1-e42b2159268d admin admin] PATH_INFO: `/v3/users/3022a04c3baa4635907cd8163b06da65` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:09.937128 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003ce24-9f29-4afd-8ba1-e42b2159268d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3022a04c3baa4635907cd8163b06da65)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:09.939006 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003ce24-9f29-4afd-8ba1-e42b2159268d admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:09.982632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-3003ce24-9f29-4afd-8ba1-e42b2159268d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3022a04c3baa4635907cd8163b06da65'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:09.994530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-3003ce24-9f29-4afd-8ba1-e42b2159268d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3022a04c3baa4635907cd8163b06da65'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.001016 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-3003ce24-9f29-4afd-8ba1-e42b2159268d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3022a04c3baa4635907cd8163b06da65'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.001658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-3003ce24-9f29-4afd-8ba1-e42b2159268d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3022a04c3baa4635907cd8163b06da65'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.008095 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-3003ce24-9f29-4afd-8ba1-e42b2159268d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3022a04c3baa4635907cd8163b06da65'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.013830 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1337/2625] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:07:09 2022] DELETE /identity/v3/users/3022a04c3baa4635907cd8163b06da65 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:10.179682 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33012f7c-a91e-4afb-9aaf-644a0277a40b service swift] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:10.191000 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33012f7c-a91e-4afb-9aaf-644a0277a40b service swift] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:10.247124 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6efd2-f7bc-4a63-9c4e-42a197baf288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:10.248007 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6efd2-f7bc-4a63-9c4e-42a197baf288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:10.248338 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6efd2-f7bc-4a63-9c4e-42a197baf288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:10.248616 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6efd2-f7bc-4a63-9c4e-42a197baf288 admin admin] PATH_INFO: `/v3/projects/8065cc2197524aef947c304e894c1696` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:10.250587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6efd2-f7bc-4a63-9c4e-42a197baf288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8065cc2197524aef947c304e894c1696)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:10.252553 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6efd2-f7bc-4a63-9c4e-42a197baf288 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:10.299833 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-24c6efd2-f7bc-4a63-9c4e-42a197baf288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8065cc2197524aef947c304e894c1696', 'request_id': 'req-24c6efd2-f7bc-4a63-9c4e-42a197baf288'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.305063 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-24c6efd2-f7bc-4a63-9c4e-42a197baf288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8065cc2197524aef947c304e894c1696', 'request_id': 'req-24c6efd2-f7bc-4a63-9c4e-42a197baf288'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.311074 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-24c6efd2-f7bc-4a63-9c4e-42a197baf288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8065cc2197524aef947c304e894c1696', 'request_id': 'req-24c6efd2-f7bc-4a63-9c4e-42a197baf288'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.322544 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-24c6efd2-f7bc-4a63-9c4e-42a197baf288 admin admin] The token cache is being invalidate because project 8065cc2197524aef947c304e894c1696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:07:10.322827 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-24c6efd2-f7bc-4a63-9c4e-42a197baf288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.323443 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-24c6efd2-f7bc-4a63-9c4e-42a197baf288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.325022 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1289/2626] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:07:10 2022] DELETE /identity/v3/projects/8065cc2197524aef947c304e894c1696 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:10.328925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003ce24-9f29-4afd-8ba1-e42b2159268d admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:10.330825 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-3003ce24-9f29-4afd-8ba1-e42b2159268d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:10.343428 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003ce24-9f29-4afd-8ba1-e42b2159268d admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:10.398596 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb244bfc-82d4-4c56-adb2-7e03e4bf6418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:10.399465 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb244bfc-82d4-4c56-adb2-7e03e4bf6418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:10.399763 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb244bfc-82d4-4c56-adb2-7e03e4bf6418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:10.400035 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb244bfc-82d4-4c56-adb2-7e03e4bf6418 admin admin] PATH_INFO: `/v3/users/af9ac4987d5a47d39417a43ca995c9ef` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:10.401236 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb244bfc-82d4-4c56-adb2-7e03e4bf6418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9ac4987d5a47d39417a43ca995c9ef)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:10.403126 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb244bfc-82d4-4c56-adb2-7e03e4bf6418 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:10.445716 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bb244bfc-82d4-4c56-adb2-7e03e4bf6418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9ac4987d5a47d39417a43ca995c9ef'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.457480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bb244bfc-82d4-4c56-adb2-7e03e4bf6418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9ac4987d5a47d39417a43ca995c9ef'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.463995 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bb244bfc-82d4-4c56-adb2-7e03e4bf6418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9ac4987d5a47d39417a43ca995c9ef'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.464683 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bb244bfc-82d4-4c56-adb2-7e03e4bf6418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9ac4987d5a47d39417a43ca995c9ef'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.472320 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bb244bfc-82d4-4c56-adb2-7e03e4bf6418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9ac4987d5a47d39417a43ca995c9ef'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.478148 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1338/2627] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:07:10 2022] DELETE /identity/v3/users/af9ac4987d5a47d39417a43ca995c9ef => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:10.648065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6efd2-f7bc-4a63-9c4e-42a197baf288 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:10.649565 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-24c6efd2-f7bc-4a63-9c4e-42a197baf288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:10.664012 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6efd2-f7bc-4a63-9c4e-42a197baf288 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:10.719684 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b47c4d-c39a-408e-a358-ea98f49dbf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:10.720567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b47c4d-c39a-408e-a358-ea98f49dbf38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:10.720875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b47c4d-c39a-408e-a358-ea98f49dbf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:10.721151 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b47c4d-c39a-408e-a358-ea98f49dbf38 admin admin] PATH_INFO: `/v3/projects/19f1e99571f84e1fa368545ded97da9d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:10.722324 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b47c4d-c39a-408e-a358-ea98f49dbf38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f1e99571f84e1fa368545ded97da9d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:10.724242 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b47c4d-c39a-408e-a358-ea98f49dbf38 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:10.768257 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-68b47c4d-c39a-408e-a358-ea98f49dbf38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f1e99571f84e1fa368545ded97da9d', 'request_id': 'req-68b47c4d-c39a-408e-a358-ea98f49dbf38'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.773882 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-68b47c4d-c39a-408e-a358-ea98f49dbf38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f1e99571f84e1fa368545ded97da9d', 'request_id': 'req-68b47c4d-c39a-408e-a358-ea98f49dbf38'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.779711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-68b47c4d-c39a-408e-a358-ea98f49dbf38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f1e99571f84e1fa368545ded97da9d', 'request_id': 'req-68b47c4d-c39a-408e-a358-ea98f49dbf38'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.791626 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-68b47c4d-c39a-408e-a358-ea98f49dbf38 admin admin] The token cache is being invalidate because project 19f1e99571f84e1fa368545ded97da9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:07:10.791941 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-68b47c4d-c39a-408e-a358-ea98f49dbf38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.792577 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-68b47c4d-c39a-408e-a358-ea98f49dbf38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:10.794171 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1290/2628] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:07:10 2022] DELETE /identity/v3/projects/19f1e99571f84e1fa368545ded97da9d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:10.799206 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a21dc-4c45-49ee-a872-13c82a66152d None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:10.799525 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a21dc-4c45-49ee-a872-13c82a66152d None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:10.799807 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a21dc-4c45-49ee-a872-13c82a66152d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:10.818768 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-782a21dc-4c45-49ee-a872-13c82a66152d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:10.819981 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-782a21dc-4c45-49ee-a872-13c82a66152d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:10.880276 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1339/2629] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:10.887841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a4bc8-4a0b-4b36-a64b-9468f1246421 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:10.888125 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a4bc8-4a0b-4b36-a64b-9468f1246421 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:10.888431 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a4bc8-4a0b-4b36-a64b-9468f1246421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:10.907658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-967a4bc8-4a0b-4b36-a64b-9468f1246421 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:10.908896 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-967a4bc8-4a0b-4b36-a64b-9468f1246421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:10.916768 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1291/2630] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:10.920870 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a21dc-4c45-49ee-a872-13c82a66152d None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:10.930331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a21dc-4c45-49ee-a872-13c82a66152d None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:10.934852 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d35171-da50-4978-ab8d-b29589b6829e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:10.935496 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d35171-da50-4978-ab8d-b29589b6829e admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:10.935775 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d35171-da50-4978-ab8d-b29589b6829e admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:10.936048 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d35171-da50-4978-ab8d-b29589b6829e admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:10.936783 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d35171-da50-4978-ab8d-b29589b6829e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:07:10.937113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d35171-da50-4978-ab8d-b29589b6829e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:10.938672 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d35171-da50-4978-ab8d-b29589b6829e admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:10.950216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1340/2631] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:07:10.954324 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a4bc8-4a0b-4b36-a64b-9468f1246421 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:10.963864 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a4bc8-4a0b-4b36-a64b-9468f1246421 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:10.968788 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d07fd-5d09-4a03-a6e5-56b6a6a84632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:10.969431 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d07fd-5d09-4a03-a6e5-56b6a6a84632 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:10.969713 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d07fd-5d09-4a03-a6e5-56b6a6a84632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:10.969987 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d07fd-5d09-4a03-a6e5-56b6a6a84632 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:10.970703 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d07fd-5d09-4a03-a6e5-56b6a6a84632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:10.972687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d07fd-5d09-4a03-a6e5-56b6a6a84632 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:10.997373 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1292/2632] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:07:10 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:11.001360 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d35171-da50-4978-ab8d-b29589b6829e admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:11.011508 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d35171-da50-4978-ab8d-b29589b6829e admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:11.066290 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6b684-aea1-4afc-abf8-6e7bb7662177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:11.066953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6b684-aea1-4afc-abf8-6e7bb7662177 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:11.067229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6b684-aea1-4afc-abf8-6e7bb7662177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:11.067501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6b684-aea1-4afc-abf8-6e7bb7662177 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:11.068251 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6b684-aea1-4afc-abf8-6e7bb7662177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:11.070083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6b684-aea1-4afc-abf8-6e7bb7662177 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:11.088935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1341/2633] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:07:11 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:11.093026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d07fd-5d09-4a03-a6e5-56b6a6a84632 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:11.103299 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d07fd-5d09-4a03-a6e5-56b6a6a84632 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:11.108055 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc69b4a-066b-4e18-a3c9-ee863f0c9b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:11.108759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc69b4a-066b-4e18-a3c9-ee863f0c9b24 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:11.109041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc69b4a-066b-4e18-a3c9-ee863f0c9b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:11.109315 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc69b4a-066b-4e18-a3c9-ee863f0c9b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:11.110031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc69b4a-066b-4e18-a3c9-ee863f0c9b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:11.112347 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc69b4a-066b-4e18-a3c9-ee863f0c9b24 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:11.123775 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1293/2634] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:11.128063 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6b684-aea1-4afc-abf8-6e7bb7662177 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:11.137758 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6b684-aea1-4afc-abf8-6e7bb7662177 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:11.142833 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582669ac-3ce0-4ca6-86dd-0f9548ed1d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:11.143500 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582669ac-3ce0-4ca6-86dd-0f9548ed1d9f admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:11.143765 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582669ac-3ce0-4ca6-86dd-0f9548ed1d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:11.144043 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582669ac-3ce0-4ca6-86dd-0f9548ed1d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:11.144803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582669ac-3ce0-4ca6-86dd-0f9548ed1d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:11.146393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582669ac-3ce0-4ca6-86dd-0f9548ed1d9f admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:11.156875 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1342/2635] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:11.160719 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc69b4a-066b-4e18-a3c9-ee863f0c9b24 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:11.170356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc69b4a-066b-4e18-a3c9-ee863f0c9b24 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:11.175542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0cffa-fab7-4586-b7a0-97720f7246d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:11.176446 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0cffa-fab7-4586-b7a0-97720f7246d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:11.176723 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0cffa-fab7-4586-b7a0-97720f7246d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:11.176994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0cffa-fab7-4586-b7a0-97720f7246d1 admin admin] PATH_INFO: `/v3/projects/0812b3e40c9846bda0b5132e7bec476c/users/44c2b9c880b04314ae2db0e5b6a94c3c/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:11.191371 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0cffa-fab7-4586-b7a0-97720f7246d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0812b3e40c9846bda0b5132e7bec476c, user_id=44c2b9c880b04314ae2db0e5b6a94c3c, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:11.194026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0cffa-fab7-4586-b7a0-97720f7246d1 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:11.206553 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1294/2636] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:11 2022] PUT /identity/v3/projects/0812b3e40c9846bda0b5132e7bec476c/users/44c2b9c880b04314ae2db0e5b6a94c3c/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:11.217602 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac4b44-440b-4989-b657-1ef7307cdcba None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:11.217897 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac4b44-440b-4989-b657-1ef7307cdcba None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:11.218178 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac4b44-440b-4989-b657-1ef7307cdcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:11.244259 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-dcac4b44-440b-4989-b657-1ef7307cdcba None None] MFA Rules not processed for user `44c2b9c880b04314ae2db0e5b6a94c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:11.245474 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-dcac4b44-440b-4989-b657-1ef7307cdcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:11.323451 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1343/2637] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:11.327998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0cffa-fab7-4586-b7a0-97720f7246d1 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:11.387823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0cffa-fab7-4586-b7a0-97720f7246d1 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:11.392935 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f31824-42df-4c00-8e41-8487e1019393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:11.394422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f31824-42df-4c00-8e41-8487e1019393 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:11.394422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f31824-42df-4c00-8e41-8487e1019393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:11.394422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f31824-42df-4c00-8e41-8487e1019393 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:11.394802 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f31824-42df-4c00-8e41-8487e1019393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:11.396732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f31824-42df-4c00-8e41-8487e1019393 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:11.420974 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1295/2638] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:07:11 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:11.425548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac4b44-440b-4989-b657-1ef7307cdcba None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:11.435851 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac4b44-440b-4989-b657-1ef7307cdcba None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:11.489896 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb93c6-9501-4640-ac6c-c54bca4c3491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:11.490574 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb93c6-9501-4640-ac6c-c54bca4c3491 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:11.490851 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb93c6-9501-4640-ac6c-c54bca4c3491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:11.491176 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb93c6-9501-4640-ac6c-c54bca4c3491 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:11.491861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb93c6-9501-4640-ac6c-c54bca4c3491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:11.493904 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb93c6-9501-4640-ac6c-c54bca4c3491 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:11.514729 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1344/2639] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:07:11 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:07:11.515924 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f31824-42df-4c00-8e41-8487e1019393 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:11.526031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f31824-42df-4c00-8e41-8487e1019393 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:11.530795 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89899b4d-a1ac-47c8-b878-15e2473212d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:11.531462 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89899b4d-a1ac-47c8-b878-15e2473212d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:11.531746 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89899b4d-a1ac-47c8-b878-15e2473212d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:11.532021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89899b4d-a1ac-47c8-b878-15e2473212d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:11.532922 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89899b4d-a1ac-47c8-b878-15e2473212d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:11.535078 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89899b4d-a1ac-47c8-b878-15e2473212d7 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:11.548520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1296/2640] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:11.550200 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb93c6-9501-4640-ac6c-c54bca4c3491 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:11.559983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb93c6-9501-4640-ac6c-c54bca4c3491 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:11.564880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39377347-2f5e-4c71-a1e9-53cbd566dddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:11.565761 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39377347-2f5e-4c71-a1e9-53cbd566dddf admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:11.566047 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39377347-2f5e-4c71-a1e9-53cbd566dddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:11.566326 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39377347-2f5e-4c71-a1e9-53cbd566dddf admin admin] PATH_INFO: `/v3/projects/9430803092ff429a98e422b3db63ca27/users/6d0e1dd12519480283e2692fd915edfd/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:11.582658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39377347-2f5e-4c71-a1e9-53cbd566dddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9430803092ff429a98e422b3db63ca27, user_id=6d0e1dd12519480283e2692fd915edfd, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:11.585309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39377347-2f5e-4c71-a1e9-53cbd566dddf admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:11.598256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1345/2641] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:11 2022] PUT /identity/v3/projects/9430803092ff429a98e422b3db63ca27/users/6d0e1dd12519480283e2692fd915edfd/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:11.602421 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89899b4d-a1ac-47c8-b878-15e2473212d7 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:11.613521 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89899b4d-a1ac-47c8-b878-15e2473212d7 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:11.676426 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf436d2-c9e7-4cb1-9647-033f1d9132f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:11.677621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf436d2-c9e7-4cb1-9647-033f1d9132f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:11.677900 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf436d2-c9e7-4cb1-9647-033f1d9132f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:11.678172 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf436d2-c9e7-4cb1-9647-033f1d9132f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:11.678883 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf436d2-c9e7-4cb1-9647-033f1d9132f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:11.680485 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf436d2-c9e7-4cb1-9647-033f1d9132f9 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:11.690016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1297/2642] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:11.694198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39377347-2f5e-4c71-a1e9-53cbd566dddf admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:11.704464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39377347-2f5e-4c71-a1e9-53cbd566dddf admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:11.709187 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf6e61-8dd5-4318-aa65-ddbca5df64ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:11.710054 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf6e61-8dd5-4318-aa65-ddbca5df64ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:11.710435 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf6e61-8dd5-4318-aa65-ddbca5df64ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:11.710717 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf6e61-8dd5-4318-aa65-ddbca5df64ac admin admin] PATH_INFO: `/v3/projects/9430803092ff429a98e422b3db63ca27/users/6d0e1dd12519480283e2692fd915edfd/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:11.712744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf6e61-8dd5-4318-aa65-ddbca5df64ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9430803092ff429a98e422b3db63ca27, user_id=6d0e1dd12519480283e2692fd915edfd, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:11.715342 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf6e61-8dd5-4318-aa65-ddbca5df64ac admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:11.725951 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1346/2643] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:11 2022] PUT /identity/v3/projects/9430803092ff429a98e422b3db63ca27/users/6d0e1dd12519480283e2692fd915edfd/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:11.736361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808fb4c-0c10-4536-96b2-499a35fe99b3 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:11.737127 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808fb4c-0c10-4536-96b2-499a35fe99b3 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:11.737358 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808fb4c-0c10-4536-96b2-499a35fe99b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:11.766319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-0808fb4c-0c10-4536-96b2-499a35fe99b3 None None] MFA Rules not processed for user `6d0e1dd12519480283e2692fd915edfd`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:11.768297 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0808fb4c-0c10-4536-96b2-499a35fe99b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:11.834747 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1298/2644] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:11.846356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf6e61-8dd5-4318-aa65-ddbca5df64ac admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:11.848291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-afcf6e61-8dd5-4318-aa65-ddbca5df64ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:11.906157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf6e61-8dd5-4318-aa65-ddbca5df64ac admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:11.911181 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a56de-9d81-41f8-b8dc-8fd19f1bdb66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:11.911831 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a56de-9d81-41f8-b8dc-8fd19f1bdb66 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:11.912112 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a56de-9d81-41f8-b8dc-8fd19f1bdb66 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:11.912421 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a56de-9d81-41f8-b8dc-8fd19f1bdb66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:11.923850 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a56de-9d81-41f8-b8dc-8fd19f1bdb66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:11.925487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a56de-9d81-41f8-b8dc-8fd19f1bdb66 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:11.935941 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1347/2645] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:12.415231 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808fb4c-0c10-4536-96b2-499a35fe99b3 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:12.417095 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0808fb4c-0c10-4536-96b2-499a35fe99b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:12.479315 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808fb4c-0c10-4536-96b2-499a35fe99b3 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:12.484476 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f69fd-16bd-4b77-a226-48e3060ac18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:12.485166 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f69fd-16bd-4b77-a226-48e3060ac18c service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:12.485851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f69fd-16bd-4b77-a226-48e3060ac18c service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:12.485851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f69fd-16bd-4b77-a226-48e3060ac18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:12.492702 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-745f69fd-16bd-4b77-a226-48e3060ac18c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:12.555797 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f69fd-16bd-4b77-a226-48e3060ac18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:12.557287 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f69fd-16bd-4b77-a226-48e3060ac18c service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:12.572959 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1299/2646] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:13.517292 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a56de-9d81-41f8-b8dc-8fd19f1bdb66 service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:13.528371 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a56de-9d81-41f8-b8dc-8fd19f1bdb66 service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:13.535479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9d681-a5a9-4146-a9fd-b1264798b898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:13.536384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9d681-a5a9-4146-a9fd-b1264798b898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:13.536661 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9d681-a5a9-4146-a9fd-b1264798b898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:13.536931 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9d681-a5a9-4146-a9fd-b1264798b898 admin admin] PATH_INFO: `/v3/users/44c2b9c880b04314ae2db0e5b6a94c3c` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:13.538101 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9d681-a5a9-4146-a9fd-b1264798b898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c2b9c880b04314ae2db0e5b6a94c3c)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:13.539974 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9d681-a5a9-4146-a9fd-b1264798b898 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:13.586673 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-24b9d681-a5a9-4146-a9fd-b1264798b898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c2b9c880b04314ae2db0e5b6a94c3c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:13.598510 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-24b9d681-a5a9-4146-a9fd-b1264798b898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c2b9c880b04314ae2db0e5b6a94c3c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:13.605237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-24b9d681-a5a9-4146-a9fd-b1264798b898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c2b9c880b04314ae2db0e5b6a94c3c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:13.605976 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-24b9d681-a5a9-4146-a9fd-b1264798b898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c2b9c880b04314ae2db0e5b6a94c3c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:13.612930 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-24b9d681-a5a9-4146-a9fd-b1264798b898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c2b9c880b04314ae2db0e5b6a94c3c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:13.618983 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1348/2647] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:07:13 2022] DELETE /identity/v3/users/44c2b9c880b04314ae2db0e5b6a94c3c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:13.623609 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb1917-a93c-4ffe-9576-8b697ad4607c None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:13.624498 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb1917-a93c-4ffe-9576-8b697ad4607c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:13.624777 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb1917-a93c-4ffe-9576-8b697ad4607c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:13.643933 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-a3bb1917-a93c-4ffe-9576-8b697ad4607c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:13.645613 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a3bb1917-a93c-4ffe-9576-8b697ad4607c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:13.664463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9d681-a5a9-4146-a9fd-b1264798b898 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:13.665890 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-24b9d681-a5a9-4146-a9fd-b1264798b898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:13.712475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1300/2648] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:13.722595 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb1917-a93c-4ffe-9576-8b697ad4607c None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:13.724119 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a3bb1917-a93c-4ffe-9576-8b697ad4607c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:13.753218 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9d681-a5a9-4146-a9fd-b1264798b898 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:13.758437 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86b428-3d16-4a54-9bdf-65e6cc37cc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:13.759316 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86b428-3d16-4a54-9bdf-65e6cc37cc9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:13.759787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86b428-3d16-4a54-9bdf-65e6cc37cc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:13.760066 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86b428-3d16-4a54-9bdf-65e6cc37cc9f admin admin] PATH_INFO: `/v3/users/2ff9c506880e45bd87a16af67e107eec` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:13.761305 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86b428-3d16-4a54-9bdf-65e6cc37cc9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ff9c506880e45bd87a16af67e107eec)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:13.763516 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86b428-3d16-4a54-9bdf-65e6cc37cc9f admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:13.787524 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb1917-a93c-4ffe-9576-8b697ad4607c None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:13.791370 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78269775-a841-4dbf-91ec-1b31fdc8ea6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:13.792132 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78269775-a841-4dbf-91ec-1b31fdc8ea6d service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:13.792441 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78269775-a841-4dbf-91ec-1b31fdc8ea6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:13.792712 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78269775-a841-4dbf-91ec-1b31fdc8ea6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:13.802294 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78269775-a841-4dbf-91ec-1b31fdc8ea6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:13.803823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78269775-a841-4dbf-91ec-1b31fdc8ea6d service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:13.813344 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1301/2649] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:13.817857 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9f86b428-3d16-4a54-9bdf-65e6cc37cc9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ff9c506880e45bd87a16af67e107eec'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:13.833547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9f86b428-3d16-4a54-9bdf-65e6cc37cc9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ff9c506880e45bd87a16af67e107eec'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:13.841966 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9f86b428-3d16-4a54-9bdf-65e6cc37cc9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ff9c506880e45bd87a16af67e107eec'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:13.843355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9f86b428-3d16-4a54-9bdf-65e6cc37cc9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ff9c506880e45bd87a16af67e107eec'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:13.854836 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9f86b428-3d16-4a54-9bdf-65e6cc37cc9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ff9c506880e45bd87a16af67e107eec'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:13.861493 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1349/2650] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:07:13 2022] DELETE /identity/v3/users/2ff9c506880e45bd87a16af67e107eec => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:14.140866 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78269775-a841-4dbf-91ec-1b31fdc8ea6d service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:14.144097 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-78269775-a841-4dbf-91ec-1b31fdc8ea6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:14.176347 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78269775-a841-4dbf-91ec-1b31fdc8ea6d service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:14.199316 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86b428-3d16-4a54-9bdf-65e6cc37cc9f admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:14.201644 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-9f86b428-3d16-4a54-9bdf-65e6cc37cc9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:14.261115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b81e0-fee5-43a0-907d-da7352ed8b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:14.263520 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b81e0-fee5-43a0-907d-da7352ed8b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:14.263810 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b81e0-fee5-43a0-907d-da7352ed8b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:14.264401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b81e0-fee5-43a0-907d-da7352ed8b17 admin admin] PATH_INFO: `/v3/projects/0812b3e40c9846bda0b5132e7bec476c` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:14.268687 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b81e0-fee5-43a0-907d-da7352ed8b17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0812b3e40c9846bda0b5132e7bec476c)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:14.272483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b81e0-fee5-43a0-907d-da7352ed8b17 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:14.310342 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86b428-3d16-4a54-9bdf-65e6cc37cc9f admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:14.315964 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d09e4-8c25-4803-b524-a556635b9e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:14.316860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d09e4-8c25-4803-b524-a556635b9e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:14.317335 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d09e4-8c25-4803-b524-a556635b9e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:14.317809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d09e4-8c25-4803-b524-a556635b9e8a admin admin] PATH_INFO: `/v3/projects/7a263551cedd420db2fb5b24a60835b8` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:14.318997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d09e4-8c25-4803-b524-a556635b9e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a263551cedd420db2fb5b24a60835b8)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:14.320947 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d09e4-8c25-4803-b524-a556635b9e8a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:14.327497 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-051b81e0-fee5-43a0-907d-da7352ed8b17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0812b3e40c9846bda0b5132e7bec476c', 'request_id': 'req-051b81e0-fee5-43a0-907d-da7352ed8b17'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.334414 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-051b81e0-fee5-43a0-907d-da7352ed8b17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0812b3e40c9846bda0b5132e7bec476c', 'request_id': 'req-051b81e0-fee5-43a0-907d-da7352ed8b17'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.343000 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-051b81e0-fee5-43a0-907d-da7352ed8b17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0812b3e40c9846bda0b5132e7bec476c', 'request_id': 'req-051b81e0-fee5-43a0-907d-da7352ed8b17'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.362310 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-051b81e0-fee5-43a0-907d-da7352ed8b17 admin admin] The token cache is being invalidate because project 0812b3e40c9846bda0b5132e7bec476c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:07:14.362901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-051b81e0-fee5-43a0-907d-da7352ed8b17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.364570 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-051b81e0-fee5-43a0-907d-da7352ed8b17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.368403 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1302/2651] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:07:14 2022] DELETE /identity/v3/projects/0812b3e40c9846bda0b5132e7bec476c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:14.372767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b81e0-fee5-43a0-907d-da7352ed8b17 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:14.375024 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-051b81e0-fee5-43a0-907d-da7352ed8b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:14.426234 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a19d09e4-8c25-4803-b524-a556635b9e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a263551cedd420db2fb5b24a60835b8', 'request_id': 'req-a19d09e4-8c25-4803-b524-a556635b9e8a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.435661 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a19d09e4-8c25-4803-b524-a556635b9e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a263551cedd420db2fb5b24a60835b8', 'request_id': 'req-a19d09e4-8c25-4803-b524-a556635b9e8a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.444365 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a19d09e4-8c25-4803-b524-a556635b9e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a263551cedd420db2fb5b24a60835b8', 'request_id': 'req-a19d09e4-8c25-4803-b524-a556635b9e8a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.468896 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a19d09e4-8c25-4803-b524-a556635b9e8a admin admin] The token cache is being invalidate because project 7a263551cedd420db2fb5b24a60835b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:07:14.469192 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a19d09e4-8c25-4803-b524-a556635b9e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.469866 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-a19d09e4-8c25-4803-b524-a556635b9e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.471657 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1350/2652] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:07:14 2022] DELETE /identity/v3/projects/7a263551cedd420db2fb5b24a60835b8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:14.483929 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b81e0-fee5-43a0-907d-da7352ed8b17 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:14.562098 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be2290-26f9-49cb-aa75-1c09ac774594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:14.563000 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be2290-26f9-49cb-aa75-1c09ac774594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:14.563275 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be2290-26f9-49cb-aa75-1c09ac774594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:14.563557 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be2290-26f9-49cb-aa75-1c09ac774594 admin admin] PATH_INFO: `/v3/users/6d0e1dd12519480283e2692fd915edfd` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:14.564854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be2290-26f9-49cb-aa75-1c09ac774594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d0e1dd12519480283e2692fd915edfd)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:14.566844 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be2290-26f9-49cb-aa75-1c09ac774594 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:14.624886 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d0be2290-26f9-49cb-aa75-1c09ac774594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d0e1dd12519480283e2692fd915edfd'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.626482 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d0be2290-26f9-49cb-aa75-1c09ac774594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d0e1dd12519480283e2692fd915edfd'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.644117 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d0be2290-26f9-49cb-aa75-1c09ac774594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d0e1dd12519480283e2692fd915edfd'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.653340 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d0be2290-26f9-49cb-aa75-1c09ac774594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d0e1dd12519480283e2692fd915edfd'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.654300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-d0be2290-26f9-49cb-aa75-1c09ac774594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d0e1dd12519480283e2692fd915edfd'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:14.673047 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1303/2653] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:07:14 2022] DELETE /identity/v3/users/6d0e1dd12519480283e2692fd915edfd => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:15.151136 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d09e4-8c25-4803-b524-a556635b9e8a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:15.152747 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a19d09e4-8c25-4803-b524-a556635b9e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:15.171796 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d09e4-8c25-4803-b524-a556635b9e8a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:15.237877 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beef645-4ba3-48b5-ab2e-e92e77088127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:15.240579 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beef645-4ba3-48b5-ab2e-e92e77088127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:15.240868 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beef645-4ba3-48b5-ab2e-e92e77088127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:15.241147 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beef645-4ba3-48b5-ab2e-e92e77088127 admin admin] PATH_INFO: `/v3/projects/9430803092ff429a98e422b3db63ca27` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:15.242445 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beef645-4ba3-48b5-ab2e-e92e77088127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9430803092ff429a98e422b3db63ca27)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:15.244667 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beef645-4ba3-48b5-ab2e-e92e77088127 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:15.334227 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6beef645-4ba3-48b5-ab2e-e92e77088127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9430803092ff429a98e422b3db63ca27', 'request_id': 'req-6beef645-4ba3-48b5-ab2e-e92e77088127'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:15.343076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6beef645-4ba3-48b5-ab2e-e92e77088127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9430803092ff429a98e422b3db63ca27', 'request_id': 'req-6beef645-4ba3-48b5-ab2e-e92e77088127'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:15.350823 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6beef645-4ba3-48b5-ab2e-e92e77088127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9430803092ff429a98e422b3db63ca27', 'request_id': 'req-6beef645-4ba3-48b5-ab2e-e92e77088127'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:15.361787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6beef645-4ba3-48b5-ab2e-e92e77088127 admin admin] The token cache is being invalidate because project 9430803092ff429a98e422b3db63ca27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:07:15.362796 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6beef645-4ba3-48b5-ab2e-e92e77088127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:15.363435 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-6beef645-4ba3-48b5-ab2e-e92e77088127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:15.365026 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1351/2654] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:07:15 2022] DELETE /identity/v3/projects/9430803092ff429a98e422b3db63ca27 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:07:15.370658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15e7e0-6918-42b3-b6b7-c939f13adf21 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:15.371014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15e7e0-6918-42b3-b6b7-c939f13adf21 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:15.371357 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15e7e0-6918-42b3-b6b7-c939f13adf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:15.391279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-1a15e7e0-6918-42b3-b6b7-c939f13adf21 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:15.392917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-1a15e7e0-6918-42b3-b6b7-c939f13adf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:15.469802 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1304/2655] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:15.479291 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511f8e4-a531-4365-96fb-a116923bd29b None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:15.479643 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511f8e4-a531-4365-96fb-a116923bd29b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:15.479994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511f8e4-a531-4365-96fb-a116923bd29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:15.499896 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-8511f8e4-a531-4365-96fb-a116923bd29b None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:15.501248 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-8511f8e4-a531-4365-96fb-a116923bd29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:15.509758 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1352/2656] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:15.513934 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15e7e0-6918-42b3-b6b7-c939f13adf21 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:15.524137 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15e7e0-6918-42b3-b6b7-c939f13adf21 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:15.528802 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043bc8b-de9f-4d7c-9c8a-172c3f6e4013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:15.529448 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043bc8b-de9f-4d7c-9c8a-172c3f6e4013 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:15.529727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043bc8b-de9f-4d7c-9c8a-172c3f6e4013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:15.530001 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043bc8b-de9f-4d7c-9c8a-172c3f6e4013 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:15.530719 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043bc8b-de9f-4d7c-9c8a-172c3f6e4013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:07:15.531021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043bc8b-de9f-4d7c-9c8a-172c3f6e4013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:15.532633 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043bc8b-de9f-4d7c-9c8a-172c3f6e4013 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:15.545408 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1305/2657] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:07:15.551450 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511f8e4-a531-4365-96fb-a116923bd29b None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:15.561162 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511f8e4-a531-4365-96fb-a116923bd29b None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:15.566574 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4231e-3e12-4006-a3c9-9852f6dfc6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:15.567237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4231e-3e12-4006-a3c9-9852f6dfc6ac admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:15.567515 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4231e-3e12-4006-a3c9-9852f6dfc6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:15.567915 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4231e-3e12-4006-a3c9-9852f6dfc6ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:15.568651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4231e-3e12-4006-a3c9-9852f6dfc6ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:15.570718 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4231e-3e12-4006-a3c9-9852f6dfc6ac admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:15.603994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1353/2658] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:07:15 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:07:15.608426 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043bc8b-de9f-4d7c-9c8a-172c3f6e4013 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:15.618765 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043bc8b-de9f-4d7c-9c8a-172c3f6e4013 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:15.680951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b9625-60e2-4c08-99cc-f286a5d7effb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:15.681653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b9625-60e2-4c08-99cc-f286a5d7effb admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:15.681878 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b9625-60e2-4c08-99cc-f286a5d7effb admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:15.682148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b9625-60e2-4c08-99cc-f286a5d7effb admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:15.682874 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b9625-60e2-4c08-99cc-f286a5d7effb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:15.685094 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b9625-60e2-4c08-99cc-f286a5d7effb admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:15.712874 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1306/2659] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:07:15 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:07:15.718125 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4231e-3e12-4006-a3c9-9852f6dfc6ac admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:15.728726 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4231e-3e12-4006-a3c9-9852f6dfc6ac admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:15.733613 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3597b3-fc10-40c5-882f-6bf693be49af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:15.734277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3597b3-fc10-40c5-882f-6bf693be49af admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:15.734552 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3597b3-fc10-40c5-882f-6bf693be49af admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:15.734869 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3597b3-fc10-40c5-882f-6bf693be49af admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:15.735692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3597b3-fc10-40c5-882f-6bf693be49af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:15.737329 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3597b3-fc10-40c5-882f-6bf693be49af admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:15.766657 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1354/2660] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:07:15.769065 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b9625-60e2-4c08-99cc-f286a5d7effb admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:15.779816 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b9625-60e2-4c08-99cc-f286a5d7effb admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:15.785458 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a8f73-df7c-41ad-8746-020fb5dc6be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:15.786369 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a8f73-df7c-41ad-8746-020fb5dc6be2 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:15.786487 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a8f73-df7c-41ad-8746-020fb5dc6be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:15.786705 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a8f73-df7c-41ad-8746-020fb5dc6be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:15.787667 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a8f73-df7c-41ad-8746-020fb5dc6be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:15.790608 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a8f73-df7c-41ad-8746-020fb5dc6be2 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:15.802001 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1307/2661] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:15.807003 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3597b3-fc10-40c5-882f-6bf693be49af admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:15.818015 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3597b3-fc10-40c5-882f-6bf693be49af admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:15.822995 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5afebb-e5cc-4395-989b-bfca8d994b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:15.823897 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5afebb-e5cc-4395-989b-bfca8d994b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:15.824200 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5afebb-e5cc-4395-989b-bfca8d994b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:15.824480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5afebb-e5cc-4395-989b-bfca8d994b52 admin admin] PATH_INFO: `/v3/projects/18206a05672d4b198c11abf9305384c8/users/a8039c05c28c44399f2a80c9d708b44b/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:15.842464 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5afebb-e5cc-4395-989b-bfca8d994b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18206a05672d4b198c11abf9305384c8, user_id=a8039c05c28c44399f2a80c9d708b44b, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:15.845671 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5afebb-e5cc-4395-989b-bfca8d994b52 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:15.864209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1355/2662] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:15 2022] PUT /identity/v3/projects/18206a05672d4b198c11abf9305384c8/users/a8039c05c28c44399f2a80c9d708b44b/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:15.873664 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a54d2-2d58-4e8c-ba0a-690dcb418d4c None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:15.873984 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a54d2-2d58-4e8c-ba0a-690dcb418d4c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:15.874264 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a54d2-2d58-4e8c-ba0a-690dcb418d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:15.914089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-f79a54d2-2d58-4e8c-ba0a-690dcb418d4c None None] MFA Rules not processed for user `a8039c05c28c44399f2a80c9d708b44b`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:15.915296 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-f79a54d2-2d58-4e8c-ba0a-690dcb418d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:15.978723 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1308/2663] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:15.990568 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5afebb-e5cc-4395-989b-bfca8d994b52 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:15.992325 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-4b5afebb-e5cc-4395-989b-bfca8d994b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:16.065537 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5afebb-e5cc-4395-989b-bfca8d994b52 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:16.069512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d72bdc-a05b-4eac-8a11-112bdef7f7e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d674fd1d6ab43ab982b66bb2349b625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:16.070154 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d72bdc-a05b-4eac-8a11-112bdef7f7e5 service glance] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:16.070436 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d72bdc-a05b-4eac-8a11-112bdef7f7e5 service glance] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:16.070711 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d72bdc-a05b-4eac-8a11-112bdef7f7e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:16.086770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d72bdc-a05b-4eac-8a11-112bdef7f7e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:16.086770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d72bdc-a05b-4eac-8a11-112bdef7f7e5 service glance] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:16.100793 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1356/2664] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:16.732853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba648acc-7aab-4bb5-9cf8-49abc50f6b50 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:16.733388 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba648acc-7aab-4bb5-9cf8-49abc50f6b50 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:16.733388 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba648acc-7aab-4bb5-9cf8-49abc50f6b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:16.752194 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-ba648acc-7aab-4bb5-9cf8-49abc50f6b50 None None] MFA Rules not processed for user `9d87a4de3fbf4cbb9e21523634007629`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:16.753418 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ba648acc-7aab-4bb5-9cf8-49abc50f6b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:16.790603 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d72bdc-a05b-4eac-8a11-112bdef7f7e5 service glance] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:16.792062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b3d72bdc-a05b-4eac-8a11-112bdef7f7e5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:16.822444 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1309/2665] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:07:16.864355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d72bdc-a05b-4eac-8a11-112bdef7f7e5 service glance] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:16.868885 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df084188-ab68-4053-be87-25510cc8e037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:16.869746 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df084188-ab68-4053-be87-25510cc8e037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:16.870161 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df084188-ab68-4053-be87-25510cc8e037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:16.870440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df084188-ab68-4053-be87-25510cc8e037 admin admin] PATH_INFO: `/v3/users/67535c1c99484689999ef478604e51d0` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:16.871636 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df084188-ab68-4053-be87-25510cc8e037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67535c1c99484689999ef478604e51d0)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:16.873549 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df084188-ab68-4053-be87-25510cc8e037 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:16.922510 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-df084188-ab68-4053-be87-25510cc8e037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67535c1c99484689999ef478604e51d0'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:16.935074 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-df084188-ab68-4053-be87-25510cc8e037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67535c1c99484689999ef478604e51d0'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:16.942455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-df084188-ab68-4053-be87-25510cc8e037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67535c1c99484689999ef478604e51d0'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:16.943425 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-df084188-ab68-4053-be87-25510cc8e037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67535c1c99484689999ef478604e51d0'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:16.952683 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-df084188-ab68-4053-be87-25510cc8e037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67535c1c99484689999ef478604e51d0'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:16.961861 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1357/2666] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:07:16 2022] DELETE /identity/v3/users/67535c1c99484689999ef478604e51d0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:17.348514 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba648acc-7aab-4bb5-9cf8-49abc50f6b50 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:17.360703 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba648acc-7aab-4bb5-9cf8-49abc50f6b50 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:17.429590 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d733dd6-91d3-41ea-9ccc-d5f505b5fb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:17.430609 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d733dd6-91d3-41ea-9ccc-d5f505b5fb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:17.430953 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d733dd6-91d3-41ea-9ccc-d5f505b5fb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:17.431293 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d733dd6-91d3-41ea-9ccc-d5f505b5fb6e admin admin] PATH_INFO: `/v3/projects/dd39c2a00ace4575896bf3f045bedce1` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:17.432618 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d733dd6-91d3-41ea-9ccc-d5f505b5fb6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd39c2a00ace4575896bf3f045bedce1)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:17.434524 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d733dd6-91d3-41ea-9ccc-d5f505b5fb6e admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:17.485676 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4d733dd6-91d3-41ea-9ccc-d5f505b5fb6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd39c2a00ace4575896bf3f045bedce1', 'request_id': 'req-4d733dd6-91d3-41ea-9ccc-d5f505b5fb6e'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:17.491804 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4d733dd6-91d3-41ea-9ccc-d5f505b5fb6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd39c2a00ace4575896bf3f045bedce1', 'request_id': 'req-4d733dd6-91d3-41ea-9ccc-d5f505b5fb6e'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:17.498945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4d733dd6-91d3-41ea-9ccc-d5f505b5fb6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd39c2a00ace4575896bf3f045bedce1', 'request_id': 'req-4d733dd6-91d3-41ea-9ccc-d5f505b5fb6e'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:17.512709 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4d733dd6-91d3-41ea-9ccc-d5f505b5fb6e admin admin] The token cache is being invalidate because project dd39c2a00ace4575896bf3f045bedce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:07:17.512942 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4d733dd6-91d3-41ea-9ccc-d5f505b5fb6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:17.513561 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4d733dd6-91d3-41ea-9ccc-d5f505b5fb6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:17.515288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1310/2667] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:07:17 2022] DELETE /identity/v3/projects/dd39c2a00ace4575896bf3f045bedce1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:17.521734 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c52b99-9f64-47c2-b7c5-e32018af1dcf None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:17.522023 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c52b99-9f64-47c2-b7c5-e32018af1dcf None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:17.522354 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c52b99-9f64-47c2-b7c5-e32018af1dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:17.540842 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f4c52b99-9f64-47c2-b7c5-e32018af1dcf None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:17.542050 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f4c52b99-9f64-47c2-b7c5-e32018af1dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:17.606220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1358/2668] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:17.614137 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035843f5-ab96-40c8-851b-c01412a093d6 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:17.614543 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035843f5-ab96-40c8-851b-c01412a093d6 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:17.615089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035843f5-ab96-40c8-851b-c01412a093d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:17.639366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-035843f5-ab96-40c8-851b-c01412a093d6 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:17.640627 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-035843f5-ab96-40c8-851b-c01412a093d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:17.650138 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1311/2669] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:17.654342 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c52b99-9f64-47c2-b7c5-e32018af1dcf None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:17.663709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c52b99-9f64-47c2-b7c5-e32018af1dcf None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:17.669046 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df8db0-d212-451c-9850-6aaef7f0e2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:17.669738 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df8db0-d212-451c-9850-6aaef7f0e2aa admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:17.670024 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df8db0-d212-451c-9850-6aaef7f0e2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:17.670310 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df8db0-d212-451c-9850-6aaef7f0e2aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:17.671028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df8db0-d212-451c-9850-6aaef7f0e2aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:07:17.671326 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df8db0-d212-451c-9850-6aaef7f0e2aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:17.672914 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df8db0-d212-451c-9850-6aaef7f0e2aa admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:17.684866 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1359/2670] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:07:17.689184 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035843f5-ab96-40c8-851b-c01412a093d6 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:17.723500 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035843f5-ab96-40c8-851b-c01412a093d6 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:17.728690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf4542-bd4e-48f7-91cd-362ead001143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:17.729034 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf4542-bd4e-48f7-91cd-362ead001143 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:17.729315 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf4542-bd4e-48f7-91cd-362ead001143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:17.729583 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf4542-bd4e-48f7-91cd-362ead001143 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:17.730263 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf4542-bd4e-48f7-91cd-362ead001143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:17.732360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf4542-bd4e-48f7-91cd-362ead001143 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:17.780769 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1312/2671] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:07:17 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:17.785250 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df8db0-d212-451c-9850-6aaef7f0e2aa admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:17.800016 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df8db0-d212-451c-9850-6aaef7f0e2aa admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:17.862544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b931239-db06-4d98-88e4-5e56dbfb9983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:17.863233 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b931239-db06-4d98-88e4-5e56dbfb9983 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:17.863520 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b931239-db06-4d98-88e4-5e56dbfb9983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:17.863797 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b931239-db06-4d98-88e4-5e56dbfb9983 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:17.864546 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b931239-db06-4d98-88e4-5e56dbfb9983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:17.869774 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b931239-db06-4d98-88e4-5e56dbfb9983 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:17.891367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1360/2672] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:07:17 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:17.895756 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf4542-bd4e-48f7-91cd-362ead001143 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:17.906843 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf4542-bd4e-48f7-91cd-362ead001143 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:17.911963 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1ba85-719d-41c1-9a7b-32a3f6a6a311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:17.912741 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1ba85-719d-41c1-9a7b-32a3f6a6a311 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:17.913196 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1ba85-719d-41c1-9a7b-32a3f6a6a311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:17.913621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1ba85-719d-41c1-9a7b-32a3f6a6a311 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:17.914423 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1ba85-719d-41c1-9a7b-32a3f6a6a311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:17.916113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1ba85-719d-41c1-9a7b-32a3f6a6a311 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:17.929586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1313/2673] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:17.933921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b931239-db06-4d98-88e4-5e56dbfb9983 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:17.946686 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b931239-db06-4d98-88e4-5e56dbfb9983 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:17.951013 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1848e8-4b96-4a4a-ba0a-183c19ac32f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:17.951684 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1848e8-4b96-4a4a-ba0a-183c19ac32f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:17.951959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1848e8-4b96-4a4a-ba0a-183c19ac32f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:17.952273 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1848e8-4b96-4a4a-ba0a-183c19ac32f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:17.952997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1848e8-4b96-4a4a-ba0a-183c19ac32f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:17.954605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1848e8-4b96-4a4a-ba0a-183c19ac32f8 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:17.965147 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1361/2674] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:17.969534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1ba85-719d-41c1-9a7b-32a3f6a6a311 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:17.979725 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1ba85-719d-41c1-9a7b-32a3f6a6a311 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:17.992475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95de6aa-fcf3-47bf-af81-8026d164fb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:17.993582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95de6aa-fcf3-47bf-af81-8026d164fb3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:17.993946 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95de6aa-fcf3-47bf-af81-8026d164fb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:17.994321 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95de6aa-fcf3-47bf-af81-8026d164fb3f admin admin] PATH_INFO: `/v3/projects/ea566cb4843d415a939a27cb0d307754/users/805fb1491c0145a18497562bccfb00c1/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:18.010491 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95de6aa-fcf3-47bf-af81-8026d164fb3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea566cb4843d415a939a27cb0d307754, user_id=805fb1491c0145a18497562bccfb00c1, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:18.013736 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95de6aa-fcf3-47bf-af81-8026d164fb3f admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:18.026442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1314/2675] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:17 2022] PUT /identity/v3/projects/ea566cb4843d415a939a27cb0d307754/users/805fb1491c0145a18497562bccfb00c1/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:18.037550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bd251-e543-49dd-b527-4220f57fc2d1 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:18.037696 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bd251-e543-49dd-b527-4220f57fc2d1 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:18.037985 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bd251-e543-49dd-b527-4220f57fc2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:18.068760 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-7b3bd251-e543-49dd-b527-4220f57fc2d1 None None] MFA Rules not processed for user `805fb1491c0145a18497562bccfb00c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:18.070012 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-7b3bd251-e543-49dd-b527-4220f57fc2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:18.138113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1362/2676] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:07:18.149454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95de6aa-fcf3-47bf-af81-8026d164fb3f admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:18.151210 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-e95de6aa-fcf3-47bf-af81-8026d164fb3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:18.238447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95de6aa-fcf3-47bf-af81-8026d164fb3f admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:18.247849 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff6361-3e02-419b-8ddd-ab6f0b1dde72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:18.248554 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff6361-3e02-419b-8ddd-ab6f0b1dde72 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:18.248841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff6361-3e02-419b-8ddd-ab6f0b1dde72 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:18.249118 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff6361-3e02-419b-8ddd-ab6f0b1dde72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:18.256822 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff6361-3e02-419b-8ddd-ab6f0b1dde72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:18.258407 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff6361-3e02-419b-8ddd-ab6f0b1dde72 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:18.267639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1315/2677] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:07:20.983173 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bd251-e543-49dd-b527-4220f57fc2d1 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:21.046160 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bd251-e543-49dd-b527-4220f57fc2d1 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:21.051320 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828f37c-0502-49e8-ab43-28da317477be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:21.052212 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828f37c-0502-49e8-ab43-28da317477be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:21.052491 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828f37c-0502-49e8-ab43-28da317477be admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:21.052760 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828f37c-0502-49e8-ab43-28da317477be admin admin] PATH_INFO: `/v3/users/805fb1491c0145a18497562bccfb00c1` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:21.053951 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828f37c-0502-49e8-ab43-28da317477be admin admin] RBAC: Authorizing `identity:delete_user(user_id=805fb1491c0145a18497562bccfb00c1)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:21.055845 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828f37c-0502-49e8-ab43-28da317477be admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:21.105065 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c828f37c-0502-49e8-ab43-28da317477be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '805fb1491c0145a18497562bccfb00c1'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:21.118507 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c828f37c-0502-49e8-ab43-28da317477be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '805fb1491c0145a18497562bccfb00c1'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:21.125544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c828f37c-0502-49e8-ab43-28da317477be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '805fb1491c0145a18497562bccfb00c1'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:21.126259 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c828f37c-0502-49e8-ab43-28da317477be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '805fb1491c0145a18497562bccfb00c1'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:21.133286 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-c828f37c-0502-49e8-ab43-28da317477be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '805fb1491c0145a18497562bccfb00c1'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:21.140129 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1363/2678] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:07:20 2022] DELETE /identity/v3/users/805fb1491c0145a18497562bccfb00c1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:21.145606 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c5ff3-12e7-4da1-9a2c-01b58f976c39 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:21.146053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c5ff3-12e7-4da1-9a2c-01b58f976c39 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:21.146550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c5ff3-12e7-4da1-9a2c-01b58f976c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:21.164932 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-ed6c5ff3-12e7-4da1-9a2c-01b58f976c39 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:21.166475 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ed6c5ff3-12e7-4da1-9a2c-01b58f976c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:21.231067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1316/2679] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:21.241394 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828f37c-0502-49e8-ab43-28da317477be admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:21.242880 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c828f37c-0502-49e8-ab43-28da317477be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:21.302339 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828f37c-0502-49e8-ab43-28da317477be admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:21.306000 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee30409-fdb4-4567-bf42-072dde10877c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:21.306645 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee30409-fdb4-4567-bf42-072dde10877c service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:21.306921 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee30409-fdb4-4567-bf42-072dde10877c service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:21.307193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee30409-fdb4-4567-bf42-072dde10877c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:21.316859 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee30409-fdb4-4567-bf42-072dde10877c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:21.319015 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee30409-fdb4-4567-bf42-072dde10877c service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:21.329025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1364/2680] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:07:21.617477 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c5ff3-12e7-4da1-9a2c-01b58f976c39 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:21.619128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ed6c5ff3-12e7-4da1-9a2c-01b58f976c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:21.637164 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c5ff3-12e7-4da1-9a2c-01b58f976c39 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:21.642079 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574de58c-ec31-41f9-b05b-6202b9f796b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:21.643067 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574de58c-ec31-41f9-b05b-6202b9f796b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:21.643231 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574de58c-ec31-41f9-b05b-6202b9f796b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:21.643541 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574de58c-ec31-41f9-b05b-6202b9f796b4 admin admin] PATH_INFO: `/v3/projects/ea566cb4843d415a939a27cb0d307754` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:21.644869 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574de58c-ec31-41f9-b05b-6202b9f796b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea566cb4843d415a939a27cb0d307754)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:21.646740 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574de58c-ec31-41f9-b05b-6202b9f796b4 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:21.692442 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-574de58c-ec31-41f9-b05b-6202b9f796b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea566cb4843d415a939a27cb0d307754', 'request_id': 'req-574de58c-ec31-41f9-b05b-6202b9f796b4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:21.697521 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-574de58c-ec31-41f9-b05b-6202b9f796b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea566cb4843d415a939a27cb0d307754', 'request_id': 'req-574de58c-ec31-41f9-b05b-6202b9f796b4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:21.703336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-574de58c-ec31-41f9-b05b-6202b9f796b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea566cb4843d415a939a27cb0d307754', 'request_id': 'req-574de58c-ec31-41f9-b05b-6202b9f796b4'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:21.716611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-574de58c-ec31-41f9-b05b-6202b9f796b4 admin admin] The token cache is being invalidate because project ea566cb4843d415a939a27cb0d307754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:07:21.716904 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-574de58c-ec31-41f9-b05b-6202b9f796b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:21.717533 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-574de58c-ec31-41f9-b05b-6202b9f796b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:21.719087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1317/2681] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:07:21 2022] DELETE /identity/v3/projects/ea566cb4843d415a939a27cb0d307754 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:21.723907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e13429-ae4c-43c8-9340-cbfed5d39052 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:21.724218 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e13429-ae4c-43c8-9340-cbfed5d39052 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:21.724497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e13429-ae4c-43c8-9340-cbfed5d39052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:21.741967 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-44e13429-ae4c-43c8-9340-cbfed5d39052 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:21.743029 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-44e13429-ae4c-43c8-9340-cbfed5d39052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:21.806684 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1365/2682] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:07:21.814298 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e81d8-4c22-40ca-ad7e-0f704ac15786 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:21.814627 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e81d8-4c22-40ca-ad7e-0f704ac15786 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:21.815418 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e81d8-4c22-40ca-ad7e-0f704ac15786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:21.833559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-c57e81d8-4c22-40ca-ad7e-0f704ac15786 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:21.834773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-c57e81d8-4c22-40ca-ad7e-0f704ac15786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:21.842794 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1318/2683] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:21.847604 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e13429-ae4c-43c8-9340-cbfed5d39052 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:21.857140 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e13429-ae4c-43c8-9340-cbfed5d39052 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:21.862345 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977fdfd-9bfa-4dd3-80d7-997544fabcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:21.862985 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977fdfd-9bfa-4dd3-80d7-997544fabcfd admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:21.863263 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977fdfd-9bfa-4dd3-80d7-997544fabcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:21.863539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977fdfd-9bfa-4dd3-80d7-997544fabcfd admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:21.864301 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977fdfd-9bfa-4dd3-80d7-997544fabcfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:07:21.864607 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977fdfd-9bfa-4dd3-80d7-997544fabcfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:21.866219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977fdfd-9bfa-4dd3-80d7-997544fabcfd admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:21.877261 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1366/2684] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:07:21.881437 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e81d8-4c22-40ca-ad7e-0f704ac15786 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:21.890435 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e81d8-4c22-40ca-ad7e-0f704ac15786 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:21.895700 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b30ee5-d64c-4365-8aa3-77c98d50aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:21.896427 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b30ee5-d64c-4365-8aa3-77c98d50aadf admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:21.896709 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b30ee5-d64c-4365-8aa3-77c98d50aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:21.896982 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b30ee5-d64c-4365-8aa3-77c98d50aadf admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:21.897677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b30ee5-d64c-4365-8aa3-77c98d50aadf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:21.899571 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b30ee5-d64c-4365-8aa3-77c98d50aadf admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:21.925460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1319/2685] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:07:21 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:21.929470 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977fdfd-9bfa-4dd3-80d7-997544fabcfd admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:21.939330 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977fdfd-9bfa-4dd3-80d7-997544fabcfd admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:21.995984 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c7d69-aa8c-4cef-af8b-033e726c277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:21.996691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c7d69-aa8c-4cef-af8b-033e726c277b admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:21.997171 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c7d69-aa8c-4cef-af8b-033e726c277b admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:21.997460 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c7d69-aa8c-4cef-af8b-033e726c277b admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:21.998149 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c7d69-aa8c-4cef-af8b-033e726c277b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:22.000048 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c7d69-aa8c-4cef-af8b-033e726c277b admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:22.024732 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1367/2686] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:07:21 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:07:22.025721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b30ee5-d64c-4365-8aa3-77c98d50aadf admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:22.041774 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b30ee5-d64c-4365-8aa3-77c98d50aadf admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:22.047819 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4ef85-1031-4b6c-bcd3-5ff92b9f1e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:22.048548 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4ef85-1031-4b6c-bcd3-5ff92b9f1e5b admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:22.048852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4ef85-1031-4b6c-bcd3-5ff92b9f1e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:22.049759 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4ef85-1031-4b6c-bcd3-5ff92b9f1e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:22.050477 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4ef85-1031-4b6c-bcd3-5ff92b9f1e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:22.052045 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4ef85-1031-4b6c-bcd3-5ff92b9f1e5b admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:22.062569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1320/2687] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:22.066707 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c7d69-aa8c-4cef-af8b-033e726c277b admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:22.076313 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c7d69-aa8c-4cef-af8b-033e726c277b admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:22.080817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966847a1-df43-4dcd-a255-c4dc174defc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:22.081457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966847a1-df43-4dcd-a255-c4dc174defc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:22.081735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966847a1-df43-4dcd-a255-c4dc174defc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:22.082002 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966847a1-df43-4dcd-a255-c4dc174defc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:22.082705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966847a1-df43-4dcd-a255-c4dc174defc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:22.084280 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966847a1-df43-4dcd-a255-c4dc174defc4 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:22.093745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1368/2688] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:22.098167 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4ef85-1031-4b6c-bcd3-5ff92b9f1e5b admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:22.107852 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4ef85-1031-4b6c-bcd3-5ff92b9f1e5b admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:22.114103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7fac4-99b0-4bda-96db-470f752ccbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:22.114992 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7fac4-99b0-4bda-96db-470f752ccbe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:22.115267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7fac4-99b0-4bda-96db-470f752ccbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:22.115542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7fac4-99b0-4bda-96db-470f752ccbe6 admin admin] PATH_INFO: `/v3/projects/03cfec3f0aae4f3b854db5fdeb7b045c/users/d73bf5b362bb4cc5820111e3824ab5e3/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:22.130098 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7fac4-99b0-4bda-96db-470f752ccbe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03cfec3f0aae4f3b854db5fdeb7b045c, user_id=d73bf5b362bb4cc5820111e3824ab5e3, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:22.132757 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7fac4-99b0-4bda-96db-470f752ccbe6 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:22.145391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1321/2689] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:22 2022] PUT /identity/v3/projects/03cfec3f0aae4f3b854db5fdeb7b045c/users/d73bf5b362bb4cc5820111e3824ab5e3/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:22.155443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf329a-8c4d-4d96-9b88-b88a439d8793 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:22.155733 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf329a-8c4d-4d96-9b88-b88a439d8793 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:22.156008 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf329a-8c4d-4d96-9b88-b88a439d8793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:22.185375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-ffaf329a-8c4d-4d96-9b88-b88a439d8793 None None] MFA Rules not processed for user `d73bf5b362bb4cc5820111e3824ab5e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:22.186562 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ffaf329a-8c4d-4d96-9b88-b88a439d8793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:22.249240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1369/2690] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:07:22.253693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7fac4-99b0-4bda-96db-470f752ccbe6 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:22.313499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7fac4-99b0-4bda-96db-470f752ccbe6 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:22.318547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe30c74-6b34-48c5-8c60-a9a94e47dbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:22.319226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe30c74-6b34-48c5-8c60-a9a94e47dbee admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:22.319512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe30c74-6b34-48c5-8c60-a9a94e47dbee admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:22.319787 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe30c74-6b34-48c5-8c60-a9a94e47dbee admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:22.320537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe30c74-6b34-48c5-8c60-a9a94e47dbee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:22.322446 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe30c74-6b34-48c5-8c60-a9a94e47dbee admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:22.348782 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1322/2691] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:07:22 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:22.352630 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf329a-8c4d-4d96-9b88-b88a439d8793 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:22.363120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf329a-8c4d-4d96-9b88-b88a439d8793 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:22.421137 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da466ee5-e242-43b6-8a55-1c6664f7c13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:22.421831 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da466ee5-e242-43b6-8a55-1c6664f7c13a admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:22.422099 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da466ee5-e242-43b6-8a55-1c6664f7c13a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:22.422511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da466ee5-e242-43b6-8a55-1c6664f7c13a admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:22.423062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da466ee5-e242-43b6-8a55-1c6664f7c13a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:22.424985 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da466ee5-e242-43b6-8a55-1c6664f7c13a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:22.446558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1370/2692] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:07:22 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:22.447965 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe30c74-6b34-48c5-8c60-a9a94e47dbee admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:22.459228 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe30c74-6b34-48c5-8c60-a9a94e47dbee admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:22.463966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339f621-99c1-400a-a33b-9f1ea4a1927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:22.464671 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339f621-99c1-400a-a33b-9f1ea4a1927c admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:22.464959 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339f621-99c1-400a-a33b-9f1ea4a1927c admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:22.465237 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339f621-99c1-400a-a33b-9f1ea4a1927c admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:22.465962 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339f621-99c1-400a-a33b-9f1ea4a1927c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:22.467571 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339f621-99c1-400a-a33b-9f1ea4a1927c admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:22.482464 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1323/2693] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:22.484102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da466ee5-e242-43b6-8a55-1c6664f7c13a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:22.494769 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da466ee5-e242-43b6-8a55-1c6664f7c13a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:22.499497 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f07f91-c080-4a54-a5f3-b2b8d301587f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:22.500340 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f07f91-c080-4a54-a5f3-b2b8d301587f admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:22.500625 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f07f91-c080-4a54-a5f3-b2b8d301587f admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:22.500903 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f07f91-c080-4a54-a5f3-b2b8d301587f admin admin] PATH_INFO: `/v3/projects/da052c9efbdb48cd8e3129520fa8abd1/users/5bf3b41f5414473ba2c646ab3c52bccb/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:22.516895 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f07f91-c080-4a54-a5f3-b2b8d301587f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da052c9efbdb48cd8e3129520fa8abd1, user_id=5bf3b41f5414473ba2c646ab3c52bccb, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:22.519594 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f07f91-c080-4a54-a5f3-b2b8d301587f admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:22.535467 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1371/2694] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:22 2022] PUT /identity/v3/projects/da052c9efbdb48cd8e3129520fa8abd1/users/5bf3b41f5414473ba2c646ab3c52bccb/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:07:22.540073 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339f621-99c1-400a-a33b-9f1ea4a1927c admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:22.550725 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339f621-99c1-400a-a33b-9f1ea4a1927c admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:22.605932 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73b36b-5f83-422f-bd45-d88eab94d96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:22.606594 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73b36b-5f83-422f-bd45-d88eab94d96a admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:22.606877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73b36b-5f83-422f-bd45-d88eab94d96a admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:22.607146 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73b36b-5f83-422f-bd45-d88eab94d96a admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:22.607862 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73b36b-5f83-422f-bd45-d88eab94d96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:22.609495 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73b36b-5f83-422f-bd45-d88eab94d96a admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:22.619850 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1324/2695] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:22.624016 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f07f91-c080-4a54-a5f3-b2b8d301587f admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:22.634166 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f07f91-c080-4a54-a5f3-b2b8d301587f admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:22.638844 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adfa76-636e-4428-a40b-9fc8a06bdf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:22.639722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adfa76-636e-4428-a40b-9fc8a06bdf5a admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:22.640010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adfa76-636e-4428-a40b-9fc8a06bdf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:22.640327 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adfa76-636e-4428-a40b-9fc8a06bdf5a admin admin] PATH_INFO: `/v3/projects/da052c9efbdb48cd8e3129520fa8abd1/users/5bf3b41f5414473ba2c646ab3c52bccb/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:22.642548 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adfa76-636e-4428-a40b-9fc8a06bdf5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da052c9efbdb48cd8e3129520fa8abd1, user_id=5bf3b41f5414473ba2c646ab3c52bccb, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:22.645231 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adfa76-636e-4428-a40b-9fc8a06bdf5a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:22.655081 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1372/2696] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:22 2022] PUT /identity/v3/projects/da052c9efbdb48cd8e3129520fa8abd1/users/5bf3b41f5414473ba2c646ab3c52bccb/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:22.667073 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46f9de-0b33-4883-a806-a26c8f2e16bf None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:22.667358 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46f9de-0b33-4883-a806-a26c8f2e16bf None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:22.667660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46f9de-0b33-4883-a806-a26c8f2e16bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:22.697172 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-8a46f9de-0b33-4883-a806-a26c8f2e16bf None None] MFA Rules not processed for user `5bf3b41f5414473ba2c646ab3c52bccb`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:22.698517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8a46f9de-0b33-4883-a806-a26c8f2e16bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:22.765880 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1325/2697] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:22.777457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adfa76-636e-4428-a40b-9fc8a06bdf5a admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:22.779180 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a6adfa76-636e-4428-a40b-9fc8a06bdf5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:22.837491 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adfa76-636e-4428-a40b-9fc8a06bdf5a admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:22.841087 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6693e29-04e1-4ed5-b03b-3c9725174442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:22.841716 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6693e29-04e1-4ed5-b03b-3c9725174442 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:22.841991 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6693e29-04e1-4ed5-b03b-3c9725174442 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:22.842266 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6693e29-04e1-4ed5-b03b-3c9725174442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:22.851615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6693e29-04e1-4ed5-b03b-3c9725174442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:22.853044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6693e29-04e1-4ed5-b03b-3c9725174442 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:22.863072 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1373/2698] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:22.935075 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46f9de-0b33-4883-a806-a26c8f2e16bf None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:22.945112 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46f9de-0b33-4883-a806-a26c8f2e16bf None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:22.949526 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece43ad-f914-476e-820c-1d0150f3f852 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:22.950149 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece43ad-f914-476e-820c-1d0150f3f852 service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:22.950699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece43ad-f914-476e-820c-1d0150f3f852 service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:22.951025 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece43ad-f914-476e-820c-1d0150f3f852 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:23.018237 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece43ad-f914-476e-820c-1d0150f3f852 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:23.019600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece43ad-f914-476e-820c-1d0150f3f852 service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:23.028362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1326/2699] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:34.228720 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6693e29-04e1-4ed5-b03b-3c9725174442 service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:34.308226 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6693e29-04e1-4ed5-b03b-3c9725174442 service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:34.312927 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4cdbf-a700-4c9e-b52c-0cfc4b3bbe51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:34.313869 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4cdbf-a700-4c9e-b52c-0cfc4b3bbe51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:34.314165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4cdbf-a700-4c9e-b52c-0cfc4b3bbe51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:34.314556 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4cdbf-a700-4c9e-b52c-0cfc4b3bbe51 admin admin] PATH_INFO: `/v3/users/d73bf5b362bb4cc5820111e3824ab5e3` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:34.316382 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4cdbf-a700-4c9e-b52c-0cfc4b3bbe51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73bf5b362bb4cc5820111e3824ab5e3)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:34.318529 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4cdbf-a700-4c9e-b52c-0cfc4b3bbe51 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:34.364660 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-41a4cdbf-a700-4c9e-b52c-0cfc4b3bbe51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73bf5b362bb4cc5820111e3824ab5e3'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:34.376054 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-41a4cdbf-a700-4c9e-b52c-0cfc4b3bbe51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73bf5b362bb4cc5820111e3824ab5e3'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:34.383908 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-41a4cdbf-a700-4c9e-b52c-0cfc4b3bbe51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73bf5b362bb4cc5820111e3824ab5e3'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:34.384641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-41a4cdbf-a700-4c9e-b52c-0cfc4b3bbe51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73bf5b362bb4cc5820111e3824ab5e3'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:34.394353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-41a4cdbf-a700-4c9e-b52c-0cfc4b3bbe51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73bf5b362bb4cc5820111e3824ab5e3'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:34.400582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1374/2700] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:07:34 2022] DELETE /identity/v3/users/d73bf5b362bb4cc5820111e3824ab5e3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:34.405036 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80503191-0174-4ee1-86da-cc437e6bc563 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:34.405500 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80503191-0174-4ee1-86da-cc437e6bc563 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:34.405621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80503191-0174-4ee1-86da-cc437e6bc563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:34.422059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-80503191-0174-4ee1-86da-cc437e6bc563 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:34.423239 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-80503191-0174-4ee1-86da-cc437e6bc563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:34.479844 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1327/2701] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:34.490117 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4cdbf-a700-4c9e-b52c-0cfc4b3bbe51 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:34.491487 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-41a4cdbf-a700-4c9e-b52c-0cfc4b3bbe51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:34.550587 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4cdbf-a700-4c9e-b52c-0cfc4b3bbe51 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:34.554337 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777343b-c27a-42fb-84b7-7f817eac5e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:34.554980 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777343b-c27a-42fb-84b7-7f817eac5e8b service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:34.555264 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777343b-c27a-42fb-84b7-7f817eac5e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:34.556015 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777343b-c27a-42fb-84b7-7f817eac5e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:34.564706 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777343b-c27a-42fb-84b7-7f817eac5e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:34.566629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777343b-c27a-42fb-84b7-7f817eac5e8b service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:34.577916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1375/2702] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:34.838416 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80503191-0174-4ee1-86da-cc437e6bc563 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:34.840247 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-80503191-0174-4ee1-86da-cc437e6bc563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:34.853072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80503191-0174-4ee1-86da-cc437e6bc563 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:34.860659 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a066d-0972-4567-aad6-c271f84db8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:34.861532 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a066d-0972-4567-aad6-c271f84db8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:34.861811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a066d-0972-4567-aad6-c271f84db8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:34.862081 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a066d-0972-4567-aad6-c271f84db8d0 admin admin] PATH_INFO: `/v3/projects/03cfec3f0aae4f3b854db5fdeb7b045c` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:34.863287 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a066d-0972-4567-aad6-c271f84db8d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03cfec3f0aae4f3b854db5fdeb7b045c)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:34.865243 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a066d-0972-4567-aad6-c271f84db8d0 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:34.913785 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-ab1a066d-0972-4567-aad6-c271f84db8d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03cfec3f0aae4f3b854db5fdeb7b045c', 'request_id': 'req-ab1a066d-0972-4567-aad6-c271f84db8d0'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:34.919174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-ab1a066d-0972-4567-aad6-c271f84db8d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03cfec3f0aae4f3b854db5fdeb7b045c', 'request_id': 'req-ab1a066d-0972-4567-aad6-c271f84db8d0'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:34.925717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-ab1a066d-0972-4567-aad6-c271f84db8d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03cfec3f0aae4f3b854db5fdeb7b045c', 'request_id': 'req-ab1a066d-0972-4567-aad6-c271f84db8d0'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:34.938333 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-ab1a066d-0972-4567-aad6-c271f84db8d0 admin admin] The token cache is being invalidate because project 03cfec3f0aae4f3b854db5fdeb7b045c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:07:34.938621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-ab1a066d-0972-4567-aad6-c271f84db8d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:34.939230 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-ab1a066d-0972-4567-aad6-c271f84db8d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:34.941496 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1328/2703] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:07:34 2022] DELETE /identity/v3/projects/03cfec3f0aae4f3b854db5fdeb7b045c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:34.945390 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777343b-c27a-42fb-84b7-7f817eac5e8b service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:34.954669 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777343b-c27a-42fb-84b7-7f817eac5e8b service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:35.009001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684ed00-87e0-4911-865a-999f783f2b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:35.009860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684ed00-87e0-4911-865a-999f783f2b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:35.010138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684ed00-87e0-4911-865a-999f783f2b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:35.010414 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684ed00-87e0-4911-865a-999f783f2b5a admin admin] PATH_INFO: `/v3/users/5bf3b41f5414473ba2c646ab3c52bccb` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:35.011597 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684ed00-87e0-4911-865a-999f783f2b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf3b41f5414473ba2c646ab3c52bccb)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:35.013511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684ed00-87e0-4911-865a-999f783f2b5a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:35.058926 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-d684ed00-87e0-4911-865a-999f783f2b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf3b41f5414473ba2c646ab3c52bccb'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:35.070015 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-d684ed00-87e0-4911-865a-999f783f2b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf3b41f5414473ba2c646ab3c52bccb'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:35.076600 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-d684ed00-87e0-4911-865a-999f783f2b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf3b41f5414473ba2c646ab3c52bccb'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:35.077258 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-d684ed00-87e0-4911-865a-999f783f2b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf3b41f5414473ba2c646ab3c52bccb'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:35.086629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-d684ed00-87e0-4911-865a-999f783f2b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf3b41f5414473ba2c646ab3c52bccb'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:35.093495 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1376/2704] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:07:34 2022] DELETE /identity/v3/users/5bf3b41f5414473ba2c646ab3c52bccb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:35.353599 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a066d-0972-4567-aad6-c271f84db8d0 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:35.355026 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ab1a066d-0972-4567-aad6-c271f84db8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:35.368240 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a066d-0972-4567-aad6-c271f84db8d0 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:35.427888 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e14579-a778-40db-9e62-13bee2a6fd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:35.428774 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e14579-a778-40db-9e62-13bee2a6fd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:35.429051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e14579-a778-40db-9e62-13bee2a6fd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:35.429318 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e14579-a778-40db-9e62-13bee2a6fd01 admin admin] PATH_INFO: `/v3/projects/da052c9efbdb48cd8e3129520fa8abd1` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:35.430535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e14579-a778-40db-9e62-13bee2a6fd01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da052c9efbdb48cd8e3129520fa8abd1)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:35.432483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e14579-a778-40db-9e62-13bee2a6fd01 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:35.478126 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-08e14579-a778-40db-9e62-13bee2a6fd01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da052c9efbdb48cd8e3129520fa8abd1', 'request_id': 'req-08e14579-a778-40db-9e62-13bee2a6fd01'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:35.483422 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-08e14579-a778-40db-9e62-13bee2a6fd01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da052c9efbdb48cd8e3129520fa8abd1', 'request_id': 'req-08e14579-a778-40db-9e62-13bee2a6fd01'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:35.489515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-08e14579-a778-40db-9e62-13bee2a6fd01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da052c9efbdb48cd8e3129520fa8abd1', 'request_id': 'req-08e14579-a778-40db-9e62-13bee2a6fd01'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:35.501037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-08e14579-a778-40db-9e62-13bee2a6fd01 admin admin] The token cache is being invalidate because project da052c9efbdb48cd8e3129520fa8abd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:07:35.501322 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-08e14579-a778-40db-9e62-13bee2a6fd01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:35.501933 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-08e14579-a778-40db-9e62-13bee2a6fd01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:35.504103 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1329/2705] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:07:35 2022] DELETE /identity/v3/projects/da052c9efbdb48cd8e3129520fa8abd1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:35.508977 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfce754-55b7-434a-a100-93e5648f024f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:35.509452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfce754-55b7-434a-a100-93e5648f024f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:35.509559 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfce754-55b7-434a-a100-93e5648f024f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:35.527866 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-ddfce754-55b7-434a-a100-93e5648f024f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:35.529084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ddfce754-55b7-434a-a100-93e5648f024f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:35.586013 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1377/2706] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:35.593787 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf36e3-b55b-4349-bade-c525156adae5 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:35.594073 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf36e3-b55b-4349-bade-c525156adae5 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:35.594350 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf36e3-b55b-4349-bade-c525156adae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:35.612028 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-dfcf36e3-b55b-4349-bade-c525156adae5 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:35.613194 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-dfcf36e3-b55b-4349-bade-c525156adae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:35.624486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1330/2707] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:35.625567 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfce754-55b7-434a-a100-93e5648f024f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:35.636146 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfce754-55b7-434a-a100-93e5648f024f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:35.641634 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326c863-5a86-4516-b2f9-612558790ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:35.642745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326c863-5a86-4516-b2f9-612558790ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:35.644423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326c863-5a86-4516-b2f9-612558790ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:35.645037 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326c863-5a86-4516-b2f9-612558790ef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:35.645777 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326c863-5a86-4516-b2f9-612558790ef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:07:35.646111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326c863-5a86-4516-b2f9-612558790ef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:35.647703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326c863-5a86-4516-b2f9-612558790ef4 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:35.661503 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1378/2708] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:07:35.672770 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf36e3-b55b-4349-bade-c525156adae5 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:35.675865 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf36e3-b55b-4349-bade-c525156adae5 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:35.680584 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549db80a-f387-4785-9f77-03a03c1c7e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:35.681225 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549db80a-f387-4785-9f77-03a03c1c7e18 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:35.681504 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549db80a-f387-4785-9f77-03a03c1c7e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:35.681776 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549db80a-f387-4785-9f77-03a03c1c7e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:35.682452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549db80a-f387-4785-9f77-03a03c1c7e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:35.684356 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549db80a-f387-4785-9f77-03a03c1c7e18 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:35.710694 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1331/2709] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:07:35 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:35.715272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326c863-5a86-4516-b2f9-612558790ef4 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:35.727525 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326c863-5a86-4516-b2f9-612558790ef4 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:35.792278 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05b64f-b257-4413-ae87-1b6afdd8b658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:35.792964 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05b64f-b257-4413-ae87-1b6afdd8b658 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:35.793253 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05b64f-b257-4413-ae87-1b6afdd8b658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:35.793532 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05b64f-b257-4413-ae87-1b6afdd8b658 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:35.794225 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05b64f-b257-4413-ae87-1b6afdd8b658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:35.796120 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05b64f-b257-4413-ae87-1b6afdd8b658 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:35.824375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1379/2710] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:07:35 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:35.828153 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549db80a-f387-4785-9f77-03a03c1c7e18 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:35.839214 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549db80a-f387-4785-9f77-03a03c1c7e18 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:35.844313 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7d553-f374-4cad-8180-6648b26690bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:35.844984 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7d553-f374-4cad-8180-6648b26690bf admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:35.845267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7d553-f374-4cad-8180-6648b26690bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:35.845545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7d553-f374-4cad-8180-6648b26690bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:35.846267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7d553-f374-4cad-8180-6648b26690bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:35.847994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7d553-f374-4cad-8180-6648b26690bf admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:35.859182 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1332/2711] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:35.864147 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05b64f-b257-4413-ae87-1b6afdd8b658 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:35.874397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05b64f-b257-4413-ae87-1b6afdd8b658 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:35.879875 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1846bf-29f1-496c-9aae-c069d999296c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:35.880573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1846bf-29f1-496c-9aae-c069d999296c admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:35.880854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1846bf-29f1-496c-9aae-c069d999296c admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:35.881134 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1846bf-29f1-496c-9aae-c069d999296c admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:35.881854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1846bf-29f1-496c-9aae-c069d999296c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:35.883427 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1846bf-29f1-496c-9aae-c069d999296c admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:35.893848 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1380/2712] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:35.898002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7d553-f374-4cad-8180-6648b26690bf admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:35.907644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7d553-f374-4cad-8180-6648b26690bf admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:35.913473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4632f91-66f9-495b-814c-167674dc48dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:35.914352 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4632f91-66f9-495b-814c-167674dc48dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:35.914635 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4632f91-66f9-495b-814c-167674dc48dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:35.914910 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4632f91-66f9-495b-814c-167674dc48dc admin admin] PATH_INFO: `/v3/projects/eae1c652fe6e40f2a92650d2702d3f9e/users/9cf385966ccf42999b6a34a3674ab2a4/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:35.932279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4632f91-66f9-495b-814c-167674dc48dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae1c652fe6e40f2a92650d2702d3f9e, user_id=9cf385966ccf42999b6a34a3674ab2a4, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:35.934920 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4632f91-66f9-495b-814c-167674dc48dc admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:35.948071 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1333/2713] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:35 2022] PUT /identity/v3/projects/eae1c652fe6e40f2a92650d2702d3f9e/users/9cf385966ccf42999b6a34a3674ab2a4/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:07:35.959372 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fbdd2-3d45-4aa0-99f5-d7bb1f83b79c None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:35.959941 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fbdd2-3d45-4aa0-99f5-d7bb1f83b79c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:35.960302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fbdd2-3d45-4aa0-99f5-d7bb1f83b79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:35.990109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-012fbdd2-3d45-4aa0-99f5-d7bb1f83b79c None None] MFA Rules not processed for user `9cf385966ccf42999b6a34a3674ab2a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:35.991535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-012fbdd2-3d45-4aa0-99f5-d7bb1f83b79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:36.070017 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1381/2714] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:36.073107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4632f91-66f9-495b-814c-167674dc48dc admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:36.149583 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4632f91-66f9-495b-814c-167674dc48dc admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:36.155447 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bee555-3762-49a7-b50e-f337b9461fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:36.156271 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bee555-3762-49a7-b50e-f337b9461fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:36.156585 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bee555-3762-49a7-b50e-f337b9461fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:36.156848 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bee555-3762-49a7-b50e-f337b9461fe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:36.157546 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bee555-3762-49a7-b50e-f337b9461fe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:36.160029 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bee555-3762-49a7-b50e-f337b9461fe9 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:36.186973 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1334/2715] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:07:36 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:36.190975 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fbdd2-3d45-4aa0-99f5-d7bb1f83b79c None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:36.202237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fbdd2-3d45-4aa0-99f5-d7bb1f83b79c None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:36.257226 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddc7d0-9bbf-4331-86d6-94eb316b28b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:36.257896 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddc7d0-9bbf-4331-86d6-94eb316b28b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:36.258171 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddc7d0-9bbf-4331-86d6-94eb316b28b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:36.258441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddc7d0-9bbf-4331-86d6-94eb316b28b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:36.259168 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddc7d0-9bbf-4331-86d6-94eb316b28b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:36.261084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddc7d0-9bbf-4331-86d6-94eb316b28b4 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:36.280194 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1382/2716] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:07:36 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:36.284621 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bee555-3762-49a7-b50e-f337b9461fe9 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:36.294641 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bee555-3762-49a7-b50e-f337b9461fe9 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:36.299226 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db29485-3d62-468e-bb69-0918a4607099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:36.300499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db29485-3d62-468e-bb69-0918a4607099 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:36.300777 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db29485-3d62-468e-bb69-0918a4607099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:36.301049 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db29485-3d62-468e-bb69-0918a4607099 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:36.301756 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db29485-3d62-468e-bb69-0918a4607099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:36.303320 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db29485-3d62-468e-bb69-0918a4607099 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:36.313386 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1335/2717] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:36.317288 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddc7d0-9bbf-4331-86d6-94eb316b28b4 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:36.327016 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddc7d0-9bbf-4331-86d6-94eb316b28b4 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:36.331669 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666873a3-3327-47d0-80cd-b491ea4d8915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:36.332571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666873a3-3327-47d0-80cd-b491ea4d8915 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:36.332849 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666873a3-3327-47d0-80cd-b491ea4d8915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:36.333122 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666873a3-3327-47d0-80cd-b491ea4d8915 admin admin] PATH_INFO: `/v3/projects/f5a636e9521b42cfb037e202b242458d/users/c3fd10ff4bfb4126ae4cdae82b1d41e5/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:36.348238 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666873a3-3327-47d0-80cd-b491ea4d8915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a636e9521b42cfb037e202b242458d, user_id=c3fd10ff4bfb4126ae4cdae82b1d41e5, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:36.350933 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666873a3-3327-47d0-80cd-b491ea4d8915 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:36.363802 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1383/2718] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:36 2022] PUT /identity/v3/projects/f5a636e9521b42cfb037e202b242458d/users/c3fd10ff4bfb4126ae4cdae82b1d41e5/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:36.367721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db29485-3d62-468e-bb69-0918a4607099 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:36.377811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db29485-3d62-468e-bb69-0918a4607099 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:36.433279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc0fd4-d3f5-43b1-b137-798952926ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:36.433935 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc0fd4-d3f5-43b1-b137-798952926ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:36.434255 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc0fd4-d3f5-43b1-b137-798952926ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:36.434511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc0fd4-d3f5-43b1-b137-798952926ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:36.435490 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc0fd4-d3f5-43b1-b137-798952926ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:36.437110 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc0fd4-d3f5-43b1-b137-798952926ef2 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:36.446586 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1336/2719] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:36.450741 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666873a3-3327-47d0-80cd-b491ea4d8915 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:36.461951 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666873a3-3327-47d0-80cd-b491ea4d8915 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:36.466723 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f15e6d-2692-40d5-b5bf-53360485e296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:36.467621 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f15e6d-2692-40d5-b5bf-53360485e296 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:36.467901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f15e6d-2692-40d5-b5bf-53360485e296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:36.468199 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f15e6d-2692-40d5-b5bf-53360485e296 admin admin] PATH_INFO: `/v3/projects/f5a636e9521b42cfb037e202b242458d/users/c3fd10ff4bfb4126ae4cdae82b1d41e5/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:36.470272 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f15e6d-2692-40d5-b5bf-53360485e296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a636e9521b42cfb037e202b242458d, user_id=c3fd10ff4bfb4126ae4cdae82b1d41e5, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:36.473653 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f15e6d-2692-40d5-b5bf-53360485e296 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:36.484259 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1384/2720] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:36 2022] PUT /identity/v3/projects/f5a636e9521b42cfb037e202b242458d/users/c3fd10ff4bfb4126ae4cdae82b1d41e5/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:07:36.493951 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021f467-677c-499e-8e2c-e7d896cfacc4 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:36.494241 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021f467-677c-499e-8e2c-e7d896cfacc4 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:36.494517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021f467-677c-499e-8e2c-e7d896cfacc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:36.521454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-d021f467-677c-499e-8e2c-e7d896cfacc4 None None] MFA Rules not processed for user `c3fd10ff4bfb4126ae4cdae82b1d41e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:36.522639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d021f467-677c-499e-8e2c-e7d896cfacc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:36.588872 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1337/2721] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:36.600555 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f15e6d-2692-40d5-b5bf-53360485e296 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:36.602330 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e2f15e6d-2692-40d5-b5bf-53360485e296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:36.658442 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f15e6d-2692-40d5-b5bf-53360485e296 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:36.662723 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc8130-dee2-4f32-a149-08f70a32d520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:36.663356 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc8130-dee2-4f32-a149-08f70a32d520 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:36.663631 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc8130-dee2-4f32-a149-08f70a32d520 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:36.663904 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc8130-dee2-4f32-a149-08f70a32d520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:36.717175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc8130-dee2-4f32-a149-08f70a32d520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:36.718580 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc8130-dee2-4f32-a149-08f70a32d520 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:36.728010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1385/2722] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:38.081920 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021f467-677c-499e-8e2c-e7d896cfacc4 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:38.083495 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d021f467-677c-499e-8e2c-e7d896cfacc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:38.151631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021f467-677c-499e-8e2c-e7d896cfacc4 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:38.156736 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24880e01-0f47-4e21-85a9-cbc5a256e8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:38.157665 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880e01-0f47-4e21-85a9-cbc5a256e8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:38.158084 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880e01-0f47-4e21-85a9-cbc5a256e8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:38.158309 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880e01-0f47-4e21-85a9-cbc5a256e8ad admin admin] PATH_INFO: `/v3/users/a8039c05c28c44399f2a80c9d708b44b` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:38.159713 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24880e01-0f47-4e21-85a9-cbc5a256e8ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8039c05c28c44399f2a80c9d708b44b)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:38.162374 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24880e01-0f47-4e21-85a9-cbc5a256e8ad admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:38.211865 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-24880e01-0f47-4e21-85a9-cbc5a256e8ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8039c05c28c44399f2a80c9d708b44b'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:38.212556 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-24880e01-0f47-4e21-85a9-cbc5a256e8ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8039c05c28c44399f2a80c9d708b44b'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:38.238390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-24880e01-0f47-4e21-85a9-cbc5a256e8ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8039c05c28c44399f2a80c9d708b44b'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:38.250051 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-24880e01-0f47-4e21-85a9-cbc5a256e8ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8039c05c28c44399f2a80c9d708b44b'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:38.251105 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-24880e01-0f47-4e21-85a9-cbc5a256e8ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8039c05c28c44399f2a80c9d708b44b'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:38.266677 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1338/2723] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:07:38 2022] DELETE /identity/v3/users/a8039c05c28c44399f2a80c9d708b44b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:38.271814 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b6f64-fd1f-4ad1-b2dd-9a742683e422 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:38.272370 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b6f64-fd1f-4ad1-b2dd-9a742683e422 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:38.272691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b6f64-fd1f-4ad1-b2dd-9a742683e422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:38.289987 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-212b6f64-fd1f-4ad1-b2dd-9a742683e422 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:38.291249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-212b6f64-fd1f-4ad1-b2dd-9a742683e422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:38.349575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1386/2724] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:38.359327 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24880e01-0f47-4e21-85a9-cbc5a256e8ad admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:38.360970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-24880e01-0f47-4e21-85a9-cbc5a256e8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:38.419919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24880e01-0f47-4e21-85a9-cbc5a256e8ad admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:38.423585 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de6953-22ac-43cd-85ea-5b00987ccd58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:38.424266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de6953-22ac-43cd-85ea-5b00987ccd58 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:38.425178 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de6953-22ac-43cd-85ea-5b00987ccd58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:38.425462 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de6953-22ac-43cd-85ea-5b00987ccd58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:38.434666 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de6953-22ac-43cd-85ea-5b00987ccd58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:38.436262 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de6953-22ac-43cd-85ea-5b00987ccd58 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:38.445767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1339/2725] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:07:38.713676 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b6f64-fd1f-4ad1-b2dd-9a742683e422 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:38.715085 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-212b6f64-fd1f-4ad1-b2dd-9a742683e422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:38.728205 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b6f64-fd1f-4ad1-b2dd-9a742683e422 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:38.733194 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cef35-9474-4259-9d1b-3f249a8c607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:38.734109 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cef35-9474-4259-9d1b-3f249a8c607b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:38.734385 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cef35-9474-4259-9d1b-3f249a8c607b admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:38.734652 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cef35-9474-4259-9d1b-3f249a8c607b admin admin] PATH_INFO: `/v3/projects/18206a05672d4b198c11abf9305384c8` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:38.735965 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7cef35-9474-4259-9d1b-3f249a8c607b admin admin] RBAC: Authorizing `identity:delete_project(project_id=18206a05672d4b198c11abf9305384c8)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:38.737962 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7cef35-9474-4259-9d1b-3f249a8c607b admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:38.786580 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-ac7cef35-9474-4259-9d1b-3f249a8c607b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18206a05672d4b198c11abf9305384c8', 'request_id': 'req-ac7cef35-9474-4259-9d1b-3f249a8c607b'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:38.793855 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-ac7cef35-9474-4259-9d1b-3f249a8c607b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18206a05672d4b198c11abf9305384c8', 'request_id': 'req-ac7cef35-9474-4259-9d1b-3f249a8c607b'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:38.799434 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-ac7cef35-9474-4259-9d1b-3f249a8c607b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18206a05672d4b198c11abf9305384c8', 'request_id': 'req-ac7cef35-9474-4259-9d1b-3f249a8c607b'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:38.810308 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-ac7cef35-9474-4259-9d1b-3f249a8c607b admin admin] The token cache is being invalidate because project 18206a05672d4b198c11abf9305384c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:07:38.810612 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-ac7cef35-9474-4259-9d1b-3f249a8c607b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:38.811247 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-ac7cef35-9474-4259-9d1b-3f249a8c607b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:38.813182 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1387/2726] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:07:38 2022] DELETE /identity/v3/projects/18206a05672d4b198c11abf9305384c8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:07:38.818187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ff44f-fb36-469e-91a0-8461d33e04ca None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:38.818477 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ff44f-fb36-469e-91a0-8461d33e04ca None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:38.818758 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ff44f-fb36-469e-91a0-8461d33e04ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:38.836644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-f62ff44f-fb36-469e-91a0-8461d33e04ca None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:38.837871 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-f62ff44f-fb36-469e-91a0-8461d33e04ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:38.909819 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1340/2727] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:38.918465 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288782f5-9394-487e-ba9c-eab6dd0ef257 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:38.918753 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288782f5-9394-487e-ba9c-eab6dd0ef257 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:38.919027 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288782f5-9394-487e-ba9c-eab6dd0ef257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:38.938174 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-288782f5-9394-487e-ba9c-eab6dd0ef257 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:38.939394 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-288782f5-9394-487e-ba9c-eab6dd0ef257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:38.947508 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1388/2728] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:38.951823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ff44f-fb36-469e-91a0-8461d33e04ca None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:38.962268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ff44f-fb36-469e-91a0-8461d33e04ca None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:38.966835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969e20e-844a-4975-a49a-60eafc4b3c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:38.967498 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969e20e-844a-4975-a49a-60eafc4b3c33 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:38.967784 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969e20e-844a-4975-a49a-60eafc4b3c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:38.968052 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969e20e-844a-4975-a49a-60eafc4b3c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:38.968837 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969e20e-844a-4975-a49a-60eafc4b3c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:07:38.969140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969e20e-844a-4975-a49a-60eafc4b3c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:38.970753 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969e20e-844a-4975-a49a-60eafc4b3c33 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:38.987194 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1341/2729] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:07:38.988322 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288782f5-9394-487e-ba9c-eab6dd0ef257 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:38.997753 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288782f5-9394-487e-ba9c-eab6dd0ef257 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:39.002488 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6becaf-ad36-49ef-b2b3-89a48ee57777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:39.003187 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6becaf-ad36-49ef-b2b3-89a48ee57777 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:39.003467 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6becaf-ad36-49ef-b2b3-89a48ee57777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:39.003738 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6becaf-ad36-49ef-b2b3-89a48ee57777 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:39.004483 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6becaf-ad36-49ef-b2b3-89a48ee57777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:39.006391 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6becaf-ad36-49ef-b2b3-89a48ee57777 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:39.037418 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1389/2730] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:07:38 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:07:39.043121 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969e20e-844a-4975-a49a-60eafc4b3c33 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:39.053532 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969e20e-844a-4975-a49a-60eafc4b3c33 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:39.110057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d40b0-1db2-42df-8177-3902d9d7a44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:39.110827 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d40b0-1db2-42df-8177-3902d9d7a44e admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:39.111111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d40b0-1db2-42df-8177-3902d9d7a44e admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:39.111388 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d40b0-1db2-42df-8177-3902d9d7a44e admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:39.112111 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d40b0-1db2-42df-8177-3902d9d7a44e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:39.114069 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d40b0-1db2-42df-8177-3902d9d7a44e admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:39.135523 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1342/2731] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:07:39 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:39.139571 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6becaf-ad36-49ef-b2b3-89a48ee57777 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:39.150604 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6becaf-ad36-49ef-b2b3-89a48ee57777 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:39.155277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f588a-d5fa-4a15-a38d-12eaa245bc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:39.155936 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f588a-d5fa-4a15-a38d-12eaa245bc28 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:39.156253 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f588a-d5fa-4a15-a38d-12eaa245bc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:39.156533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f588a-d5fa-4a15-a38d-12eaa245bc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:39.157249 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f588a-d5fa-4a15-a38d-12eaa245bc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:39.158810 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f588a-d5fa-4a15-a38d-12eaa245bc28 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:39.169725 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1390/2732] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:39.173641 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d40b0-1db2-42df-8177-3902d9d7a44e admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:39.183660 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d40b0-1db2-42df-8177-3902d9d7a44e admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:39.188246 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2380b-091e-4608-9f46-b98613cda060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:39.188902 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2380b-091e-4608-9f46-b98613cda060 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:39.189183 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2380b-091e-4608-9f46-b98613cda060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:39.189455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2380b-091e-4608-9f46-b98613cda060 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:39.190706 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2380b-091e-4608-9f46-b98613cda060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:39.192313 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2380b-091e-4608-9f46-b98613cda060 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:39.202238 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1343/2733] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:39.206930 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f588a-d5fa-4a15-a38d-12eaa245bc28 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:39.216973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f588a-d5fa-4a15-a38d-12eaa245bc28 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:39.221613 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc69ea5-ab07-4efd-9192-3f6f620730e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:39.222511 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc69ea5-ab07-4efd-9192-3f6f620730e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:39.222784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc69ea5-ab07-4efd-9192-3f6f620730e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:39.223053 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc69ea5-ab07-4efd-9192-3f6f620730e9 admin admin] PATH_INFO: `/v3/projects/b7157fb0baf64740a7141cb5545791cf/users/61f3aab3b1b34519adfb0ee41bff7c7f/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:39.240895 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc69ea5-ab07-4efd-9192-3f6f620730e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7157fb0baf64740a7141cb5545791cf, user_id=61f3aab3b1b34519adfb0ee41bff7c7f, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:39.243523 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc69ea5-ab07-4efd-9192-3f6f620730e9 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:39.261411 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1391/2734] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:39 2022] PUT /identity/v3/projects/b7157fb0baf64740a7141cb5545791cf/users/61f3aab3b1b34519adfb0ee41bff7c7f/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:07:39.273012 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a2592-ff0a-4c69-ad02-86fecbd902be None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:39.273530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a2592-ff0a-4c69-ad02-86fecbd902be None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:39.273906 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a2592-ff0a-4c69-ad02-86fecbd902be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:39.300369 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-d94a2592-ff0a-4c69-ad02-86fecbd902be None None] MFA Rules not processed for user `61f3aab3b1b34519adfb0ee41bff7c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:39.301559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-d94a2592-ff0a-4c69-ad02-86fecbd902be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:39.369314 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1344/2735] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:39.381455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc69ea5-ab07-4efd-9192-3f6f620730e9 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:39.383433 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-4dc69ea5-ab07-4efd-9192-3f6f620730e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:39.444512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc69ea5-ab07-4efd-9192-3f6f620730e9 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:39.448193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47174d7b-28eb-4fa9-a518-adba4a34e9ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:39.448859 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47174d7b-28eb-4fa9-a518-adba4a34e9ae service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:39.449131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47174d7b-28eb-4fa9-a518-adba4a34e9ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:39.449516 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47174d7b-28eb-4fa9-a518-adba4a34e9ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:39.457776 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47174d7b-28eb-4fa9-a518-adba4a34e9ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:39.459179 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47174d7b-28eb-4fa9-a518-adba4a34e9ae service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:39.467919 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1392/2736] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:39.492857 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a2592-ff0a-4c69-ad02-86fecbd902be None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:39.554353 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a2592-ff0a-4c69-ad02-86fecbd902be None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:39.559014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d806790-e428-4cda-83b8-61681f6bf8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:39.559899 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d806790-e428-4cda-83b8-61681f6bf8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:39.560187 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d806790-e428-4cda-83b8-61681f6bf8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:39.560550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d806790-e428-4cda-83b8-61681f6bf8ee admin admin] PATH_INFO: `/v3/users/61f3aab3b1b34519adfb0ee41bff7c7f` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:39.561802 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d806790-e428-4cda-83b8-61681f6bf8ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f3aab3b1b34519adfb0ee41bff7c7f)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:39.563708 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d806790-e428-4cda-83b8-61681f6bf8ee admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:39.610336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4d806790-e428-4cda-83b8-61681f6bf8ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f3aab3b1b34519adfb0ee41bff7c7f'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:39.611049 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4d806790-e428-4cda-83b8-61681f6bf8ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f3aab3b1b34519adfb0ee41bff7c7f'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:39.623455 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4d806790-e428-4cda-83b8-61681f6bf8ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f3aab3b1b34519adfb0ee41bff7c7f'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:39.633502 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4d806790-e428-4cda-83b8-61681f6bf8ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f3aab3b1b34519adfb0ee41bff7c7f'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:39.634243 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4d806790-e428-4cda-83b8-61681f6bf8ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f3aab3b1b34519adfb0ee41bff7c7f'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:39.647119 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1345/2737] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:07:39 2022] DELETE /identity/v3/users/61f3aab3b1b34519adfb0ee41bff7c7f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:39.651605 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58f981-8a9e-4a3f-8fb8-fe33b65cf68c None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:39.652070 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58f981-8a9e-4a3f-8fb8-fe33b65cf68c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:39.652558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58f981-8a9e-4a3f-8fb8-fe33b65cf68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:39.669428 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-aa58f981-8a9e-4a3f-8fb8-fe33b65cf68c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:39.670675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-aa58f981-8a9e-4a3f-8fb8-fe33b65cf68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:39.728008 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1393/2738] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:39.738074 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d806790-e428-4cda-83b8-61681f6bf8ee admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:39.739499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-4d806790-e428-4cda-83b8-61681f6bf8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:39.797733 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d806790-e428-4cda-83b8-61681f6bf8ee admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:39.801944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a34eb-e7b1-49a4-88ca-abad9a058cf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:39.802581 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a34eb-e7b1-49a4-88ca-abad9a058cf3 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:39.802861 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a34eb-e7b1-49a4-88ca-abad9a058cf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:39.803137 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a34eb-e7b1-49a4-88ca-abad9a058cf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:39.812133 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a34eb-e7b1-49a4-88ca-abad9a058cf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:39.813573 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a34eb-e7b1-49a4-88ca-abad9a058cf3 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:39.822904 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1346/2739] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:40.108452 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58f981-8a9e-4a3f-8fb8-fe33b65cf68c None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:40.109890 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-aa58f981-8a9e-4a3f-8fb8-fe33b65cf68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:40.122545 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58f981-8a9e-4a3f-8fb8-fe33b65cf68c None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:40.128444 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eeb503-ba48-42f3-925f-818118b4f0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:40.129413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeb503-ba48-42f3-925f-818118b4f0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:40.129752 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeb503-ba48-42f3-925f-818118b4f0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:40.130112 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeb503-ba48-42f3-925f-818118b4f0eb admin admin] PATH_INFO: `/v3/projects/b7157fb0baf64740a7141cb5545791cf` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:40.131442 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eeb503-ba48-42f3-925f-818118b4f0eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7157fb0baf64740a7141cb5545791cf)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:40.133527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eeb503-ba48-42f3-925f-818118b4f0eb admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:40.181901 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-18eeb503-ba48-42f3-925f-818118b4f0eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7157fb0baf64740a7141cb5545791cf', 'request_id': 'req-18eeb503-ba48-42f3-925f-818118b4f0eb'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:40.190089 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-18eeb503-ba48-42f3-925f-818118b4f0eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7157fb0baf64740a7141cb5545791cf', 'request_id': 'req-18eeb503-ba48-42f3-925f-818118b4f0eb'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:40.196264 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-18eeb503-ba48-42f3-925f-818118b4f0eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7157fb0baf64740a7141cb5545791cf', 'request_id': 'req-18eeb503-ba48-42f3-925f-818118b4f0eb'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:40.208194 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-18eeb503-ba48-42f3-925f-818118b4f0eb admin admin] The token cache is being invalidate because project b7157fb0baf64740a7141cb5545791cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:07:40.208567 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-18eeb503-ba48-42f3-925f-818118b4f0eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:40.209209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-18eeb503-ba48-42f3-925f-818118b4f0eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:40.210752 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1394/2740] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:07:40 2022] DELETE /identity/v3/projects/b7157fb0baf64740a7141cb5545791cf => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:40.215763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f0277-448d-42e9-adad-ce8929d30a95 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:40.216290 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f0277-448d-42e9-adad-ce8929d30a95 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:40.216430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f0277-448d-42e9-adad-ce8929d30a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:40.234069 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-940f0277-448d-42e9-adad-ce8929d30a95 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:40.235268 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-940f0277-448d-42e9-adad-ce8929d30a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:40.300430 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1347/2741] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:07:40.302468 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbb11f-6f85-4721-a64e-706e3f0a0cf1 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:40.302758 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbb11f-6f85-4721-a64e-706e3f0a0cf1 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:40.303075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbb11f-6f85-4721-a64e-706e3f0a0cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:40.326831 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-2edbb11f-6f85-4721-a64e-706e3f0a0cf1 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:40.328017 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-2edbb11f-6f85-4721-a64e-706e3f0a0cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:40.336027 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1395/2742] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:40.340343 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f0277-448d-42e9-adad-ce8929d30a95 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:40.349889 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f0277-448d-42e9-adad-ce8929d30a95 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:40.354530 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4fa12-cf43-46e6-b965-5e1190a585f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:40.355181 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4fa12-cf43-46e6-b965-5e1190a585f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:40.355460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4fa12-cf43-46e6-b965-5e1190a585f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:40.355733 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4fa12-cf43-46e6-b965-5e1190a585f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:40.356483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4fa12-cf43-46e6-b965-5e1190a585f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:07:40.356789 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4fa12-cf43-46e6-b965-5e1190a585f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:40.358389 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4fa12-cf43-46e6-b965-5e1190a585f9 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:40.371320 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1348/2743] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:07:40.375369 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbb11f-6f85-4721-a64e-706e3f0a0cf1 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:40.385248 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbb11f-6f85-4721-a64e-706e3f0a0cf1 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:40.390742 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d79d9-a6d2-4bde-aae4-61cefa748d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:40.391883 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d79d9-a6d2-4bde-aae4-61cefa748d93 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:40.392183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d79d9-a6d2-4bde-aae4-61cefa748d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:40.392480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d79d9-a6d2-4bde-aae4-61cefa748d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:40.393287 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d79d9-a6d2-4bde-aae4-61cefa748d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:40.395324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d79d9-a6d2-4bde-aae4-61cefa748d93 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:40.422543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1396/2744] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:07:40 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:40.426998 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4fa12-cf43-46e6-b965-5e1190a585f9 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:40.436900 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4fa12-cf43-46e6-b965-5e1190a585f9 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:40.501190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139c3ee-bd13-4b3d-acf2-faa316e32a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:40.502266 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139c3ee-bd13-4b3d-acf2-faa316e32a72 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:40.503287 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139c3ee-bd13-4b3d-acf2-faa316e32a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:40.503727 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139c3ee-bd13-4b3d-acf2-faa316e32a72 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:40.504624 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139c3ee-bd13-4b3d-acf2-faa316e32a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:40.506800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139c3ee-bd13-4b3d-acf2-faa316e32a72 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:40.528672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1349/2745] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:07:40 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:07:40.533377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d79d9-a6d2-4bde-aae4-61cefa748d93 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:40.548347 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d79d9-a6d2-4bde-aae4-61cefa748d93 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:40.553675 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e860e7-c186-4cf1-a136-791141511343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:40.554394 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e860e7-c186-4cf1-a136-791141511343 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:40.554679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e860e7-c186-4cf1-a136-791141511343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:40.554952 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e860e7-c186-4cf1-a136-791141511343 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:40.555812 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e860e7-c186-4cf1-a136-791141511343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:40.557443 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e860e7-c186-4cf1-a136-791141511343 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:40.569350 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1397/2746] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:40.572614 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139c3ee-bd13-4b3d-acf2-faa316e32a72 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:40.582474 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139c3ee-bd13-4b3d-acf2-faa316e32a72 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:40.587216 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59318bce-3b65-47f4-836b-b9786c1bb603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:40.587963 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59318bce-3b65-47f4-836b-b9786c1bb603 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:40.588450 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59318bce-3b65-47f4-836b-b9786c1bb603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:40.588895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59318bce-3b65-47f4-836b-b9786c1bb603 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:40.589774 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59318bce-3b65-47f4-836b-b9786c1bb603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:40.591534 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59318bce-3b65-47f4-836b-b9786c1bb603 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:40.602547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1350/2747] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:07:40.606789 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e860e7-c186-4cf1-a136-791141511343 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:40.617489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e860e7-c186-4cf1-a136-791141511343 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:40.622896 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cf2ef-fed9-4b7f-b9e8-f550f8a3d987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:40.623779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cf2ef-fed9-4b7f-b9e8-f550f8a3d987 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:40.624076 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cf2ef-fed9-4b7f-b9e8-f550f8a3d987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:40.624379 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cf2ef-fed9-4b7f-b9e8-f550f8a3d987 admin admin] PATH_INFO: `/v3/projects/a2a2e2e6222f48ebae4e9f9d7e9e8a4d/users/2afab5deb8c34f058c659a22a3402c59/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:40.640637 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cf2ef-fed9-4b7f-b9e8-f550f8a3d987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a2e2e6222f48ebae4e9f9d7e9e8a4d, user_id=2afab5deb8c34f058c659a22a3402c59, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:40.643632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cf2ef-fed9-4b7f-b9e8-f550f8a3d987 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:40.662787 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1398/2748] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:40 2022] PUT /identity/v3/projects/a2a2e2e6222f48ebae4e9f9d7e9e8a4d/users/2afab5deb8c34f058c659a22a3402c59/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:40.668515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c839f9-1095-4433-99c1-ebe7650708c5 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:40.668803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c839f9-1095-4433-99c1-ebe7650708c5 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:40.669082 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c839f9-1095-4433-99c1-ebe7650708c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:40.688293 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-06c839f9-1095-4433-99c1-ebe7650708c5 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:40.689625 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-06c839f9-1095-4433-99c1-ebe7650708c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:40.761929 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1351/2749] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:40.772446 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cf2ef-fed9-4b7f-b9e8-f550f8a3d987 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:40.774400 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-226cf2ef-fed9-4b7f-b9e8-f550f8a3d987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:40.832959 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cf2ef-fed9-4b7f-b9e8-f550f8a3d987 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:40.837326 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34507212-7ca5-4b67-92b8-9c764cb1e54c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:40.837978 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34507212-7ca5-4b67-92b8-9c764cb1e54c service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:40.838258 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34507212-7ca5-4b67-92b8-9c764cb1e54c service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:40.838533 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34507212-7ca5-4b67-92b8-9c764cb1e54c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:40.848373 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34507212-7ca5-4b67-92b8-9c764cb1e54c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:40.849802 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34507212-7ca5-4b67-92b8-9c764cb1e54c service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:40.860394 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1399/2750] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:41.508600 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edccba6-055b-4e79-abf6-795a3a699e6c None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:41.509148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edccba6-055b-4e79-abf6-795a3a699e6c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:41.509148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edccba6-055b-4e79-abf6-795a3a699e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:41.538380 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-6edccba6-055b-4e79-abf6-795a3a699e6c None None] MFA Rules not processed for user `2afab5deb8c34f058c659a22a3402c59`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:41.540061 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-6edccba6-055b-4e79-abf6-795a3a699e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:41.627390 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1352/2751] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:41.640827 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34507212-7ca5-4b67-92b8-9c764cb1e54c service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:41.642929 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-34507212-7ca5-4b67-92b8-9c764cb1e54c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:41.697903 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34507212-7ca5-4b67-92b8-9c764cb1e54c service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:41.701388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccbcaf-db70-47cd-a98e-4af017e27c66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:41.702018 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccbcaf-db70-47cd-a98e-4af017e27c66 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:41.702294 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccbcaf-db70-47cd-a98e-4af017e27c66 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:41.702561 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccbcaf-db70-47cd-a98e-4af017e27c66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:41.710582 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccbcaf-db70-47cd-a98e-4af017e27c66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:41.711967 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccbcaf-db70-47cd-a98e-4af017e27c66 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:41.720579 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1400/2752] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:44.435340 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edccba6-055b-4e79-abf6-795a3a699e6c None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:44.436778 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-6edccba6-055b-4e79-abf6-795a3a699e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:44.449132 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edccba6-055b-4e79-abf6-795a3a699e6c None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:44.452663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12822c9a-9db8-44d5-97c4-8478d8e1e8d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:44.453288 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12822c9a-9db8-44d5-97c4-8478d8e1e8d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:44.453567 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12822c9a-9db8-44d5-97c4-8478d8e1e8d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:44.453839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12822c9a-9db8-44d5-97c4-8478d8e1e8d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:44.455515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-12822c9a-9db8-44d5-97c4-8478d8e1e8d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:44.514264 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12822c9a-9db8-44d5-97c4-8478d8e1e8d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:44.515673 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12822c9a-9db8-44d5-97c4-8478d8e1e8d7 service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:44.525684 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1353/2753] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:45.140393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb550d-ed91-41cb-b61b-ae9112328dc1 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:45.140914 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb550d-ed91-41cb-b61b-ae9112328dc1 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:45.140914 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb550d-ed91-41cb-b61b-ae9112328dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:45.159151 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-74bb550d-ed91-41cb-b61b-ae9112328dc1 None None] MFA Rules not processed for user `2afab5deb8c34f058c659a22a3402c59`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:45.160372 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-74bb550d-ed91-41cb-b61b-ae9112328dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:45.167294 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1401/2754] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:51.276715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12822c9a-9db8-44d5-97c4-8478d8e1e8d7 service cinder] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:51.278115 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-12822c9a-9db8-44d5-97c4-8478d8e1e8d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:51.291622 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12822c9a-9db8-44d5-97c4-8478d8e1e8d7 service cinder] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:51.296081 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc21920-011b-4427-9d30-a8b1306645cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:51.296966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc21920-011b-4427-9d30-a8b1306645cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:51.297248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc21920-011b-4427-9d30-a8b1306645cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:51.297524 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc21920-011b-4427-9d30-a8b1306645cf admin admin] PATH_INFO: `/v3/users/8c91278195ea4a91b999f2a9fa628b88` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:51.298701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc21920-011b-4427-9d30-a8b1306645cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c91278195ea4a91b999f2a9fa628b88)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:51.301301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc21920-011b-4427-9d30-a8b1306645cf admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:51.345911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-3fc21920-011b-4427-9d30-a8b1306645cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c91278195ea4a91b999f2a9fa628b88'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:51.346550 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-3fc21920-011b-4427-9d30-a8b1306645cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c91278195ea4a91b999f2a9fa628b88'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:51.358877 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-3fc21920-011b-4427-9d30-a8b1306645cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c91278195ea4a91b999f2a9fa628b88'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:51.366714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-3fc21920-011b-4427-9d30-a8b1306645cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c91278195ea4a91b999f2a9fa628b88'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:51.367611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-3fc21920-011b-4427-9d30-a8b1306645cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c91278195ea4a91b999f2a9fa628b88'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:51.380732 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1354/2755] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:07:51 2022] DELETE /identity/v3/users/8c91278195ea4a91b999f2a9fa628b88 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:51.385846 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb48256-f6a3-4ecc-bb0a-b8954270b0d0 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:51.386225 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb48256-f6a3-4ecc-bb0a-b8954270b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:51.386330 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb48256-f6a3-4ecc-bb0a-b8954270b0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:51.410632 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-cfb48256-f6a3-4ecc-bb0a-b8954270b0d0 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:51.412217 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cfb48256-f6a3-4ecc-bb0a-b8954270b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:51.471890 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1402/2756] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:51.481511 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc21920-011b-4427-9d30-a8b1306645cf admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:51.482966 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-3fc21920-011b-4427-9d30-a8b1306645cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:51.539162 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc21920-011b-4427-9d30-a8b1306645cf admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:51.542824 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed30537-aa82-4f58-9003-585ffcf87bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:51.543454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed30537-aa82-4f58-9003-585ffcf87bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:51.543730 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed30537-aa82-4f58-9003-585ffcf87bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:51.544006 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed30537-aa82-4f58-9003-585ffcf87bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:51.553308 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed30537-aa82-4f58-9003-585ffcf87bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:51.554709 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed30537-aa82-4f58-9003-585ffcf87bc9 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:51.563835 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1355/2757] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:51.824865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb48256-f6a3-4ecc-bb0a-b8954270b0d0 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:51.826315 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cfb48256-f6a3-4ecc-bb0a-b8954270b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:51.838676 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb48256-f6a3-4ecc-bb0a-b8954270b0d0 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:51.843292 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1aa3ec-2450-43c5-9c5f-82e1bee98df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:51.844156 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aa3ec-2450-43c5-9c5f-82e1bee98df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:51.844463 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aa3ec-2450-43c5-9c5f-82e1bee98df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:51.844739 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aa3ec-2450-43c5-9c5f-82e1bee98df1 admin admin] PATH_INFO: `/v3/projects/b07e47f2bc3f455683e16c9f4ab1bf22` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:51.845924 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1aa3ec-2450-43c5-9c5f-82e1bee98df1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07e47f2bc3f455683e16c9f4ab1bf22)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:51.848154 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1aa3ec-2450-43c5-9c5f-82e1bee98df1 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:51.893773 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2a1aa3ec-2450-43c5-9c5f-82e1bee98df1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07e47f2bc3f455683e16c9f4ab1bf22', 'request_id': 'req-2a1aa3ec-2450-43c5-9c5f-82e1bee98df1'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:51.899914 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2a1aa3ec-2450-43c5-9c5f-82e1bee98df1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07e47f2bc3f455683e16c9f4ab1bf22', 'request_id': 'req-2a1aa3ec-2450-43c5-9c5f-82e1bee98df1'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:51.905130 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2a1aa3ec-2450-43c5-9c5f-82e1bee98df1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07e47f2bc3f455683e16c9f4ab1bf22', 'request_id': 'req-2a1aa3ec-2450-43c5-9c5f-82e1bee98df1'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:51.915796 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2a1aa3ec-2450-43c5-9c5f-82e1bee98df1 admin admin] The token cache is being invalidate because project b07e47f2bc3f455683e16c9f4ab1bf22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:07:51.916084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2a1aa3ec-2450-43c5-9c5f-82e1bee98df1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:51.916743 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2a1aa3ec-2450-43c5-9c5f-82e1bee98df1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:07:51.918320 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1403/2758] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:07:51 2022] DELETE /identity/v3/projects/b07e47f2bc3f455683e16c9f4ab1bf22 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:07:51.923114 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8da19f-e63f-4119-97da-64d66707df25 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:51.923398 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8da19f-e63f-4119-97da-64d66707df25 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:51.923673 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8da19f-e63f-4119-97da-64d66707df25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:51.941604 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-df8da19f-e63f-4119-97da-64d66707df25 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:51.942786 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-df8da19f-e63f-4119-97da-64d66707df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:51.999117 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1356/2759] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:52.007207 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5fc18-3f0d-4753-9d0c-80c7957bb23b None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:52.007493 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5fc18-3f0d-4753-9d0c-80c7957bb23b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:52.007771 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5fc18-3f0d-4753-9d0c-80c7957bb23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:52.028455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-adc5fc18-3f0d-4753-9d0c-80c7957bb23b None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:52.029646 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-adc5fc18-3f0d-4753-9d0c-80c7957bb23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:52.039282 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1404/2760] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:07:52.043594 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8da19f-e63f-4119-97da-64d66707df25 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:52.053083 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8da19f-e63f-4119-97da-64d66707df25 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:52.057838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168355c6-e799-4c4f-94ff-c181f0ea763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:52.058483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168355c6-e799-4c4f-94ff-c181f0ea763d admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:52.058767 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168355c6-e799-4c4f-94ff-c181f0ea763d admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:52.059044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168355c6-e799-4c4f-94ff-c181f0ea763d admin admin] PATH_INFO: `/v3/domains` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:52.059762 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168355c6-e799-4c4f-94ff-c181f0ea763d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79925) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:07:52.060070 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168355c6-e799-4c4f-94ff-c181f0ea763d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:52.061793 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168355c6-e799-4c4f-94ff-c181f0ea763d admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:52.073672 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1357/2761] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:07:52.077906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5fc18-3f0d-4753-9d0c-80c7957bb23b None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:52.087510 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5fc18-3f0d-4753-9d0c-80c7957bb23b None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:52.092196 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86fc06-21af-4110-a765-fa3fdede1138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:52.092833 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86fc06-21af-4110-a765-fa3fdede1138 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:52.093113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86fc06-21af-4110-a765-fa3fdede1138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:52.093386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86fc06-21af-4110-a765-fa3fdede1138 admin admin] PATH_INFO: `/v3/projects` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:52.094060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86fc06-21af-4110-a765-fa3fdede1138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:52.095922 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86fc06-21af-4110-a765-fa3fdede1138 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:52.121148 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1405/2762] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:07:52 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:52.125481 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168355c6-e799-4c4f-94ff-c181f0ea763d admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:52.135730 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168355c6-e799-4c4f-94ff-c181f0ea763d admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:52.190287 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de06598-8be7-489a-944e-7723e0400ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:52.190944 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de06598-8be7-489a-944e-7723e0400ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:52.191224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de06598-8be7-489a-944e-7723e0400ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:52.191498 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de06598-8be7-489a-944e-7723e0400ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:52.192222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de06598-8be7-489a-944e-7723e0400ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:52.194128 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de06598-8be7-489a-944e-7723e0400ff3 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:52.212589 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1358/2763] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:07:52 2022] POST /identity/v3/users => generated 282 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:07:52.216744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86fc06-21af-4110-a765-fa3fdede1138 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:52.229254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86fc06-21af-4110-a765-fa3fdede1138 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:52.236202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90d4a0-6757-45b9-8c03-81e6a54126b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:52.238691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90d4a0-6757-45b9-8c03-81e6a54126b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:52.238691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90d4a0-6757-45b9-8c03-81e6a54126b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:52.238691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90d4a0-6757-45b9-8c03-81e6a54126b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:52.238691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90d4a0-6757-45b9-8c03-81e6a54126b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:52.239706 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90d4a0-6757-45b9-8c03-81e6a54126b4 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:52.250260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1406/2764] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:52.254395 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de06598-8be7-489a-944e-7723e0400ff3 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:52.264021 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de06598-8be7-489a-944e-7723e0400ff3 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:52.269431 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767faffe-aa8e-46bc-99b8-7ded0a13009c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:52.270068 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767faffe-aa8e-46bc-99b8-7ded0a13009c admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:52.270345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767faffe-aa8e-46bc-99b8-7ded0a13009c admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:52.270617 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767faffe-aa8e-46bc-99b8-7ded0a13009c admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:52.271324 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767faffe-aa8e-46bc-99b8-7ded0a13009c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:52.272930 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767faffe-aa8e-46bc-99b8-7ded0a13009c admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:52.285014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1359/2765] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:07:52.289051 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90d4a0-6757-45b9-8c03-81e6a54126b4 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:52.298709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90d4a0-6757-45b9-8c03-81e6a54126b4 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:52.303240 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32004f9-28f7-4c4e-a312-3093fa864729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:52.304103 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32004f9-28f7-4c4e-a312-3093fa864729 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:52.304415 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32004f9-28f7-4c4e-a312-3093fa864729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:52.304692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32004f9-28f7-4c4e-a312-3093fa864729 admin admin] PATH_INFO: `/v3/projects/b75bf53b4f3a4b86a8240ee8b2df8e48/users/fc0bd19faf4649178f2d918f70e5270c/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:52.318437 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32004f9-28f7-4c4e-a312-3093fa864729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75bf53b4f3a4b86a8240ee8b2df8e48, user_id=fc0bd19faf4649178f2d918f70e5270c, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:52.321086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32004f9-28f7-4c4e-a312-3093fa864729 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:52.333616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1407/2766] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:07:52 2022] PUT /identity/v3/projects/b75bf53b4f3a4b86a8240ee8b2df8e48/users/fc0bd19faf4649178f2d918f70e5270c/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:07:52.344361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271ee8d-34e4-40ef-96b3-8626fd8d0294 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:52.344634 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271ee8d-34e4-40ef-96b3-8626fd8d0294 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:52.344909 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271ee8d-34e4-40ef-96b3-8626fd8d0294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:52.370300 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-9271ee8d-34e4-40ef-96b3-8626fd8d0294 None None] MFA Rules not processed for user `fc0bd19faf4649178f2d918f70e5270c`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:07:52.371473 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-9271ee8d-34e4-40ef-96b3-8626fd8d0294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:52.433699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1360/2767] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:07:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:07:52.444960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32004f9-28f7-4c4e-a312-3093fa864729 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:52.446664 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-c32004f9-28f7-4c4e-a312-3093fa864729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:52.502860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32004f9-28f7-4c4e-a312-3093fa864729 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:52.506447 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88d7b8-c396-42f9-80d5-96e7aa92bfc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:52.507077 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88d7b8-c396-42f9-80d5-96e7aa92bfc6 service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:52.507370 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88d7b8-c396-42f9-80d5-96e7aa92bfc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:52.507626 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88d7b8-c396-42f9-80d5-96e7aa92bfc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:52.515759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88d7b8-c396-42f9-80d5-96e7aa92bfc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:52.517441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88d7b8-c396-42f9-80d5-96e7aa92bfc6 service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:52.525960 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1408/2768] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:07:59.141286 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271ee8d-34e4-40ef-96b3-8626fd8d0294 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:07:59.142658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-9271ee8d-34e4-40ef-96b3-8626fd8d0294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:59.210251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271ee8d-34e4-40ef-96b3-8626fd8d0294 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:07:59.215917 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac90f2-da88-47ff-94ca-1356b85dbe30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8a29487b009419dbead4684bcd01cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:07:59.216650 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac90f2-da88-47ff-94ca-1356b85dbe30 service placement] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:07:59.216942 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac90f2-da88-47ff-94ca-1356b85dbe30 service placement] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:07:59.217224 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac90f2-da88-47ff-94ca-1356b85dbe30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:07:59.219046 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b0ac90f2-da88-47ff-94ca-1356b85dbe30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:07:59.233164 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac90f2-da88-47ff-94ca-1356b85dbe30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:07:59.234748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac90f2-da88-47ff-94ca-1356b85dbe30 service placement] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:07:59.245245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1361/2769] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:07:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:08:10.431373 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88d7b8-c396-42f9-80d5-96e7aa92bfc6 service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:10.432802 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-6a88d7b8-c396-42f9-80d5-96e7aa92bfc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:10.496780 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88d7b8-c396-42f9-80d5-96e7aa92bfc6 service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:10.501961 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf64e0-ec51-443b-a0da-416761b92199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:10.502837 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf64e0-ec51-443b-a0da-416761b92199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:10.503115 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf64e0-ec51-443b-a0da-416761b92199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:10.503388 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf64e0-ec51-443b-a0da-416761b92199 admin admin] PATH_INFO: `/v3/users/9cf385966ccf42999b6a34a3674ab2a4` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:10.505196 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf64e0-ec51-443b-a0da-416761b92199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf385966ccf42999b6a34a3674ab2a4)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:10.507546 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf64e0-ec51-443b-a0da-416761b92199 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:10.563591 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9ebf64e0-ec51-443b-a0da-416761b92199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf385966ccf42999b6a34a3674ab2a4'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:10.577102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9ebf64e0-ec51-443b-a0da-416761b92199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf385966ccf42999b6a34a3674ab2a4'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:10.584835 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9ebf64e0-ec51-443b-a0da-416761b92199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf385966ccf42999b6a34a3674ab2a4'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:10.585547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9ebf64e0-ec51-443b-a0da-416761b92199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf385966ccf42999b6a34a3674ab2a4'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:10.592893 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9ebf64e0-ec51-443b-a0da-416761b92199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf385966ccf42999b6a34a3674ab2a4'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:10.599509 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1409/2770] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:08:10 2022] DELETE /identity/v3/users/9cf385966ccf42999b6a34a3674ab2a4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:10.603964 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28fee0-095a-4174-8b73-40d8321d086d None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:10.604484 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28fee0-095a-4174-8b73-40d8321d086d None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:10.604594 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28fee0-095a-4174-8b73-40d8321d086d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:10.621592 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-af28fee0-095a-4174-8b73-40d8321d086d None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:10.622773 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-af28fee0-095a-4174-8b73-40d8321d086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:10.681689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1362/2771] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:08:10.691193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf64e0-ec51-443b-a0da-416761b92199 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:10.692640 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-9ebf64e0-ec51-443b-a0da-416761b92199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:10.754373 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf64e0-ec51-443b-a0da-416761b92199 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:10.758039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07c692-25f4-4d59-9188-4348d62b93ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:10.758679 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07c692-25f4-4d59-9188-4348d62b93ff service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:10.758963 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07c692-25f4-4d59-9188-4348d62b93ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:10.759237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07c692-25f4-4d59-9188-4348d62b93ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:10.768606 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07c692-25f4-4d59-9188-4348d62b93ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:10.770040 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07c692-25f4-4d59-9188-4348d62b93ff service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:10.779987 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1410/2772] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:08:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:08:11.049474 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28fee0-095a-4174-8b73-40d8321d086d None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:11.050901 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-af28fee0-095a-4174-8b73-40d8321d086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:11.062620 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28fee0-095a-4174-8b73-40d8321d086d None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:11.068122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9d2a8-84e8-450a-850a-ee563a534366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:11.069091 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9d2a8-84e8-450a-850a-ee563a534366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:11.069373 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9d2a8-84e8-450a-850a-ee563a534366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:11.069639 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9d2a8-84e8-450a-850a-ee563a534366 admin admin] PATH_INFO: `/v3/projects/eae1c652fe6e40f2a92650d2702d3f9e` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:11.071113 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9d2a8-84e8-450a-850a-ee563a534366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eae1c652fe6e40f2a92650d2702d3f9e)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:11.073155 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9d2a8-84e8-450a-850a-ee563a534366 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:11.119229 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fab9d2a8-84e8-450a-850a-ee563a534366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eae1c652fe6e40f2a92650d2702d3f9e', 'request_id': 'req-fab9d2a8-84e8-450a-850a-ee563a534366'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:11.124408 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fab9d2a8-84e8-450a-850a-ee563a534366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eae1c652fe6e40f2a92650d2702d3f9e', 'request_id': 'req-fab9d2a8-84e8-450a-850a-ee563a534366'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:11.130911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fab9d2a8-84e8-450a-850a-ee563a534366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eae1c652fe6e40f2a92650d2702d3f9e', 'request_id': 'req-fab9d2a8-84e8-450a-850a-ee563a534366'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:11.143033 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fab9d2a8-84e8-450a-850a-ee563a534366 admin admin] The token cache is being invalidate because project eae1c652fe6e40f2a92650d2702d3f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:08:11.143319 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fab9d2a8-84e8-450a-850a-ee563a534366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:11.143932 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fab9d2a8-84e8-450a-850a-ee563a534366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:11.146162 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1363/2773] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:08:11 2022] DELETE /identity/v3/projects/eae1c652fe6e40f2a92650d2702d3f9e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:11.150175 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07c692-25f4-4d59-9188-4348d62b93ff service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:11.159535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07c692-25f4-4d59-9188-4348d62b93ff service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:11.214106 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92383d00-7cc8-404d-b2f6-bb49c012c7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:11.214973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92383d00-7cc8-404d-b2f6-bb49c012c7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:11.215253 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92383d00-7cc8-404d-b2f6-bb49c012c7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:11.215525 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92383d00-7cc8-404d-b2f6-bb49c012c7d4 admin admin] PATH_INFO: `/v3/users/c3fd10ff4bfb4126ae4cdae82b1d41e5` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:11.216720 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92383d00-7cc8-404d-b2f6-bb49c012c7d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3fd10ff4bfb4126ae4cdae82b1d41e5)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:11.218659 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92383d00-7cc8-404d-b2f6-bb49c012c7d4 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:11.264816 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-92383d00-7cc8-404d-b2f6-bb49c012c7d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3fd10ff4bfb4126ae4cdae82b1d41e5'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:11.276804 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-92383d00-7cc8-404d-b2f6-bb49c012c7d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3fd10ff4bfb4126ae4cdae82b1d41e5'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:11.283481 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-92383d00-7cc8-404d-b2f6-bb49c012c7d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3fd10ff4bfb4126ae4cdae82b1d41e5'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:11.284190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-92383d00-7cc8-404d-b2f6-bb49c012c7d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3fd10ff4bfb4126ae4cdae82b1d41e5'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:11.291550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-92383d00-7cc8-404d-b2f6-bb49c012c7d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3fd10ff4bfb4126ae4cdae82b1d41e5'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:11.298033 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1411/2774] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:08:11 2022] DELETE /identity/v3/users/c3fd10ff4bfb4126ae4cdae82b1d41e5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:11.578865 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9d2a8-84e8-450a-850a-ee563a534366 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:11.582100 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-fab9d2a8-84e8-450a-850a-ee563a534366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:11.606881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9d2a8-84e8-450a-850a-ee563a534366 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:11.677486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0740ca-118a-4cc5-ae56-d8f87e2a1a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:11.678241 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0740ca-118a-4cc5-ae56-d8f87e2a1a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:11.678516 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0740ca-118a-4cc5-ae56-d8f87e2a1a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:11.678783 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0740ca-118a-4cc5-ae56-d8f87e2a1a83 admin admin] PATH_INFO: `/v3/projects/f5a636e9521b42cfb037e202b242458d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:11.679970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0740ca-118a-4cc5-ae56-d8f87e2a1a83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a636e9521b42cfb037e202b242458d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:11.682007 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0740ca-118a-4cc5-ae56-d8f87e2a1a83 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:11.735593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-1e0740ca-118a-4cc5-ae56-d8f87e2a1a83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a636e9521b42cfb037e202b242458d', 'request_id': 'req-1e0740ca-118a-4cc5-ae56-d8f87e2a1a83'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:11.740884 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-1e0740ca-118a-4cc5-ae56-d8f87e2a1a83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a636e9521b42cfb037e202b242458d', 'request_id': 'req-1e0740ca-118a-4cc5-ae56-d8f87e2a1a83'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:11.747484 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-1e0740ca-118a-4cc5-ae56-d8f87e2a1a83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a636e9521b42cfb037e202b242458d', 'request_id': 'req-1e0740ca-118a-4cc5-ae56-d8f87e2a1a83'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:11.763686 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-1e0740ca-118a-4cc5-ae56-d8f87e2a1a83 admin admin] The token cache is being invalidate because project f5a636e9521b42cfb037e202b242458d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:08:11.763984 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-1e0740ca-118a-4cc5-ae56-d8f87e2a1a83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:11.765348 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-1e0740ca-118a-4cc5-ae56-d8f87e2a1a83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:11.767354 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1364/2775] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:08:11 2022] DELETE /identity/v3/projects/f5a636e9521b42cfb037e202b242458d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:11.772998 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18964e74-bf05-4f52-9729-2c750326be6b None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:11.773891 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18964e74-bf05-4f52-9729-2c750326be6b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:11.774180 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18964e74-bf05-4f52-9729-2c750326be6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:11.793636 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-18964e74-bf05-4f52-9729-2c750326be6b None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:11.795095 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-18964e74-bf05-4f52-9729-2c750326be6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:11.869393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1412/2776] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:08:11.878029 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d112cb-9381-494b-b0f3-a617f7825aa0 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:11.878308 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d112cb-9381-494b-b0f3-a617f7825aa0 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:11.878803 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d112cb-9381-494b-b0f3-a617f7825aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:11.898915 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-34d112cb-9381-494b-b0f3-a617f7825aa0 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:11.900107 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-34d112cb-9381-494b-b0f3-a617f7825aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:11.908132 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1365/2777] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:08:11.912659 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18964e74-bf05-4f52-9729-2c750326be6b None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:11.922468 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18964e74-bf05-4f52-9729-2c750326be6b None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:11.927756 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fc771-c525-4e94-b6b5-f46fa0460cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:11.928506 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fc771-c525-4e94-b6b5-f46fa0460cbb admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:11.928796 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fc771-c525-4e94-b6b5-f46fa0460cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:11.929074 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fc771-c525-4e94-b6b5-f46fa0460cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:11.929826 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fc771-c525-4e94-b6b5-f46fa0460cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:08:11.930138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fc771-c525-4e94-b6b5-f46fa0460cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:11.931771 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fc771-c525-4e94-b6b5-f46fa0460cbb admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:11.946080 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1413/2778] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:08:11.950336 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d112cb-9381-494b-b0f3-a617f7825aa0 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:11.960250 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d112cb-9381-494b-b0f3-a617f7825aa0 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:11.965052 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66922486-a25e-402e-b597-17f5951696a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:11.965700 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66922486-a25e-402e-b597-17f5951696a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:11.965976 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66922486-a25e-402e-b597-17f5951696a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:11.966248 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66922486-a25e-402e-b597-17f5951696a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:11.966933 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66922486-a25e-402e-b597-17f5951696a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:11.968956 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66922486-a25e-402e-b597-17f5951696a4 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:12.001576 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1366/2779] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:08:11 2022] POST /identity/v3/projects => generated 401 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:08:12.008230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fc771-c525-4e94-b6b5-f46fa0460cbb admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:12.023809 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fc771-c525-4e94-b6b5-f46fa0460cbb admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:12.092955 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1281aa-21f6-454d-89a8-02e4ecf53cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:12.093633 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1281aa-21f6-454d-89a8-02e4ecf53cfb admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:12.093969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1281aa-21f6-454d-89a8-02e4ecf53cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:12.094243 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1281aa-21f6-454d-89a8-02e4ecf53cfb admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:12.095011 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1281aa-21f6-454d-89a8-02e4ecf53cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:12.097148 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1281aa-21f6-454d-89a8-02e4ecf53cfb admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:12.116312 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1414/2780] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:08:12 2022] POST /identity/v3/users => generated 301 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:08:12.120365 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66922486-a25e-402e-b597-17f5951696a4 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:12.131222 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66922486-a25e-402e-b597-17f5951696a4 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:12.135946 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a98813-0271-4d6d-aa5b-54c04957889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:12.136631 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a98813-0271-4d6d-aa5b-54c04957889d admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:12.136908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a98813-0271-4d6d-aa5b-54c04957889d admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:12.137175 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a98813-0271-4d6d-aa5b-54c04957889d admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:12.137879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a98813-0271-4d6d-aa5b-54c04957889d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:12.139467 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a98813-0271-4d6d-aa5b-54c04957889d admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:12.149741 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1367/2781] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:08:12.153620 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1281aa-21f6-454d-89a8-02e4ecf53cfb admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:12.163267 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1281aa-21f6-454d-89a8-02e4ecf53cfb admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:12.167873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffacdc-bdd1-4f01-9e68-dbdb3a02c83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:12.168556 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffacdc-bdd1-4f01-9e68-dbdb3a02c83d admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:12.168836 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffacdc-bdd1-4f01-9e68-dbdb3a02c83d admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:12.169111 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffacdc-bdd1-4f01-9e68-dbdb3a02c83d admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:12.169846 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffacdc-bdd1-4f01-9e68-dbdb3a02c83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:12.171455 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffacdc-bdd1-4f01-9e68-dbdb3a02c83d admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:12.183184 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1415/2782] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:08:12.187270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a98813-0271-4d6d-aa5b-54c04957889d admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:12.197540 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a98813-0271-4d6d-aa5b-54c04957889d admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:12.202106 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89b7a9-9d65-4293-9ddd-6eb5e7c7c812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:12.202974 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89b7a9-9d65-4293-9ddd-6eb5e7c7c812 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:12.203258 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89b7a9-9d65-4293-9ddd-6eb5e7c7c812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:12.203536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89b7a9-9d65-4293-9ddd-6eb5e7c7c812 admin admin] PATH_INFO: `/v3/projects/f487ff9247cb4986b04225ea7080964e/users/03556755df404365a651f47b15b6620c/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:12.217726 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89b7a9-9d65-4293-9ddd-6eb5e7c7c812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f487ff9247cb4986b04225ea7080964e, user_id=03556755df404365a651f47b15b6620c, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:12.220445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89b7a9-9d65-4293-9ddd-6eb5e7c7c812 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:12.232582 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1368/2783] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:08:12 2022] PUT /identity/v3/projects/f487ff9247cb4986b04225ea7080964e/users/03556755df404365a651f47b15b6620c/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:12.246593 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413690ef-e91a-468f-81a2-e72901bcf99f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:12.246879 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413690ef-e91a-468f-81a2-e72901bcf99f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:12.247212 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413690ef-e91a-468f-81a2-e72901bcf99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:12.275503 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-413690ef-e91a-468f-81a2-e72901bcf99f None None] MFA Rules not processed for user `03556755df404365a651f47b15b6620c`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:12.276741 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-413690ef-e91a-468f-81a2-e72901bcf99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:12.339759 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1416/2784] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:08:12.344200 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89b7a9-9d65-4293-9ddd-6eb5e7c7c812 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:12.407137 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89b7a9-9d65-4293-9ddd-6eb5e7c7c812 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:12.412612 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208b84d-a4f5-453d-93c2-30b0f48f3f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:12.413261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208b84d-a4f5-453d-93c2-30b0f48f3f0b admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:12.413542 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208b84d-a4f5-453d-93c2-30b0f48f3f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:12.413816 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208b84d-a4f5-453d-93c2-30b0f48f3f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:12.414515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208b84d-a4f5-453d-93c2-30b0f48f3f0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:12.416445 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208b84d-a4f5-453d-93c2-30b0f48f3f0b admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:12.442538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1369/2785] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:08:12 2022] POST /identity/v3/projects => generated 399 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:08:12.447472 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413690ef-e91a-468f-81a2-e72901bcf99f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:12.460479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413690ef-e91a-468f-81a2-e72901bcf99f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:12.517324 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a3580-d5b7-41e3-88df-c6164d59aba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:12.517916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a3580-d5b7-41e3-88df-c6164d59aba1 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:12.518196 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a3580-d5b7-41e3-88df-c6164d59aba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:12.518469 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a3580-d5b7-41e3-88df-c6164d59aba1 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:12.519232 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a3580-d5b7-41e3-88df-c6164d59aba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:12.522075 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a3580-d5b7-41e3-88df-c6164d59aba1 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:12.543925 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1417/2786] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:08:12 2022] POST /identity/v3/users => generated 306 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:08:12.547855 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208b84d-a4f5-453d-93c2-30b0f48f3f0b admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:12.557979 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208b84d-a4f5-453d-93c2-30b0f48f3f0b admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:12.562572 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6aa38b-3a13-4d29-b6a5-c1f62a3cb496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:12.563213 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6aa38b-3a13-4d29-b6a5-c1f62a3cb496 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:12.563494 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6aa38b-3a13-4d29-b6a5-c1f62a3cb496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:12.563765 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6aa38b-3a13-4d29-b6a5-c1f62a3cb496 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:12.564515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6aa38b-3a13-4d29-b6a5-c1f62a3cb496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:12.566089 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6aa38b-3a13-4d29-b6a5-c1f62a3cb496 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:12.576831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1370/2787] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:08:12.580828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a3580-d5b7-41e3-88df-c6164d59aba1 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:12.591060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a3580-d5b7-41e3-88df-c6164d59aba1 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:12.595629 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16d18a-577c-419b-972d-1d02c476d180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:12.596528 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16d18a-577c-419b-972d-1d02c476d180 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:12.596801 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16d18a-577c-419b-972d-1d02c476d180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:12.597071 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16d18a-577c-419b-972d-1d02c476d180 admin admin] PATH_INFO: `/v3/projects/d1dfc2b73ea8499f96419ff63ec1f3cb/users/428a644000fb46b68d520373e7a53f55/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:12.612115 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16d18a-577c-419b-972d-1d02c476d180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1dfc2b73ea8499f96419ff63ec1f3cb, user_id=428a644000fb46b68d520373e7a53f55, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:12.614835 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16d18a-577c-419b-972d-1d02c476d180 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:12.627737 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1418/2788] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:08:12 2022] PUT /identity/v3/projects/d1dfc2b73ea8499f96419ff63ec1f3cb/users/428a644000fb46b68d520373e7a53f55/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:08:12.632330 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6aa38b-3a13-4d29-b6a5-c1f62a3cb496 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:12.644080 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6aa38b-3a13-4d29-b6a5-c1f62a3cb496 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:12.700162 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9c17c-ba31-4083-aea6-a39f238bcf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:12.700857 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9c17c-ba31-4083-aea6-a39f238bcf46 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:12.701138 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9c17c-ba31-4083-aea6-a39f238bcf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:12.701413 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9c17c-ba31-4083-aea6-a39f238bcf46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:12.702140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9c17c-ba31-4083-aea6-a39f238bcf46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:12.703728 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9c17c-ba31-4083-aea6-a39f238bcf46 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:12.714333 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1371/2789] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:08:12.718403 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16d18a-577c-419b-972d-1d02c476d180 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:12.728462 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16d18a-577c-419b-972d-1d02c476d180 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:12.732972 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fceeb-0b6b-4b3e-b2c8-9ae0276eed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:12.733839 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fceeb-0b6b-4b3e-b2c8-9ae0276eed9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:12.734113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fceeb-0b6b-4b3e-b2c8-9ae0276eed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:12.734384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fceeb-0b6b-4b3e-b2c8-9ae0276eed9e admin admin] PATH_INFO: `/v3/projects/d1dfc2b73ea8499f96419ff63ec1f3cb/users/428a644000fb46b68d520373e7a53f55/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:12.736396 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fceeb-0b6b-4b3e-b2c8-9ae0276eed9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1dfc2b73ea8499f96419ff63ec1f3cb, user_id=428a644000fb46b68d520373e7a53f55, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:12.738963 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fceeb-0b6b-4b3e-b2c8-9ae0276eed9e admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:12.750119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1419/2790] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:08:12 2022] PUT /identity/v3/projects/d1dfc2b73ea8499f96419ff63ec1f3cb/users/428a644000fb46b68d520373e7a53f55/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:12.760742 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe122d-71a5-4ab1-9e23-6323b8b20b44 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:12.761029 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe122d-71a5-4ab1-9e23-6323b8b20b44 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:12.761309 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe122d-71a5-4ab1-9e23-6323b8b20b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:12.786748 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-0efe122d-71a5-4ab1-9e23-6323b8b20b44 None None] MFA Rules not processed for user `428a644000fb46b68d520373e7a53f55`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:12.787876 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0efe122d-71a5-4ab1-9e23-6323b8b20b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:12.856055 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1372/2791] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:12 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:08:12.867569 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fceeb-0b6b-4b3e-b2c8-9ae0276eed9e admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:12.869369 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-ef0fceeb-0b6b-4b3e-b2c8-9ae0276eed9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:12.927611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fceeb-0b6b-4b3e-b2c8-9ae0276eed9e admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:12.931259 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddafed-d395-4857-952e-1c6533d05e9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:12.931897 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddafed-d395-4857-952e-1c6533d05e9a service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:12.932195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddafed-d395-4857-952e-1c6533d05e9a service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:12.932479 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddafed-d395-4857-952e-1c6533d05e9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:12.941282 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddafed-d395-4857-952e-1c6533d05e9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:12.942709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddafed-d395-4857-952e-1c6533d05e9a service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:12.952849 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1420/2792] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:08:12 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:08:13.035897 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe122d-71a5-4ab1-9e23-6323b8b20b44 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:13.045650 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe122d-71a5-4ab1-9e23-6323b8b20b44 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:13.049195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929f4d2-0127-4ed6-b949-95e803859c5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:13.049824 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929f4d2-0127-4ed6-b949-95e803859c5e service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:13.050094 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929f4d2-0127-4ed6-b949-95e803859c5e service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:13.050361 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929f4d2-0127-4ed6-b949-95e803859c5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:13.112486 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929f4d2-0127-4ed6-b949-95e803859c5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:13.113895 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929f4d2-0127-4ed6-b949-95e803859c5e service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:13.123070 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1373/2793] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:08:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:08:17.147282 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddafed-d395-4857-952e-1c6533d05e9a service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:17.210083 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddafed-d395-4857-952e-1c6533d05e9a service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:17.214662 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9d5de-6e33-465e-9a09-7fd36c839f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:17.215544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9d5de-6e33-465e-9a09-7fd36c839f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:17.215800 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9d5de-6e33-465e-9a09-7fd36c839f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:17.216068 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9d5de-6e33-465e-9a09-7fd36c839f51 admin admin] PATH_INFO: `/v3/users/03556755df404365a651f47b15b6620c` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:17.217299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9d5de-6e33-465e-9a09-7fd36c839f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03556755df404365a651f47b15b6620c)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:17.219182 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9d5de-6e33-465e-9a09-7fd36c839f51 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:17.263528 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-49f9d5de-6e33-465e-9a09-7fd36c839f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03556755df404365a651f47b15b6620c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:17.277311 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-49f9d5de-6e33-465e-9a09-7fd36c839f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03556755df404365a651f47b15b6620c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:17.285359 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-49f9d5de-6e33-465e-9a09-7fd36c839f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03556755df404365a651f47b15b6620c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:17.286115 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-49f9d5de-6e33-465e-9a09-7fd36c839f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03556755df404365a651f47b15b6620c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:17.294271 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-49f9d5de-6e33-465e-9a09-7fd36c839f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03556755df404365a651f47b15b6620c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:17.300139 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1421/2794] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:08:17 2022] DELETE /identity/v3/users/03556755df404365a651f47b15b6620c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:08:17.304658 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b4d0b-d3e9-40d9-91f0-256898aef8a9 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:17.305138 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b4d0b-d3e9-40d9-91f0-256898aef8a9 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:17.305237 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b4d0b-d3e9-40d9-91f0-256898aef8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:17.322205 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-1f5b4d0b-d3e9-40d9-91f0-256898aef8a9 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:17.323564 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-1f5b4d0b-d3e9-40d9-91f0-256898aef8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:17.382154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1374/2795] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:08:17.392293 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9d5de-6e33-465e-9a09-7fd36c839f51 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:17.393900 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-49f9d5de-6e33-465e-9a09-7fd36c839f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:17.462260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9d5de-6e33-465e-9a09-7fd36c839f51 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:17.466368 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da40ce-aa56-48e4-b6c0-28ad018e59d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:17.467004 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da40ce-aa56-48e4-b6c0-28ad018e59d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:17.467277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da40ce-aa56-48e4-b6c0-28ad018e59d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:17.467547 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da40ce-aa56-48e4-b6c0-28ad018e59d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:17.477119 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da40ce-aa56-48e4-b6c0-28ad018e59d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:17.478551 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da40ce-aa56-48e4-b6c0-28ad018e59d6 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:17.487784 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1422/2796] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:08:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:08:17.753257 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b4d0b-d3e9-40d9-91f0-256898aef8a9 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:17.754682 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-1f5b4d0b-d3e9-40d9-91f0-256898aef8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:17.768079 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b4d0b-d3e9-40d9-91f0-256898aef8a9 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:17.777740 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:17.778611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:17.778881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:17.779192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a admin admin] PATH_INFO: `/v3/projects/f487ff9247cb4986b04225ea7080964e` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:17.780387 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f487ff9247cb4986b04225ea7080964e)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:17.782280 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:17.831515 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f487ff9247cb4986b04225ea7080964e', 'request_id': 'req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:17.836900 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f487ff9247cb4986b04225ea7080964e', 'request_id': 'req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:17.842890 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f487ff9247cb4986b04225ea7080964e', 'request_id': 'req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:17.855531 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a admin admin] The token cache is being invalidate because project f487ff9247cb4986b04225ea7080964e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:08:17.855820 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:17.856452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:17.857991 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1375/2797] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:08:17 2022] DELETE /identity/v3/projects/f487ff9247cb4986b04225ea7080964e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:17.861927 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da40ce-aa56-48e4-b6c0-28ad018e59d6 service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:17.871873 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da40ce-aa56-48e4-b6c0-28ad018e59d6 service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:17.931689 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3693e-b76d-4538-bbb2-e2f3fa5124a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:17.932610 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3693e-b76d-4538-bbb2-e2f3fa5124a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:17.932890 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3693e-b76d-4538-bbb2-e2f3fa5124a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:17.933165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3693e-b76d-4538-bbb2-e2f3fa5124a8 admin admin] PATH_INFO: `/v3/users/428a644000fb46b68d520373e7a53f55` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:17.934391 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3693e-b76d-4538-bbb2-e2f3fa5124a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=428a644000fb46b68d520373e7a53f55)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:17.936325 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3693e-b76d-4538-bbb2-e2f3fa5124a8 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:17.981724 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2fb3693e-b76d-4538-bbb2-e2f3fa5124a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '428a644000fb46b68d520373e7a53f55'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:17.993284 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2fb3693e-b76d-4538-bbb2-e2f3fa5124a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '428a644000fb46b68d520373e7a53f55'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:18.000432 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2fb3693e-b76d-4538-bbb2-e2f3fa5124a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '428a644000fb46b68d520373e7a53f55'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:18.001211 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2fb3693e-b76d-4538-bbb2-e2f3fa5124a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '428a644000fb46b68d520373e7a53f55'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:18.008645 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2fb3693e-b76d-4538-bbb2-e2f3fa5124a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '428a644000fb46b68d520373e7a53f55'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:18.015196 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1423/2798] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:08:17 2022] DELETE /identity/v3/users/428a644000fb46b68d520373e7a53f55 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:18.289740 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:18.291232 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:18.310507 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3bc86-61e7-4b48-9344-b1d64a230d5a admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:18.371845 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08a9e9-f00b-4c85-88e6-25a57ee48ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:18.372747 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08a9e9-f00b-4c85-88e6-25a57ee48ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:18.373031 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08a9e9-f00b-4c85-88e6-25a57ee48ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:18.373305 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08a9e9-f00b-4c85-88e6-25a57ee48ce2 admin admin] PATH_INFO: `/v3/projects/d1dfc2b73ea8499f96419ff63ec1f3cb` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:18.374479 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08a9e9-f00b-4c85-88e6-25a57ee48ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1dfc2b73ea8499f96419ff63ec1f3cb)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:18.376400 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08a9e9-f00b-4c85-88e6-25a57ee48ce2 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:18.424834 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4c08a9e9-f00b-4c85-88e6-25a57ee48ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1dfc2b73ea8499f96419ff63ec1f3cb', 'request_id': 'req-4c08a9e9-f00b-4c85-88e6-25a57ee48ce2'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:18.429875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4c08a9e9-f00b-4c85-88e6-25a57ee48ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1dfc2b73ea8499f96419ff63ec1f3cb', 'request_id': 'req-4c08a9e9-f00b-4c85-88e6-25a57ee48ce2'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:18.435718 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4c08a9e9-f00b-4c85-88e6-25a57ee48ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1dfc2b73ea8499f96419ff63ec1f3cb', 'request_id': 'req-4c08a9e9-f00b-4c85-88e6-25a57ee48ce2'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:18.448159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4c08a9e9-f00b-4c85-88e6-25a57ee48ce2 admin admin] The token cache is being invalidate because project d1dfc2b73ea8499f96419ff63ec1f3cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:08:18.448466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4c08a9e9-f00b-4c85-88e6-25a57ee48ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:18.449086 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4c08a9e9-f00b-4c85-88e6-25a57ee48ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:18.450617 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1376/2799] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:08:18 2022] DELETE /identity/v3/projects/d1dfc2b73ea8499f96419ff63ec1f3cb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:18.455725 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94721a16-f2d6-4912-bf39-c551ca9840eb None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:18.456377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94721a16-f2d6-4912-bf39-c551ca9840eb None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:18.456377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94721a16-f2d6-4912-bf39-c551ca9840eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:18.475432 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-94721a16-f2d6-4912-bf39-c551ca9840eb None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:18.476651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-94721a16-f2d6-4912-bf39-c551ca9840eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:18.536413 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1424/2800] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:08:18.545320 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da5141-1ffb-4b54-97eb-019315b81190 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:18.545610 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da5141-1ffb-4b54-97eb-019315b81190 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:18.545874 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da5141-1ffb-4b54-97eb-019315b81190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:18.563707 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-35da5141-1ffb-4b54-97eb-019315b81190 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:18.565301 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-35da5141-1ffb-4b54-97eb-019315b81190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:18.574192 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1377/2801] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:08:18.578566 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94721a16-f2d6-4912-bf39-c551ca9840eb None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:18.589270 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94721a16-f2d6-4912-bf39-c551ca9840eb None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:18.593945 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3453869-b23c-4bc9-878d-0d037b192500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:18.594719 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3453869-b23c-4bc9-878d-0d037b192500 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:18.595001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3453869-b23c-4bc9-878d-0d037b192500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:18.595275 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3453869-b23c-4bc9-878d-0d037b192500 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:18.596028 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3453869-b23c-4bc9-878d-0d037b192500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:08:18.596364 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3453869-b23c-4bc9-878d-0d037b192500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:18.597935 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3453869-b23c-4bc9-878d-0d037b192500 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:18.609531 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1425/2802] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:08:18.613851 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da5141-1ffb-4b54-97eb-019315b81190 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:18.623092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da5141-1ffb-4b54-97eb-019315b81190 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:18.628064 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c78448-00d9-414c-a76d-f82849cc716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:18.628886 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c78448-00d9-414c-a76d-f82849cc716e admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:18.629172 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c78448-00d9-414c-a76d-f82849cc716e admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:18.629450 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c78448-00d9-414c-a76d-f82849cc716e admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:18.630538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c78448-00d9-414c-a76d-f82849cc716e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:18.633790 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c78448-00d9-414c-a76d-f82849cc716e admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:18.658854 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1378/2803] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:08:18 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:08:18.663198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3453869-b23c-4bc9-878d-0d037b192500 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:18.673602 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3453869-b23c-4bc9-878d-0d037b192500 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:18.729889 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb815e8-b4bb-49b9-92bd-3ea3764f4887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:18.730480 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb815e8-b4bb-49b9-92bd-3ea3764f4887 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:18.730760 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb815e8-b4bb-49b9-92bd-3ea3764f4887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:18.731032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb815e8-b4bb-49b9-92bd-3ea3764f4887 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:18.731722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb815e8-b4bb-49b9-92bd-3ea3764f4887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:18.733647 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb815e8-b4bb-49b9-92bd-3ea3764f4887 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:18.754498 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1426/2804] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:08:18 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:08:18.759102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c78448-00d9-414c-a76d-f82849cc716e admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:18.770282 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c78448-00d9-414c-a76d-f82849cc716e admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:18.775167 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4010f-f79b-4497-a029-d5c1bfb2891a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:18.775844 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4010f-f79b-4497-a029-d5c1bfb2891a admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:18.776154 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4010f-f79b-4497-a029-d5c1bfb2891a admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:18.776460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4010f-f79b-4497-a029-d5c1bfb2891a admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:18.777186 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4010f-f79b-4497-a029-d5c1bfb2891a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:18.778831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4010f-f79b-4497-a029-d5c1bfb2891a admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:18.789931 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1379/2805] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:08:18.794079 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb815e8-b4bb-49b9-92bd-3ea3764f4887 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:18.804366 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb815e8-b4bb-49b9-92bd-3ea3764f4887 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:18.808949 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fb8bc-5f9b-452a-96b0-e6ece0c0fd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:18.809587 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fb8bc-5f9b-452a-96b0-e6ece0c0fd54 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:18.809864 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fb8bc-5f9b-452a-96b0-e6ece0c0fd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:18.810137 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fb8bc-5f9b-452a-96b0-e6ece0c0fd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:18.810841 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fb8bc-5f9b-452a-96b0-e6ece0c0fd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:18.812423 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fb8bc-5f9b-452a-96b0-e6ece0c0fd54 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:18.823305 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1427/2806] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:08:18.827588 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4010f-f79b-4497-a029-d5c1bfb2891a admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:18.838109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4010f-f79b-4497-a029-d5c1bfb2891a admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:18.843539 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696c3c9-ee1f-4f87-bc3a-be9893464a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:18.844440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696c3c9-ee1f-4f87-bc3a-be9893464a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:18.844721 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696c3c9-ee1f-4f87-bc3a-be9893464a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:18.844994 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696c3c9-ee1f-4f87-bc3a-be9893464a91 admin admin] PATH_INFO: `/v3/projects/97327063803b4d3598065d43246c3a75/users/bfcc776410dc4b1db59a95e0bc8209a5/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:18.861009 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696c3c9-ee1f-4f87-bc3a-be9893464a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97327063803b4d3598065d43246c3a75, user_id=bfcc776410dc4b1db59a95e0bc8209a5, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:18.863704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696c3c9-ee1f-4f87-bc3a-be9893464a91 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:18.877190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1380/2807] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:08:18 2022] PUT /identity/v3/projects/97327063803b4d3598065d43246c3a75/users/bfcc776410dc4b1db59a95e0bc8209a5/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:18.888470 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e38b53-fbca-47c1-95d3-fca43af02e9c None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:18.888755 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e38b53-fbca-47c1-95d3-fca43af02e9c None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:18.889053 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e38b53-fbca-47c1-95d3-fca43af02e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:18.915542 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-48e38b53-fbca-47c1-95d3-fca43af02e9c None None] MFA Rules not processed for user `bfcc776410dc4b1db59a95e0bc8209a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:18.916719 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-48e38b53-fbca-47c1-95d3-fca43af02e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:18.985636 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1428/2808] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:08:18.990201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696c3c9-ee1f-4f87-bc3a-be9893464a91 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:19.051980 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696c3c9-ee1f-4f87-bc3a-be9893464a91 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:19.057098 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4b61f-5ed2-4e5b-8444-c8ded4ca3a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:19.057765 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4b61f-5ed2-4e5b-8444-c8ded4ca3a97 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:19.058043 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4b61f-5ed2-4e5b-8444-c8ded4ca3a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:19.058315 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4b61f-5ed2-4e5b-8444-c8ded4ca3a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:19.059012 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4b61f-5ed2-4e5b-8444-c8ded4ca3a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:19.060940 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4b61f-5ed2-4e5b-8444-c8ded4ca3a97 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:19.087141 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1381/2809] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:08:18 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:08:19.091204 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e38b53-fbca-47c1-95d3-fca43af02e9c None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:19.101817 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e38b53-fbca-47c1-95d3-fca43af02e9c None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:19.157271 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e2851-5af8-4664-93a8-a1f748a0ea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:19.157942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e2851-5af8-4664-93a8-a1f748a0ea22 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:19.158220 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e2851-5af8-4664-93a8-a1f748a0ea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:19.158493 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e2851-5af8-4664-93a8-a1f748a0ea22 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:19.159190 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e2851-5af8-4664-93a8-a1f748a0ea22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:19.161166 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e2851-5af8-4664-93a8-a1f748a0ea22 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:19.181575 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1429/2810] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:08:19 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:08:19.185636 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4b61f-5ed2-4e5b-8444-c8ded4ca3a97 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:19.196545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4b61f-5ed2-4e5b-8444-c8ded4ca3a97 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:19.201176 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7794b-49c6-431e-a15a-6c5edd7ec3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:19.201828 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7794b-49c6-431e-a15a-6c5edd7ec3da admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:19.202106 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7794b-49c6-431e-a15a-6c5edd7ec3da admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:19.202373 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7794b-49c6-431e-a15a-6c5edd7ec3da admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:19.203086 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7794b-49c6-431e-a15a-6c5edd7ec3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:19.204728 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7794b-49c6-431e-a15a-6c5edd7ec3da admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:19.215630 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1382/2811] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:08:19.219683 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e2851-5af8-4664-93a8-a1f748a0ea22 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:19.229501 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e2851-5af8-4664-93a8-a1f748a0ea22 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:19.234113 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4a966-5fbf-4875-b71b-4d2f07505c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:19.234979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4a966-5fbf-4875-b71b-4d2f07505c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:19.235254 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4a966-5fbf-4875-b71b-4d2f07505c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:19.235527 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4a966-5fbf-4875-b71b-4d2f07505c46 admin admin] PATH_INFO: `/v3/projects/6d6a2f54cf3d44a980846309f0ae9e49/users/5ac1d749568846fd9c83c2733c73226c/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:19.250334 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4a966-5fbf-4875-b71b-4d2f07505c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6a2f54cf3d44a980846309f0ae9e49, user_id=5ac1d749568846fd9c83c2733c73226c, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:19.253010 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4a966-5fbf-4875-b71b-4d2f07505c46 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:19.268744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1430/2812] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:08:19 2022] PUT /identity/v3/projects/6d6a2f54cf3d44a980846309f0ae9e49/users/5ac1d749568846fd9c83c2733c73226c/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:19.273264 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7794b-49c6-431e-a15a-6c5edd7ec3da admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:19.283632 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7794b-49c6-431e-a15a-6c5edd7ec3da admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:19.338823 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc5e6e-637a-4d13-affa-048bfea23c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:19.339493 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc5e6e-637a-4d13-affa-048bfea23c75 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:19.339761 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc5e6e-637a-4d13-affa-048bfea23c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:19.340037 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc5e6e-637a-4d13-affa-048bfea23c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:19.340788 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc5e6e-637a-4d13-affa-048bfea23c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:19.342368 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc5e6e-637a-4d13-affa-048bfea23c75 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:19.352252 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1383/2813] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:08:19.356323 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4a966-5fbf-4875-b71b-4d2f07505c46 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:19.369465 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4a966-5fbf-4875-b71b-4d2f07505c46 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:19.374221 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b5f96-e0bf-4c4c-b5f4-a7a5c78cba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:19.375108 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b5f96-e0bf-4c4c-b5f4-a7a5c78cba3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:19.375387 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b5f96-e0bf-4c4c-b5f4-a7a5c78cba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:19.375664 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b5f96-e0bf-4c4c-b5f4-a7a5c78cba3d admin admin] PATH_INFO: `/v3/projects/6d6a2f54cf3d44a980846309f0ae9e49/users/5ac1d749568846fd9c83c2733c73226c/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:19.380208 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b5f96-e0bf-4c4c-b5f4-a7a5c78cba3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6a2f54cf3d44a980846309f0ae9e49, user_id=5ac1d749568846fd9c83c2733c73226c, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:19.381030 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b5f96-e0bf-4c4c-b5f4-a7a5c78cba3d admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:19.393383 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1431/2814] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:08:19 2022] PUT /identity/v3/projects/6d6a2f54cf3d44a980846309f0ae9e49/users/5ac1d749568846fd9c83c2733c73226c/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:19.403832 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef2dc2-2cdc-4815-a783-b8b765eef074 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:19.404132 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef2dc2-2cdc-4815-a783-b8b765eef074 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:19.404440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef2dc2-2cdc-4815-a783-b8b765eef074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:19.432081 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-adef2dc2-2cdc-4815-a783-b8b765eef074 None None] MFA Rules not processed for user `5ac1d749568846fd9c83c2733c73226c`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:19.433345 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-adef2dc2-2cdc-4815-a783-b8b765eef074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:19.501638 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1384/2815] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:08:19.512133 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b5f96-e0bf-4c4c-b5f4-a7a5c78cba3d admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:19.513920 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-294b5f96-e0bf-4c4c-b5f4-a7a5c78cba3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:19.572595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b5f96-e0bf-4c4c-b5f4-a7a5c78cba3d admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:19.576320 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49e655-5f53-4fa8-9c06-0f2360abeedc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:19.576988 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49e655-5f53-4fa8-9c06-0f2360abeedc service cinder] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:19.577491 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49e655-5f53-4fa8-9c06-0f2360abeedc service cinder] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:19.578014 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49e655-5f53-4fa8-9c06-0f2360abeedc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:19.633978 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49e655-5f53-4fa8-9c06-0f2360abeedc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:19.635536 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49e655-5f53-4fa8-9c06-0f2360abeedc service cinder] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:19.645829 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1432/2816] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:08:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:08:23.803335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef2dc2-2cdc-4815-a783-b8b765eef074 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:23.813867 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef2dc2-2cdc-4815-a783-b8b765eef074 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:23.817488 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b08d4-9cf9-4426-8e12-1efbf7030162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:23.818122 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b08d4-9cf9-4426-8e12-1efbf7030162 service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:23.818405 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b08d4-9cf9-4426-8e12-1efbf7030162 service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:23.818680 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b08d4-9cf9-4426-8e12-1efbf7030162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:23.828489 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b08d4-9cf9-4426-8e12-1efbf7030162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:23.829909 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b08d4-9cf9-4426-8e12-1efbf7030162 service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:23.839713 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1385/2817] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:08:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:08:28.673230 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49e655-5f53-4fa8-9c06-0f2360abeedc service cinder] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:28.735890 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49e655-5f53-4fa8-9c06-0f2360abeedc service cinder] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:28.740343 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91ac14-27b9-4eee-af9b-aabf8bb8e747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:28.741200 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91ac14-27b9-4eee-af9b-aabf8bb8e747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:28.741475 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91ac14-27b9-4eee-af9b-aabf8bb8e747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:28.741745 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91ac14-27b9-4eee-af9b-aabf8bb8e747 admin admin] PATH_INFO: `/v3/users/bfcc776410dc4b1db59a95e0bc8209a5` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:28.743453 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91ac14-27b9-4eee-af9b-aabf8bb8e747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfcc776410dc4b1db59a95e0bc8209a5)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:28.745647 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91ac14-27b9-4eee-af9b-aabf8bb8e747 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:28.792369 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-cc91ac14-27b9-4eee-af9b-aabf8bb8e747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfcc776410dc4b1db59a95e0bc8209a5'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:28.809173 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-cc91ac14-27b9-4eee-af9b-aabf8bb8e747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfcc776410dc4b1db59a95e0bc8209a5'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:28.819187 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-cc91ac14-27b9-4eee-af9b-aabf8bb8e747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfcc776410dc4b1db59a95e0bc8209a5'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:28.820206 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-cc91ac14-27b9-4eee-af9b-aabf8bb8e747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfcc776410dc4b1db59a95e0bc8209a5'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:28.827918 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-cc91ac14-27b9-4eee-af9b-aabf8bb8e747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfcc776410dc4b1db59a95e0bc8209a5'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:28.834722 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1433/2818] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:08:28 2022] DELETE /identity/v3/users/bfcc776410dc4b1db59a95e0bc8209a5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:28.840191 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fd128-290b-424c-9e9d-45cf8181ec1e None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:28.840693 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fd128-290b-424c-9e9d-45cf8181ec1e None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:28.840918 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fd128-290b-424c-9e9d-45cf8181ec1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:28.861712 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-655fd128-290b-424c-9e9d-45cf8181ec1e None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:28.863358 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-655fd128-290b-424c-9e9d-45cf8181ec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:28.922831 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1386/2819] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:08:28.932910 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91ac14-27b9-4eee-af9b-aabf8bb8e747 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:28.934325 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cc91ac14-27b9-4eee-af9b-aabf8bb8e747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:28.991328 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91ac14-27b9-4eee-af9b-aabf8bb8e747 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:28.995091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0ed11-8739-440e-a45d-8be8cf529f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:28.995739 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0ed11-8739-440e-a45d-8be8cf529f60 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:28.996018 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0ed11-8739-440e-a45d-8be8cf529f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:28.996329 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0ed11-8739-440e-a45d-8be8cf529f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:29.005219 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0ed11-8739-440e-a45d-8be8cf529f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:29.006656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0ed11-8739-440e-a45d-8be8cf529f60 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:29.017130 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1434/2820] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:08:29.298057 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fd128-290b-424c-9e9d-45cf8181ec1e None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:29.299461 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-655fd128-290b-424c-9e9d-45cf8181ec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:29.313008 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fd128-290b-424c-9e9d-45cf8181ec1e None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:29.318865 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80113d9-4e41-43e0-b626-dafc0616e266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:29.320312 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80113d9-4e41-43e0-b626-dafc0616e266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:29.321373 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80113d9-4e41-43e0-b626-dafc0616e266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:29.321613 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80113d9-4e41-43e0-b626-dafc0616e266 admin admin] PATH_INFO: `/v3/projects/97327063803b4d3598065d43246c3a75` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:29.322956 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80113d9-4e41-43e0-b626-dafc0616e266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97327063803b4d3598065d43246c3a75)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:29.325074 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80113d9-4e41-43e0-b626-dafc0616e266 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:29.374892 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b80113d9-4e41-43e0-b626-dafc0616e266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97327063803b4d3598065d43246c3a75', 'request_id': 'req-b80113d9-4e41-43e0-b626-dafc0616e266'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:29.380016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b80113d9-4e41-43e0-b626-dafc0616e266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97327063803b4d3598065d43246c3a75', 'request_id': 'req-b80113d9-4e41-43e0-b626-dafc0616e266'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:29.387715 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b80113d9-4e41-43e0-b626-dafc0616e266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97327063803b4d3598065d43246c3a75', 'request_id': 'req-b80113d9-4e41-43e0-b626-dafc0616e266'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:29.401479 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b80113d9-4e41-43e0-b626-dafc0616e266 admin admin] The token cache is being invalidate because project 97327063803b4d3598065d43246c3a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:08:29.401765 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b80113d9-4e41-43e0-b626-dafc0616e266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:29.402375 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-b80113d9-4e41-43e0-b626-dafc0616e266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:29.403906 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1387/2821] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:08:29 2022] DELETE /identity/v3/projects/97327063803b4d3598065d43246c3a75 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:29.407973 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0ed11-8739-440e-a45d-8be8cf529f60 service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:29.417544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0ed11-8739-440e-a45d-8be8cf529f60 service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:29.474989 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a93f3-3e03-4658-9661-e8f448199fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:29.475869 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a93f3-3e03-4658-9661-e8f448199fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:29.476148 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a93f3-3e03-4658-9661-e8f448199fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:29.476459 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a93f3-3e03-4658-9661-e8f448199fd4 admin admin] PATH_INFO: `/v3/users/5ac1d749568846fd9c83c2733c73226c` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:29.478160 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a93f3-3e03-4658-9661-e8f448199fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ac1d749568846fd9c83c2733c73226c)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:29.480064 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a93f3-3e03-4658-9661-e8f448199fd4 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:29.526539 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-232a93f3-3e03-4658-9661-e8f448199fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ac1d749568846fd9c83c2733c73226c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:29.538081 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-232a93f3-3e03-4658-9661-e8f448199fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ac1d749568846fd9c83c2733c73226c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:29.545303 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-232a93f3-3e03-4658-9661-e8f448199fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ac1d749568846fd9c83c2733c73226c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:29.546102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-232a93f3-3e03-4658-9661-e8f448199fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ac1d749568846fd9c83c2733c73226c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:29.554377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-232a93f3-3e03-4658-9661-e8f448199fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ac1d749568846fd9c83c2733c73226c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:29.561253 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1435/2822] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:08:29 2022] DELETE /identity/v3/users/5ac1d749568846fd9c83c2733c73226c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:29.831391 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80113d9-4e41-43e0-b626-dafc0616e266 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:29.832861 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-b80113d9-4e41-43e0-b626-dafc0616e266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:29.845811 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80113d9-4e41-43e0-b626-dafc0616e266 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:29.905638 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0372c-8948-4c07-93bc-6506af336208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:29.906541 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0372c-8948-4c07-93bc-6506af336208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:29.906822 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0372c-8948-4c07-93bc-6506af336208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:29.907096 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0372c-8948-4c07-93bc-6506af336208 admin admin] PATH_INFO: `/v3/projects/6d6a2f54cf3d44a980846309f0ae9e49` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:29.908311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0372c-8948-4c07-93bc-6506af336208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d6a2f54cf3d44a980846309f0ae9e49)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:29.910204 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0372c-8948-4c07-93bc-6506af336208 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:29.953965 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-57c0372c-8948-4c07-93bc-6506af336208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d6a2f54cf3d44a980846309f0ae9e49', 'request_id': 'req-57c0372c-8948-4c07-93bc-6506af336208'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:29.959165 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-57c0372c-8948-4c07-93bc-6506af336208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d6a2f54cf3d44a980846309f0ae9e49', 'request_id': 'req-57c0372c-8948-4c07-93bc-6506af336208'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:29.965570 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-57c0372c-8948-4c07-93bc-6506af336208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d6a2f54cf3d44a980846309f0ae9e49', 'request_id': 'req-57c0372c-8948-4c07-93bc-6506af336208'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:29.977911 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-57c0372c-8948-4c07-93bc-6506af336208 admin admin] The token cache is being invalidate because project 6d6a2f54cf3d44a980846309f0ae9e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:08:29.978190 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-57c0372c-8948-4c07-93bc-6506af336208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:29.978801 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-57c0372c-8948-4c07-93bc-6506af336208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:29.980379 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1388/2823] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:08:29 2022] DELETE /identity/v3/projects/6d6a2f54cf3d44a980846309f0ae9e49 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:29.986282 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fff11-1e2d-4627-9322-59589af07e1f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:29.986750 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fff11-1e2d-4627-9322-59589af07e1f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:29.986848 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fff11-1e2d-4627-9322-59589af07e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:30.003823 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-e00fff11-1e2d-4627-9322-59589af07e1f None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:30.005084 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e00fff11-1e2d-4627-9322-59589af07e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:30.063044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1436/2824] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:08:30.071448 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6ecd6-a38e-4410-9b1f-c691d660a372 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:30.071736 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6ecd6-a38e-4410-9b1f-c691d660a372 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:30.072017 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6ecd6-a38e-4410-9b1f-c691d660a372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:30.092189 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-87f6ecd6-a38e-4410-9b1f-c691d660a372 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:30.093366 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-87f6ecd6-a38e-4410-9b1f-c691d660a372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:30.101116 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1389/2825] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:08:30.105828 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fff11-1e2d-4627-9322-59589af07e1f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:30.115906 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fff11-1e2d-4627-9322-59589af07e1f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:30.121067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15198bed-0ed2-4da6-b4e7-6bda7158c925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:30.121712 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15198bed-0ed2-4da6-b4e7-6bda7158c925 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:30.121991 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15198bed-0ed2-4da6-b4e7-6bda7158c925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:30.122260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15198bed-0ed2-4da6-b4e7-6bda7158c925 admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:30.122972 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15198bed-0ed2-4da6-b4e7-6bda7158c925 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:08:30.123269 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15198bed-0ed2-4da6-b4e7-6bda7158c925 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:30.124872 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15198bed-0ed2-4da6-b4e7-6bda7158c925 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:30.136538 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1437/2826] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 14:08:30.141102 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6ecd6-a38e-4410-9b1f-c691d660a372 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:30.150195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6ecd6-a38e-4410-9b1f-c691d660a372 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:30.154826 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbadad-601d-465f-bd10-000999be1469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:30.155460 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbadad-601d-465f-bd10-000999be1469 admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:30.155740 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbadad-601d-465f-bd10-000999be1469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:30.156011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbadad-601d-465f-bd10-000999be1469 admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:30.156717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbadad-601d-465f-bd10-000999be1469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:30.158725 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbadad-601d-465f-bd10-000999be1469 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:30.184270 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1390/2827] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:08:30 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:08:30.188419 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15198bed-0ed2-4da6-b4e7-6bda7158c925 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:30.199287 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15198bed-0ed2-4da6-b4e7-6bda7158c925 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:30.253034 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08100f05-f6a3-4054-95f2-ed375bb2d1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:30.253641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08100f05-f6a3-4054-95f2-ed375bb2d1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:30.253916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08100f05-f6a3-4054-95f2-ed375bb2d1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:30.254204 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08100f05-f6a3-4054-95f2-ed375bb2d1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:30.254865 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08100f05-f6a3-4054-95f2-ed375bb2d1c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:30.256803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08100f05-f6a3-4054-95f2-ed375bb2d1c5 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:30.276251 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1438/2828] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:08:30 2022] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 14:08:30.280211 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbadad-601d-465f-bd10-000999be1469 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:30.290477 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbadad-601d-465f-bd10-000999be1469 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:30.295360 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bf95a-eeb2-4c4f-9e5c-4f1c225f5624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:30.296002 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bf95a-eeb2-4c4f-9e5c-4f1c225f5624 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:30.296309 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bf95a-eeb2-4c4f-9e5c-4f1c225f5624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:30.296583 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bf95a-eeb2-4c4f-9e5c-4f1c225f5624 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:30.297289 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bf95a-eeb2-4c4f-9e5c-4f1c225f5624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:30.298926 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bf95a-eeb2-4c4f-9e5c-4f1c225f5624 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:30.310771 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1391/2829] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:08:30.314658 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08100f05-f6a3-4054-95f2-ed375bb2d1c5 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:30.324425 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08100f05-f6a3-4054-95f2-ed375bb2d1c5 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:30.329025 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af702ffb-afda-4daa-af64-1b2cfaee8c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:30.329692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af702ffb-afda-4daa-af64-1b2cfaee8c0d admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:30.329953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af702ffb-afda-4daa-af64-1b2cfaee8c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:30.330229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af702ffb-afda-4daa-af64-1b2cfaee8c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:30.330942 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af702ffb-afda-4daa-af64-1b2cfaee8c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:30.332543 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af702ffb-afda-4daa-af64-1b2cfaee8c0d admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:30.342051 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1439/2830] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:08:30.345842 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bf95a-eeb2-4c4f-9e5c-4f1c225f5624 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:30.355958 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bf95a-eeb2-4c4f-9e5c-4f1c225f5624 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:30.360558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1668e5-be0b-4641-aa10-f7b9c6187bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:30.361439 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1668e5-be0b-4641-aa10-f7b9c6187bc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:30.361699 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1668e5-be0b-4641-aa10-f7b9c6187bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:30.361969 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1668e5-be0b-4641-aa10-f7b9c6187bc7 admin admin] PATH_INFO: `/v3/projects/91f76f1324a34acf9b6d0e42d04f78d0/users/553fb490b564499d920d31e3d2d62677/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:30.376670 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1668e5-be0b-4641-aa10-f7b9c6187bc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f76f1324a34acf9b6d0e42d04f78d0, user_id=553fb490b564499d920d31e3d2d62677, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:30.379292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1668e5-be0b-4641-aa10-f7b9c6187bc7 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:30.392499 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1392/2831] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:08:30 2022] PUT /identity/v3/projects/91f76f1324a34acf9b6d0e42d04f78d0/users/553fb490b564499d920d31e3d2d62677/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:30.404001 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad36a70-b0c6-44f7-ade4-6b28fc7e799f None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:30.404332 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad36a70-b0c6-44f7-ade4-6b28fc7e799f None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:30.404614 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad36a70-b0c6-44f7-ade4-6b28fc7e799f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:30.431424 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-3ad36a70-b0c6-44f7-ade4-6b28fc7e799f None None] MFA Rules not processed for user `553fb490b564499d920d31e3d2d62677`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:30.432672 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-3ad36a70-b0c6-44f7-ade4-6b28fc7e799f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:30.497594 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1440/2832] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:08:30.508806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1668e5-be0b-4641-aa10-f7b9c6187bc7 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:30.510506 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-ea1668e5-be0b-4641-aa10-f7b9c6187bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:30.565686 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1668e5-be0b-4641-aa10-f7b9c6187bc7 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:30.569335 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c486e-000c-4944-ae69-95da0384ddaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc8efc2d5134bdba361a5c7bcfc1ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:30.569961 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c486e-000c-4944-ae69-95da0384ddaa service cinder] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:30.570240 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c486e-000c-4944-ae69-95da0384ddaa service cinder] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:30.570510 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c486e-000c-4944-ae69-95da0384ddaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:30.578571 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c486e-000c-4944-ae69-95da0384ddaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:30.579970 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c486e-000c-4944-ae69-95da0384ddaa service cinder] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:30.588547 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1393/2833] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:08:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:08:49.488009 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad36a70-b0c6-44f7-ade4-6b28fc7e799f None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:49.489532 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-3ad36a70-b0c6-44f7-ade4-6b28fc7e799f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:49.555724 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad36a70-b0c6-44f7-ade4-6b28fc7e799f None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:49.560796 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1fcb2-b452-41ae-8841-247fa65a516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:49.561656 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1fcb2-b452-41ae-8841-247fa65a516f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:49.561937 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1fcb2-b452-41ae-8841-247fa65a516f admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:49.562218 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1fcb2-b452-41ae-8841-247fa65a516f admin admin] PATH_INFO: `/v3/users/fc0bd19faf4649178f2d918f70e5270c` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:49.563393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1fcb2-b452-41ae-8841-247fa65a516f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc0bd19faf4649178f2d918f70e5270c)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:49.565344 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1fcb2-b452-41ae-8841-247fa65a516f admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:49.609846 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-e7a1fcb2-b452-41ae-8841-247fa65a516f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc0bd19faf4649178f2d918f70e5270c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:49.622131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-e7a1fcb2-b452-41ae-8841-247fa65a516f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc0bd19faf4649178f2d918f70e5270c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:49.629057 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-e7a1fcb2-b452-41ae-8841-247fa65a516f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc0bd19faf4649178f2d918f70e5270c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:49.629769 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-e7a1fcb2-b452-41ae-8841-247fa65a516f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc0bd19faf4649178f2d918f70e5270c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:49.638215 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-e7a1fcb2-b452-41ae-8841-247fa65a516f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc0bd19faf4649178f2d918f70e5270c'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:49.645213 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1441/2834] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:08:49 2022] DELETE /identity/v3/users/fc0bd19faf4649178f2d918f70e5270c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:49.649800 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc396f-707f-44ba-968d-fc56428a743c None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:49.650351 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc396f-707f-44ba-968d-fc56428a743c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:49.650466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc396f-707f-44ba-968d-fc56428a743c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:49.668794 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-cccc396f-707f-44ba-968d-fc56428a743c None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:49.670007 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-cccc396f-707f-44ba-968d-fc56428a743c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:49.728148 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1394/2835] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:08:49.738091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1fcb2-b452-41ae-8841-247fa65a516f admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:49.739512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e7a1fcb2-b452-41ae-8841-247fa65a516f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:49.795716 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1fcb2-b452-41ae-8841-247fa65a516f admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:49.799209 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47240128-45cc-4e34-a496-e4e354a27728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:49.799860 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47240128-45cc-4e34-a496-e4e354a27728 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:49.800133 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47240128-45cc-4e34-a496-e4e354a27728 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:49.800429 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47240128-45cc-4e34-a496-e4e354a27728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:49.809758 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47240128-45cc-4e34-a496-e4e354a27728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:49.811142 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47240128-45cc-4e34-a496-e4e354a27728 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:49.820462 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1442/2836] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:08:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:08:50.087452 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc396f-707f-44ba-968d-fc56428a743c None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:50.089483 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-cccc396f-707f-44ba-968d-fc56428a743c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:50.101580 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc396f-707f-44ba-968d-fc56428a743c None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:50.106789 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8b590-1773-41fc-9e8e-7bb968f1af60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:50.107650 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8b590-1773-41fc-9e8e-7bb968f1af60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:50.107926 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8b590-1773-41fc-9e8e-7bb968f1af60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:50.108244 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8b590-1773-41fc-9e8e-7bb968f1af60 admin admin] PATH_INFO: `/v3/projects/b75bf53b4f3a4b86a8240ee8b2df8e48` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:50.109415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8b590-1773-41fc-9e8e-7bb968f1af60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75bf53b4f3a4b86a8240ee8b2df8e48)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:50.111293 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8b590-1773-41fc-9e8e-7bb968f1af60 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:50.157402 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-53b8b590-1773-41fc-9e8e-7bb968f1af60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75bf53b4f3a4b86a8240ee8b2df8e48', 'request_id': 'req-53b8b590-1773-41fc-9e8e-7bb968f1af60'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:50.162653 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-53b8b590-1773-41fc-9e8e-7bb968f1af60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75bf53b4f3a4b86a8240ee8b2df8e48', 'request_id': 'req-53b8b590-1773-41fc-9e8e-7bb968f1af60'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:50.168690 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-53b8b590-1773-41fc-9e8e-7bb968f1af60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75bf53b4f3a4b86a8240ee8b2df8e48', 'request_id': 'req-53b8b590-1773-41fc-9e8e-7bb968f1af60'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:50.180932 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-53b8b590-1773-41fc-9e8e-7bb968f1af60 admin admin] The token cache is being invalidate because project b75bf53b4f3a4b86a8240ee8b2df8e48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:08:50.181220 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-53b8b590-1773-41fc-9e8e-7bb968f1af60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:50.182339 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-53b8b590-1773-41fc-9e8e-7bb968f1af60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:50.183879 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1395/2837] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:08:50 2022] DELETE /identity/v3/projects/b75bf53b4f3a4b86a8240ee8b2df8e48 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:54.823550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47240128-45cc-4e34-a496-e4e354a27728 service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:54.824966 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-47240128-45cc-4e34-a496-e4e354a27728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:54.838115 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47240128-45cc-4e34-a496-e4e354a27728 service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:54.891115 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f45dac-58db-4b7e-9380-79239bb374ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:54.891974 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f45dac-58db-4b7e-9380-79239bb374ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:54.892282 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f45dac-58db-4b7e-9380-79239bb374ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:54.892558 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f45dac-58db-4b7e-9380-79239bb374ce admin admin] PATH_INFO: `/v3/users/553fb490b564499d920d31e3d2d62677` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:54.893727 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f45dac-58db-4b7e-9380-79239bb374ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=553fb490b564499d920d31e3d2d62677)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:54.895614 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f45dac-58db-4b7e-9380-79239bb374ce admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:54.939798 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-41f45dac-58db-4b7e-9380-79239bb374ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553fb490b564499d920d31e3d2d62677'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:54.952031 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-41f45dac-58db-4b7e-9380-79239bb374ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553fb490b564499d920d31e3d2d62677'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:54.958654 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-41f45dac-58db-4b7e-9380-79239bb374ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553fb490b564499d920d31e3d2d62677'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:54.959317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-41f45dac-58db-4b7e-9380-79239bb374ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553fb490b564499d920d31e3d2d62677'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:54.967314 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-41f45dac-58db-4b7e-9380-79239bb374ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553fb490b564499d920d31e3d2d62677'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:54.973299 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1443/2838] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:08:54 2022] DELETE /identity/v3/users/553fb490b564499d920d31e3d2d62677 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:54.978005 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc530ce-2c5b-4375-a871-3cf275461545 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:54.978496 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc530ce-2c5b-4375-a871-3cf275461545 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:54.978643 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc530ce-2c5b-4375-a871-3cf275461545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:54.995538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-6bc530ce-2c5b-4375-a871-3cf275461545 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:54.996746 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-6bc530ce-2c5b-4375-a871-3cf275461545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:55.054307 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1396/2839] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:08:55.064032 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f45dac-58db-4b7e-9380-79239bb374ce admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:55.065467 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-41f45dac-58db-4b7e-9380-79239bb374ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:55.122747 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f45dac-58db-4b7e-9380-79239bb374ce admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:55.126475 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca261c-acf9-4cfb-a6d7-36d3eaa41a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:55.127193 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca261c-acf9-4cfb-a6d7-36d3eaa41a19 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:55.127466 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca261c-acf9-4cfb-a6d7-36d3eaa41a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:55.127736 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca261c-acf9-4cfb-a6d7-36d3eaa41a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:55.136869 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca261c-acf9-4cfb-a6d7-36d3eaa41a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:55.138355 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca261c-acf9-4cfb-a6d7-36d3eaa41a19 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:55.148389 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1444/2840] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:08:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 14:08:55.407359 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc530ce-2c5b-4375-a871-3cf275461545 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:55.408916 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-6bc530ce-2c5b-4375-a871-3cf275461545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:55.422565 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc530ce-2c5b-4375-a871-3cf275461545 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:55.427340 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de3999-2d0a-4519-a352-ce4a56ce9044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:55.428919 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de3999-2d0a-4519-a352-ce4a56ce9044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:55.429210 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de3999-2d0a-4519-a352-ce4a56ce9044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:55.429489 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de3999-2d0a-4519-a352-ce4a56ce9044 admin admin] PATH_INFO: `/v3/projects/91f76f1324a34acf9b6d0e42d04f78d0` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:55.430696 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de3999-2d0a-4519-a352-ce4a56ce9044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91f76f1324a34acf9b6d0e42d04f78d0)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:55.433200 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de3999-2d0a-4519-a352-ce4a56ce9044 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:55.477066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-13de3999-2d0a-4519-a352-ce4a56ce9044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91f76f1324a34acf9b6d0e42d04f78d0', 'request_id': 'req-13de3999-2d0a-4519-a352-ce4a56ce9044'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:55.482292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-13de3999-2d0a-4519-a352-ce4a56ce9044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91f76f1324a34acf9b6d0e42d04f78d0', 'request_id': 'req-13de3999-2d0a-4519-a352-ce4a56ce9044'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:55.488201 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-13de3999-2d0a-4519-a352-ce4a56ce9044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91f76f1324a34acf9b6d0e42d04f78d0', 'request_id': 'req-13de3999-2d0a-4519-a352-ce4a56ce9044'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:55.500415 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-13de3999-2d0a-4519-a352-ce4a56ce9044 admin admin] The token cache is being invalidate because project 91f76f1324a34acf9b6d0e42d04f78d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:08:55.500719 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-13de3999-2d0a-4519-a352-ce4a56ce9044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:55.501313 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-13de3999-2d0a-4519-a352-ce4a56ce9044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:08:55.502815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1397/2841] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:08:55 2022] DELETE /identity/v3/projects/91f76f1324a34acf9b6d0e42d04f78d0 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:08:55.507970 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac1b9f-1790-4b04-92af-e61126079b77 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:55.508294 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac1b9f-1790-4b04-92af-e61126079b77 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:55.508573 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac1b9f-1790-4b04-92af-e61126079b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:55.526640 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-30ac1b9f-1790-4b04-92af-e61126079b77 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:55.527835 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-30ac1b9f-1790-4b04-92af-e61126079b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:55.583797 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1445/2842] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:08:55.592412 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca8d06-c370-43d8-9ccb-1355be188580 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:55.592704 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca8d06-c370-43d8-9ccb-1355be188580 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:55.592984 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca8d06-c370-43d8-9ccb-1355be188580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:55.610789 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-2cca8d06-c370-43d8-9ccb-1355be188580 None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:55.611967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-2cca8d06-c370-43d8-9ccb-1355be188580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:55.620386 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1398/2843] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:08:55.624290 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac1b9f-1790-4b04-92af-e61126079b77 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:55.633580 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac1b9f-1790-4b04-92af-e61126079b77 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:55.638564 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc19914-d483-4d90-ba08-10851fcf33ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:55.639198 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc19914-d483-4d90-ba08-10851fcf33ba admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:55.639475 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc19914-d483-4d90-ba08-10851fcf33ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:55.639754 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc19914-d483-4d90-ba08-10851fcf33ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:55.640757 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc19914-d483-4d90-ba08-10851fcf33ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79924) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 14:08:55.641061 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc19914-d483-4d90-ba08-10851fcf33ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:55.642642 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc19914-d483-4d90-ba08-10851fcf33ba admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:55.654204 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1446/2844] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 14:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 14:08:55.658205 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca8d06-c370-43d8-9ccb-1355be188580 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:55.667893 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca8d06-c370-43d8-9ccb-1355be188580 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:55.677496 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd491d9-8b3f-43ab-b4fc-e61d6e3a7e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:55.678137 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd491d9-8b3f-43ab-b4fc-e61d6e3a7e7c admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:55.678441 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd491d9-8b3f-43ab-b4fc-e61d6e3a7e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:55.678711 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd491d9-8b3f-43ab-b4fc-e61d6e3a7e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:55.681041 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd491d9-8b3f-43ab-b4fc-e61d6e3a7e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:55.682935 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd491d9-8b3f-43ab-b4fc-e61d6e3a7e7c admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:55.709619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1399/2845] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:08:55 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:08:55.714496 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc19914-d483-4d90-ba08-10851fcf33ba admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:55.724425 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc19914-d483-4d90-ba08-10851fcf33ba admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:55.780091 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ed1a9-62b9-492c-b627-5694437bfc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:55.780779 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ed1a9-62b9-492c-b627-5694437bfc2c admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:55.781060 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ed1a9-62b9-492c-b627-5694437bfc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:55.781332 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ed1a9-62b9-492c-b627-5694437bfc2c admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:55.782005 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ed1a9-62b9-492c-b627-5694437bfc2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:55.783867 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ed1a9-62b9-492c-b627-5694437bfc2c admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:55.802308 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1447/2846] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:08:55 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:08:55.806620 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd491d9-8b3f-43ab-b4fc-e61d6e3a7e7c admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:55.817285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd491d9-8b3f-43ab-b4fc-e61d6e3a7e7c admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:55.822725 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c0b4e-15bf-438f-aca2-da89e5aa7f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:55.823380 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0b4e-15bf-438f-aca2-da89e5aa7f5c admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:55.823663 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0b4e-15bf-438f-aca2-da89e5aa7f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:55.823937 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0b4e-15bf-438f-aca2-da89e5aa7f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:55.824701 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c0b4e-15bf-438f-aca2-da89e5aa7f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:55.826281 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c0b4e-15bf-438f-aca2-da89e5aa7f5c admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:55.836612 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1400/2847] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:08:55.840979 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ed1a9-62b9-492c-b627-5694437bfc2c admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:55.850535 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ed1a9-62b9-492c-b627-5694437bfc2c admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:55.855191 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d214561-ab17-477a-8ad2-a34dd97a79d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:55.855822 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d214561-ab17-477a-8ad2-a34dd97a79d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:55.856097 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d214561-ab17-477a-8ad2-a34dd97a79d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:55.856397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d214561-ab17-477a-8ad2-a34dd97a79d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:55.857102 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d214561-ab17-477a-8ad2-a34dd97a79d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:55.858641 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d214561-ab17-477a-8ad2-a34dd97a79d0 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:55.868292 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1448/2848] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:08:55.872016 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c0b4e-15bf-438f-aca2-da89e5aa7f5c admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:55.881859 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c0b4e-15bf-438f-aca2-da89e5aa7f5c admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:55.887242 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaba4f-30f9-4c0b-9fa6-46efe2feae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:55.888223 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaba4f-30f9-4c0b-9fa6-46efe2feae44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:55.888512 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaba4f-30f9-4c0b-9fa6-46efe2feae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:55.888788 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaba4f-30f9-4c0b-9fa6-46efe2feae44 admin admin] PATH_INFO: `/v3/projects/5534e7deeddb4f72b5e068060f617c76/users/eeb63f41f4b94ac29c82b334773ca9f8/roles/15845f6e13b44ef7893159f660311b15` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:55.904952 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaba4f-30f9-4c0b-9fa6-46efe2feae44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5534e7deeddb4f72b5e068060f617c76, user_id=eeb63f41f4b94ac29c82b334773ca9f8, role_id=15845f6e13b44ef7893159f660311b15)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:55.907605 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaba4f-30f9-4c0b-9fa6-46efe2feae44 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:55.920815 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1401/2849] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:08:55 2022] PUT /identity/v3/projects/5534e7deeddb4f72b5e068060f617c76/users/eeb63f41f4b94ac29c82b334773ca9f8/roles/15845f6e13b44ef7893159f660311b15 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:08:55.925994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f483157-ba3d-4ee3-95fe-419e681fe3eb None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:55.926277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f483157-ba3d-4ee3-95fe-419e681fe3eb None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:55.926551 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f483157-ba3d-4ee3-95fe-419e681fe3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:55.944783 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-1f483157-ba3d-4ee3-95fe-419e681fe3eb None None] MFA Rules not processed for user `bfaa5ec258f44012bccce1e5ad959ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:08:55.945945 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-1f483157-ba3d-4ee3-95fe-419e681fe3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:56.002131 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1449/2850] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:08:56.012044 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaba4f-30f9-4c0b-9fa6-46efe2feae44 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:08:56.013752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-80eaba4f-30f9-4c0b-9fa6-46efe2feae44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:08:56.069488 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaba4f-30f9-4c0b-9fa6-46efe2feae44 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:08:56.073636 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc254db7-da55-47f5-a34e-3a4139ae8453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:08:56.074285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc254db7-da55-47f5-a34e-3a4139ae8453 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:08:56.074563 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc254db7-da55-47f5-a34e-3a4139ae8453 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:08:56.074836 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc254db7-da55-47f5-a34e-3a4139ae8453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:08:56.083629 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc254db7-da55-47f5-a34e-3a4139ae8453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:08:56.085062 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc254db7-da55-47f5-a34e-3a4139ae8453 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:08:56.094234 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1402/2851] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:09:00.468524 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bd292-f6e2-4777-8e9c-35cec8a5f3a5 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:00.469044 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bd292-f6e2-4777-8e9c-35cec8a5f3a5 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:00.469144 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bd292-f6e2-4777-8e9c-35cec8a5f3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:00.497465 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-f51bd292-f6e2-4777-8e9c-35cec8a5f3a5 None None] MFA Rules not processed for user `eeb63f41f4b94ac29c82b334773ca9f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:09:00.498657 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-f51bd292-f6e2-4777-8e9c-35cec8a5f3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:00.564735 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1450/2852] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:09:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:09:00.569194 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc254db7-da55-47f5-a34e-3a4139ae8453 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:00.578838 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc254db7-da55-47f5-a34e-3a4139ae8453 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:00.583454 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174f84c-a946-47cd-ba2f-340ff861377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:00.584098 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174f84c-a946-47cd-ba2f-340ff861377a admin admin] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:00.584613 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174f84c-a946-47cd-ba2f-340ff861377a admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:00.585109 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174f84c-a946-47cd-ba2f-340ff861377a admin admin] PATH_INFO: `/v3/projects` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:00.585813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174f84c-a946-47cd-ba2f-340ff861377a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:00.588279 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174f84c-a946-47cd-ba2f-340ff861377a admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:00.614700 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1403/2853] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 14:09:00 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:09:00.619396 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bd292-f6e2-4777-8e9c-35cec8a5f3a5 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:00.631086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bd292-f6e2-4777-8e9c-35cec8a5f3a5 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:00.699911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156732b-d960-4027-a00c-dcc06f4ff6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:00.700714 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156732b-d960-4027-a00c-dcc06f4ff6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:00.700992 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156732b-d960-4027-a00c-dcc06f4ff6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:00.701260 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156732b-d960-4027-a00c-dcc06f4ff6a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:00.702012 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156732b-d960-4027-a00c-dcc06f4ff6a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:00.704062 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156732b-d960-4027-a00c-dcc06f4ff6a3 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:00.728941 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1451/2854] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 14:09:00 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 14:09:00.730174 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174f84c-a946-47cd-ba2f-340ff861377a admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:00.741060 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174f84c-a946-47cd-ba2f-340ff861377a admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:00.746522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013284d-ba34-4eed-8998-beef9d00111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:00.747099 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013284d-ba34-4eed-8998-beef9d00111f admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:00.747381 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013284d-ba34-4eed-8998-beef9d00111f admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:00.750894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013284d-ba34-4eed-8998-beef9d00111f admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:00.750894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013284d-ba34-4eed-8998-beef9d00111f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:00.750894 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013284d-ba34-4eed-8998-beef9d00111f admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:00.776689 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1404/2855] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 14:09:00.778854 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156732b-d960-4027-a00c-dcc06f4ff6a3 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:00.789133 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156732b-d960-4027-a00c-dcc06f4ff6a3 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:00.793885 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c3e7d-6938-4936-8ec3-0a346878713f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:00.794772 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c3e7d-6938-4936-8ec3-0a346878713f admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:00.795054 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c3e7d-6938-4936-8ec3-0a346878713f admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:00.795331 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c3e7d-6938-4936-8ec3-0a346878713f admin admin] PATH_INFO: `/v3/projects/e8d60c3a227e4d0f9ee942520ce94f06/users/d0234f0dd16f499a827cd0ec912aa8a5/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:00.811425 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c3e7d-6938-4936-8ec3-0a346878713f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d60c3a227e4d0f9ee942520ce94f06, user_id=d0234f0dd16f499a827cd0ec912aa8a5, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:00.814086 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c3e7d-6938-4936-8ec3-0a346878713f admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:00.828796 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1452/2856] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:09:00 2022] PUT /identity/v3/projects/e8d60c3a227e4d0f9ee942520ce94f06/users/d0234f0dd16f499a827cd0ec912aa8a5/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:09:00.832806 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013284d-ba34-4eed-8998-beef9d00111f admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:00.842932 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013284d-ba34-4eed-8998-beef9d00111f admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:00.904030 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f24e3-b6b0-4a40-87ab-3b260ee3cf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:00.904731 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f24e3-b6b0-4a40-87ab-3b260ee3cf08 admin admin] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:00.905014 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f24e3-b6b0-4a40-87ab-3b260ee3cf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:00.905292 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f24e3-b6b0-4a40-87ab-3b260ee3cf08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:00.906058 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f24e3-b6b0-4a40-87ab-3b260ee3cf08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:00.907601 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f24e3-b6b0-4a40-87ab-3b260ee3cf08 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:00.919669 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1405/2857] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 14:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 14:09:00.923744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c3e7d-6938-4936-8ec3-0a346878713f admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:00.936278 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c3e7d-6938-4936-8ec3-0a346878713f admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:00.942150 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e62909-2d2b-4467-924a-85ac829c41ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:00.943116 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e62909-2d2b-4467-924a-85ac829c41ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:00.943393 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e62909-2d2b-4467-924a-85ac829c41ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:00.943728 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e62909-2d2b-4467-924a-85ac829c41ed admin admin] PATH_INFO: `/v3/projects/e8d60c3a227e4d0f9ee942520ce94f06/users/d0234f0dd16f499a827cd0ec912aa8a5/roles/ef3b4e4f0c1e44ffb59235164ffac17d` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:00.945794 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e62909-2d2b-4467-924a-85ac829c41ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d60c3a227e4d0f9ee942520ce94f06, user_id=d0234f0dd16f499a827cd0ec912aa8a5, role_id=ef3b4e4f0c1e44ffb59235164ffac17d)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:00.948525 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e62909-2d2b-4467-924a-85ac829c41ed admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:00.959916 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1453/2858] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 14:09:00 2022] PUT /identity/v3/projects/e8d60c3a227e4d0f9ee942520ce94f06/users/d0234f0dd16f499a827cd0ec912aa8a5/roles/ef3b4e4f0c1e44ffb59235164ffac17d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:09:06.297034 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1e170-7dff-4b5a-bf55-9117166aa6a0 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:06.297485 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1e170-7dff-4b5a-bf55-9117166aa6a0 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:06.297611 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1e170-7dff-4b5a-bf55-9117166aa6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:06.335619 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-43b1e170-7dff-4b5a-bf55-9117166aa6a0 None None] MFA Rules not processed for user `d0234f0dd16f499a827cd0ec912aa8a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:09:06.337286 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-43b1e170-7dff-4b5a-bf55-9117166aa6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:06.414559 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1406/2859] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:09:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:09:06.429241 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e62909-2d2b-4467-924a-85ac829c41ed admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:06.431612 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b4e62909-2d2b-4467-924a-85ac829c41ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:06.508441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e62909-2d2b-4467-924a-85ac829c41ed admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:06.512287 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a403f0-65c8-45ff-ba90-1ab16df78d5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:06.512953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a403f0-65c8-45ff-ba90-1ab16df78d5d service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:06.513237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a403f0-65c8-45ff-ba90-1ab16df78d5d service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:06.513514 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a403f0-65c8-45ff-ba90-1ab16df78d5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:06.571495 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a403f0-65c8-45ff-ba90-1ab16df78d5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:06.573268 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a403f0-65c8-45ff-ba90-1ab16df78d5d service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:06.582521 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1454/2860] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:09:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:09:07.638050 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600e650-366c-491c-bb26-e529907dd597 None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:07.638585 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600e650-366c-491c-bb26-e529907dd597 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:07.638585 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600e650-366c-491c-bb26-e529907dd597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:07.656072 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-8600e650-366c-491c-bb26-e529907dd597 None None] MFA Rules not processed for user `eeb63f41f4b94ac29c82b334773ca9f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:09:07.657329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-8600e650-366c-491c-bb26-e529907dd597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:07.664285 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1407/2861] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:09:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:09:16.919336 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def82372-e0af-4e71-b67c-7494b9ea8b0b None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:16.919977 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def82372-e0af-4e71-b67c-7494b9ea8b0b None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:16.919977 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def82372-e0af-4e71-b67c-7494b9ea8b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:16.936532 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-def82372-e0af-4e71-b67c-7494b9ea8b0b None None] MFA Rules not processed for user `2afab5deb8c34f058c659a22a3402c59`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:09:16.937703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-def82372-e0af-4e71-b67c-7494b9ea8b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:16.992923 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1455/2862] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 14:09:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:09:48.340045 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600e650-366c-491c-bb26-e529907dd597 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:48.397558 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600e650-366c-491c-bb26-e529907dd597 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:48.401956 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6888f7-f055-48ec-a526-caa2b4ddad97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:48.402599 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6888f7-f055-48ec-a526-caa2b4ddad97 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:48.402881 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6888f7-f055-48ec-a526-caa2b4ddad97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:48.403155 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6888f7-f055-48ec-a526-caa2b4ddad97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:48.413299 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6888f7-f055-48ec-a526-caa2b4ddad97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:48.414896 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6888f7-f055-48ec-a526-caa2b4ddad97 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:48.425260 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1408/2863] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:09:48 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:09:54.090425 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def82372-e0af-4e71-b67c-7494b9ea8b0b None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:54.099907 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def82372-e0af-4e71-b67c-7494b9ea8b0b None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:54.103409 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94db113-0ce3-4117-8590-fe978941da31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:54.104048 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94db113-0ce3-4117-8590-fe978941da31 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:54.104369 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94db113-0ce3-4117-8590-fe978941da31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:54.104643 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94db113-0ce3-4117-8590-fe978941da31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:54.106386 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e94db113-0ce3-4117-8590-fe978941da31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:54.120963 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94db113-0ce3-4117-8590-fe978941da31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:54.123034 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94db113-0ce3-4117-8590-fe978941da31 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:54.136017 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1456/2864] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:09:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:09:57.697329 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6888f7-f055-48ec-a526-caa2b4ddad97 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:09:57.706717 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6888f7-f055-48ec-a526-caa2b4ddad97 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:09:57.710798 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fe06f-47d4-4eed-b398-96c305959187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:09:57.711669 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fe06f-47d4-4eed-b398-96c305959187 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:09:57.711956 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fe06f-47d4-4eed-b398-96c305959187 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:09:57.712290 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fe06f-47d4-4eed-b398-96c305959187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:09:57.714136 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-5f3fe06f-47d4-4eed-b398-96c305959187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:09:57.779774 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fe06f-47d4-4eed-b398-96c305959187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:09:57.781434 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fe06f-47d4-4eed-b398-96c305959187 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:09:57.793059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1409/2865] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:10:04.316422 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94db113-0ce3-4117-8590-fe978941da31 service neutron] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:10:04.317824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e94db113-0ce3-4117-8590-fe978941da31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:10:04.331680 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94db113-0ce3-4117-8590-fe978941da31 service neutron] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:10:04.336845 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be88222-5a22-485a-a5bb-8396c4eeb229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:10:04.337969 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88222-5a22-485a-a5bb-8396c4eeb229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:10:04.338235 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88222-5a22-485a-a5bb-8396c4eeb229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:10:04.338650 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88222-5a22-485a-a5bb-8396c4eeb229 admin admin] PATH_INFO: `/v3/users/9d87a4de3fbf4cbb9e21523634007629` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:10:04.339868 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be88222-5a22-485a-a5bb-8396c4eeb229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d87a4de3fbf4cbb9e21523634007629)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:10:04.342367 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be88222-5a22-485a-a5bb-8396c4eeb229 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:10:04.392281 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2be88222-5a22-485a-a5bb-8396c4eeb229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d87a4de3fbf4cbb9e21523634007629'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:04.412848 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2be88222-5a22-485a-a5bb-8396c4eeb229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d87a4de3fbf4cbb9e21523634007629'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:04.420163 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2be88222-5a22-485a-a5bb-8396c4eeb229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d87a4de3fbf4cbb9e21523634007629'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:04.420941 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2be88222-5a22-485a-a5bb-8396c4eeb229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d87a4de3fbf4cbb9e21523634007629'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:04.428550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-2be88222-5a22-485a-a5bb-8396c4eeb229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d87a4de3fbf4cbb9e21523634007629'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:04.434932 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1457/2866] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:10:04 2022] DELETE /identity/v3/users/9d87a4de3fbf4cbb9e21523634007629 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:10:04.605538 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fe06f-47d4-4eed-b398-96c305959187 service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:10:04.615738 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fe06f-47d4-4eed-b398-96c305959187 service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:10:04.671255 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:10:04.672087 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:10:04.672401 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:10:04.672673 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0 admin admin] PATH_INFO: `/v3/projects/104740054c3a47ca8cc3cb262d975fd5` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:10:04.673839 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=104740054c3a47ca8cc3cb262d975fd5)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:10:04.675719 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:10:04.719246 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104740054c3a47ca8cc3cb262d975fd5', 'request_id': 'req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:04.724552 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104740054c3a47ca8cc3cb262d975fd5', 'request_id': 'req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:04.730568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104740054c3a47ca8cc3cb262d975fd5', 'request_id': 'req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:04.743652 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0 admin admin] The token cache is being invalidate because project 104740054c3a47ca8cc3cb262d975fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:10:04.743940 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:04.744566 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:04.746079 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1410/2867] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:10:04 2022] DELETE /identity/v3/projects/104740054c3a47ca8cc3cb262d975fd5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:10:04.750824 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be88222-5a22-485a-a5bb-8396c4eeb229 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:10:04.752237 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-2be88222-5a22-485a-a5bb-8396c4eeb229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:10:04.766277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be88222-5a22-485a-a5bb-8396c4eeb229 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:10:04.820309 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbd4f2-739c-456c-9475-6ad04ec49092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:10:04.821165 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbd4f2-739c-456c-9475-6ad04ec49092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:10:04.821440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbd4f2-739c-456c-9475-6ad04ec49092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:10:04.821709 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbd4f2-739c-456c-9475-6ad04ec49092 admin admin] PATH_INFO: `/v3/users/b92a47e8971d49f3bbeea408a189aad7` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:10:04.822899 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbd4f2-739c-456c-9475-6ad04ec49092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92a47e8971d49f3bbeea408a189aad7)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:10:04.824840 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbd4f2-739c-456c-9475-6ad04ec49092 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:10:04.868512 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-46fbd4f2-739c-456c-9475-6ad04ec49092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92a47e8971d49f3bbeea408a189aad7'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:04.880971 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-46fbd4f2-739c-456c-9475-6ad04ec49092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92a47e8971d49f3bbeea408a189aad7'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:04.887684 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-46fbd4f2-739c-456c-9475-6ad04ec49092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92a47e8971d49f3bbeea408a189aad7'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:04.888440 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-46fbd4f2-739c-456c-9475-6ad04ec49092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92a47e8971d49f3bbeea408a189aad7'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:04.895987 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-46fbd4f2-739c-456c-9475-6ad04ec49092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92a47e8971d49f3bbeea408a189aad7'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:04.902183 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1458/2868] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:10:04 2022] DELETE /identity/v3/users/b92a47e8971d49f3bbeea408a189aad7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:10:05.076195 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:10:05.078539 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:10:05.102593 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcfb71-6ea3-49fe-9628-5c7607fd4cc0 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:10:05.158404 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83056b96-25fc-46a8-8548-5d418b4538f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:10:05.159180 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83056b96-25fc-46a8-8548-5d418b4538f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:10:05.159457 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83056b96-25fc-46a8-8548-5d418b4538f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:10:05.159728 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83056b96-25fc-46a8-8548-5d418b4538f9 admin admin] PATH_INFO: `/v3/projects/d63edf0ea87748beb70946b8950b066f` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:10:05.160921 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83056b96-25fc-46a8-8548-5d418b4538f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63edf0ea87748beb70946b8950b066f)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:10:05.162809 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83056b96-25fc-46a8-8548-5d418b4538f9 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:10:05.206974 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-83056b96-25fc-46a8-8548-5d418b4538f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63edf0ea87748beb70946b8950b066f', 'request_id': 'req-83056b96-25fc-46a8-8548-5d418b4538f9'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:05.212142 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-83056b96-25fc-46a8-8548-5d418b4538f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63edf0ea87748beb70946b8950b066f', 'request_id': 'req-83056b96-25fc-46a8-8548-5d418b4538f9'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:05.218644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-83056b96-25fc-46a8-8548-5d418b4538f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63edf0ea87748beb70946b8950b066f', 'request_id': 'req-83056b96-25fc-46a8-8548-5d418b4538f9'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:05.230261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-83056b96-25fc-46a8-8548-5d418b4538f9 admin admin] The token cache is being invalidate because project d63edf0ea87748beb70946b8950b066f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:10:05.230545 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-83056b96-25fc-46a8-8548-5d418b4538f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:05.231155 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-83056b96-25fc-46a8-8548-5d418b4538f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:05.233267 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1411/2869] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:10:05 2022] DELETE /identity/v3/projects/d63edf0ea87748beb70946b8950b066f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 14:10:19.276894 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbd4f2-739c-456c-9475-6ad04ec49092 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:10:19.278345 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-46fbd4f2-739c-456c-9475-6ad04ec49092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:10:19.291884 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbd4f2-739c-456c-9475-6ad04ec49092 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:10:19.346819 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf609c-a56f-4e2e-8d1b-4ac53843f0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:10:19.347691 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf609c-a56f-4e2e-8d1b-4ac53843f0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:10:19.347972 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf609c-a56f-4e2e-8d1b-4ac53843f0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:10:19.348277 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf609c-a56f-4e2e-8d1b-4ac53843f0ad admin admin] PATH_INFO: `/v3/users/2afab5deb8c34f058c659a22a3402c59` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:10:19.349457 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf609c-a56f-4e2e-8d1b-4ac53843f0ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=2afab5deb8c34f058c659a22a3402c59)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:10:19.351345 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf609c-a56f-4e2e-8d1b-4ac53843f0ad admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:10:19.395820 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bacf609c-a56f-4e2e-8d1b-4ac53843f0ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2afab5deb8c34f058c659a22a3402c59'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:19.407842 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bacf609c-a56f-4e2e-8d1b-4ac53843f0ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2afab5deb8c34f058c659a22a3402c59'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:19.414879 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bacf609c-a56f-4e2e-8d1b-4ac53843f0ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2afab5deb8c34f058c659a22a3402c59'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:19.415570 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bacf609c-a56f-4e2e-8d1b-4ac53843f0ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2afab5deb8c34f058c659a22a3402c59'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:19.423018 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-bacf609c-a56f-4e2e-8d1b-4ac53843f0ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2afab5deb8c34f058c659a22a3402c59'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:19.428997 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1459/2870] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:10:19 2022] DELETE /identity/v3/users/2afab5deb8c34f058c659a22a3402c59 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:10:19.596908 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83056b96-25fc-46a8-8548-5d418b4538f9 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:10:19.598367 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-83056b96-25fc-46a8-8548-5d418b4538f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:10:19.611126 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83056b96-25fc-46a8-8548-5d418b4538f9 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:10:19.670761 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734ef5a-2511-4eb9-82da-898ac24c544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:10:19.671535 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734ef5a-2511-4eb9-82da-898ac24c544d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:10:19.671813 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734ef5a-2511-4eb9-82da-898ac24c544d admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:10:19.672083 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734ef5a-2511-4eb9-82da-898ac24c544d admin admin] PATH_INFO: `/v3/projects/a2a2e2e6222f48ebae4e9f9d7e9e8a4d` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:10:19.673294 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734ef5a-2511-4eb9-82da-898ac24c544d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a2e2e6222f48ebae4e9f9d7e9e8a4d)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:10:19.675158 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734ef5a-2511-4eb9-82da-898ac24c544d admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:10:19.720719 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-a734ef5a-2511-4eb9-82da-898ac24c544d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'request_id': 'req-a734ef5a-2511-4eb9-82da-898ac24c544d'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:19.725921 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-a734ef5a-2511-4eb9-82da-898ac24c544d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'request_id': 'req-a734ef5a-2511-4eb9-82da-898ac24c544d'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:19.731763 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-a734ef5a-2511-4eb9-82da-898ac24c544d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a2e2e6222f48ebae4e9f9d7e9e8a4d', 'request_id': 'req-a734ef5a-2511-4eb9-82da-898ac24c544d'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:19.744118 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-a734ef5a-2511-4eb9-82da-898ac24c544d admin admin] The token cache is being invalidate because project a2a2e2e6222f48ebae4e9f9d7e9e8a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79925) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:10:19.744436 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-a734ef5a-2511-4eb9-82da-898ac24c544d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:19.745082 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-a734ef5a-2511-4eb9-82da-898ac24c544d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:10:19.746636 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1412/2871] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:10:19 2022] DELETE /identity/v3/projects/a2a2e2e6222f48ebae4e9f9d7e9e8a4d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:11:02.403295 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf609c-a56f-4e2e-8d1b-4ac53843f0ad admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:02.404703 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-bacf609c-a56f-4e2e-8d1b-4ac53843f0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:02.460441 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf609c-a56f-4e2e-8d1b-4ac53843f0ad admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:02.506616 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15520edd-2824-431c-8266-a6c7189a6eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:02.507252 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15520edd-2824-431c-8266-a6c7189a6eae service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:02.507530 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15520edd-2824-431c-8266-a6c7189a6eae service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:02.507803 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15520edd-2824-431c-8266-a6c7189a6eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:02.509599 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-15520edd-2824-431c-8266-a6c7189a6eae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:02.519336 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15520edd-2824-431c-8266-a6c7189a6eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:02.520758 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15520edd-2824-431c-8266-a6c7189a6eae service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:02.528544 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1460/2872] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:11:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:11:48.683995 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734ef5a-2511-4eb9-82da-898ac24c544d admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:11:48.685440 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-a734ef5a-2511-4eb9-82da-898ac24c544d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:48.697471 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734ef5a-2511-4eb9-82da-898ac24c544d admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:11:48.701056 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48b396-ae20-41c5-8cb4-1d82950f5a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:11:48.701684 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48b396-ae20-41c5-8cb4-1d82950f5a25 service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:11:48.701967 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48b396-ae20-41c5-8cb4-1d82950f5a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:11:48.702245 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48b396-ae20-41c5-8cb4-1d82950f5a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:11:48.703941 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-9f48b396-ae20-41c5-8cb4-1d82950f5a25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:11:48.773277 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48b396-ae20-41c5-8cb4-1d82950f5a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:11:48.774714 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48b396-ae20-41c5-8cb4-1d82950f5a25 service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:11:48.786209 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1413/2873] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:11:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:12:00.653994 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9cc9-9e23-40b4-bf93-87ba1b635193 None None] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:00.654611 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9cc9-9e23-40b4-bf93-87ba1b635193 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:00.654952 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9cc9-9e23-40b4-bf93-87ba1b635193 None None] PATH_INFO: `/` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:00.656721 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1461/2874] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 14:12:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:12:00.663236 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421bb2e-244a-4432-99b1-81d2620c9c8c None None] REQUEST_METHOD: `POST` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:00.663730 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421bb2e-244a-4432-99b1-81d2620c9c8c None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:00.663841 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421bb2e-244a-4432-99b1-81d2620c9c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:00.701818 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.auth.core [None req-0421bb2e-244a-4432-99b1-81d2620c9c8c None None] MFA Rules not processed for user `930f350dad954c7783f479bbb25c1f46`. Rule list: `[]` (Enabled: `True`). {{(pid=79925) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:00.703295 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0421bb2e-244a-4432-99b1-81d2620c9c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:00.709807 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1414/2875] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 14:12:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 14:12:00.722050 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca9cc9-9e23-40b4-bf93-87ba1b635193 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:00.723744 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-b8ca9cc9-9e23-40b4-bf93-87ba1b635193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:00.736620 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca9cc9-9e23-40b4-bf93-87ba1b635193 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:00.740815 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75487aa3-125e-4d0d-bb34-a53ad8e59dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:00.741525 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75487aa3-125e-4d0d-bb34-a53ad8e59dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:00.741868 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75487aa3-125e-4d0d-bb34-a53ad8e59dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:00.742147 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75487aa3-125e-4d0d-bb34-a53ad8e59dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:00.749384 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75487aa3-125e-4d0d-bb34-a53ad8e59dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:00.750770 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75487aa3-125e-4d0d-bb34-a53ad8e59dc5 service neutron] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:00.759246 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1462/2876] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:12:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:12:00.843817 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aaae0-3e0d-4231-ba96-a265efd6d441 None None] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:00.844108 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aaae0-3e0d-4231-ba96-a265efd6d441 None None] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:00.844421 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aaae0-3e0d-4231-ba96-a265efd6d441 None None] PATH_INFO: `/` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:00.845844 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1415/2877] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 14:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 14:12:00.851206 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c32829-2ba6-4a2c-94cd-37681edb3489 None None] REQUEST_METHOD: `POST` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:00.851492 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c32829-2ba6-4a2c-94cd-37681edb3489 None None] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:00.851765 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c32829-2ba6-4a2c-94cd-37681edb3489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:00.870039 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.auth.core [None req-e5c32829-2ba6-4a2c-94cd-37681edb3489 None None] MFA Rules not processed for user `975f10f781b94bdaa8edee39a2b1bba4`. Rule list: `[]` (Enabled: `True`). {{(pid=79924) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 14:12:00.871197 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e5c32829-2ba6-4a2c-94cd-37681edb3489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:00.880911 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1463/2878] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 14:12:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 14:12:00.891350 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084aaae0-3e0d-4231-ba96-a265efd6d441 None None] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:00.902945 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084aaae0-3e0d-4231-ba96-a265efd6d441 None None] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:00.906537 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84896a17-a9d8-4f41-bc29-9652abe55fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930f350dad954c7783f479bbb25c1f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:00.907159 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84896a17-a9d8-4f41-bc29-9652abe55fab service neutron] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:00.907436 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84896a17-a9d8-4f41-bc29-9652abe55fab service neutron] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:00.907703 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84896a17-a9d8-4f41-bc29-9652abe55fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:00.917722 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84896a17-a9d8-4f41-bc29-9652abe55fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:00.919146 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84896a17-a9d8-4f41-bc29-9652abe55fab service neutron] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:00.930059 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1416/2879] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:12:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:12:00.993051 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c32829-2ba6-4a2c-94cd-37681edb3489 None None] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:00.994498 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e5c32829-2ba6-4a2c-94cd-37681edb3489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:01.060256 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c32829-2ba6-4a2c-94cd-37681edb3489 None None] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:01.065397 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ac7c6-c382-4d0a-8e9f-f0d36fb75de2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8a29487b009419dbead4684bcd01cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:01.066036 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ac7c6-c382-4d0a-8e9f-f0d36fb75de2 service placement] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:01.066315 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ac7c6-c382-4d0a-8e9f-f0d36fb75de2 service placement] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:01.066590 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ac7c6-c382-4d0a-8e9f-f0d36fb75de2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:01.068409 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cf6ac7c6-c382-4d0a-8e9f-f0d36fb75de2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:01.079417 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ac7c6-c382-4d0a-8e9f-f0d36fb75de2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:01.081006 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ac7c6-c382-4d0a-8e9f-f0d36fb75de2 service placement] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:01.090601 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1464/2880] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:12:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:12:03.346383 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84896a17-a9d8-4f41-bc29-9652abe55fab service neutron] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:12:03.348250 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-84896a17-a9d8-4f41-bc29-9652abe55fab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:03.365664 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84896a17-a9d8-4f41-bc29-9652abe55fab service neutron] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:12:03.371569 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d72b4-ba6c-49cd-9966-e568b38bcb48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:12:03.372251 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d72b4-ba6c-49cd-9966-e568b38bcb48 service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:12:03.372536 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d72b4-ba6c-49cd-9966-e568b38bcb48 service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:12:03.372814 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d72b4-ba6c-49cd-9966-e568b38bcb48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:12:03.375170 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0c8d72b4-ba6c-49cd-9966-e568b38bcb48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:12:03.396814 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d72b4-ba6c-49cd-9966-e568b38bcb48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:12:03.398752 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d72b4-ba6c-49cd-9966-e568b38bcb48 service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:12:03.410061 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1417/2881] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:12:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:13:03.645160 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ac7c6-c382-4d0a-8e9f-f0d36fb75de2 service placement] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:03.646550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-cf6ac7c6-c382-4d0a-8e9f-f0d36fb75de2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:03.727178 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ac7c6-c382-4d0a-8e9f-f0d36fb75de2 service placement] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:03.732302 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4156c5d-d30c-4c34-b281-13b734c96097 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8a29487b009419dbead4684bcd01cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:03.732938 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4156c5d-d30c-4c34-b281-13b734c96097 service placement] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:03.733216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4156c5d-d30c-4c34-b281-13b734c96097 service placement] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:03.733489 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4156c5d-d30c-4c34-b281-13b734c96097 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:03.735225 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a4156c5d-d30c-4c34-b281-13b734c96097 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:03.746826 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4156c5d-d30c-4c34-b281-13b734c96097 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:03.748417 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4156c5d-d30c-4c34-b281-13b734c96097 service placement] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:03.758578 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1465/2882] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:13:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:13:26.284042 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d72b4-ba6c-49cd-9966-e568b38bcb48 service nova] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:26.356205 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d72b4-ba6c-49cd-9966-e568b38bcb48 service nova] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:26.362853 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28101b-1388-4fd2-9e32-6ed10d7e8d3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:26.364155 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28101b-1388-4fd2-9e32-6ed10d7e8d3d service nova] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:26.365386 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28101b-1388-4fd2-9e32-6ed10d7e8d3d service nova] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:26.365386 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28101b-1388-4fd2-9e32-6ed10d7e8d3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:26.367261 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0c28101b-1388-4fd2-9e32-6ed10d7e8d3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:26.399302 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28101b-1388-4fd2-9e32-6ed10d7e8d3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:26.400495 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28101b-1388-4fd2-9e32-6ed10d7e8d3d service nova] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:26.431517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1418/2883] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:13:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:13:28.613202 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4156c5d-d30c-4c34-b281-13b734c96097 service placement] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:28.614687 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-a4156c5d-d30c-4c34-b281-13b734c96097 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:28.631195 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4156c5d-d30c-4c34-b281-13b734c96097 service placement] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:28.636719 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f7c48-da67-4a3c-9ec2-9135eaa2c519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975f10f781b94bdaa8edee39a2b1bba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:28.637394 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f7c48-da67-4a3c-9ec2-9135eaa2c519 service nova] REQUEST_METHOD: `GET` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:28.637676 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f7c48-da67-4a3c-9ec2-9135eaa2c519 service nova] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:28.637953 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f7c48-da67-4a3c-9ec2-9135eaa2c519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:28.639705 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-e57f7c48-da67-4a3c-9ec2-9135eaa2c519 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:28.652848 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f7c48-da67-4a3c-9ec2-9135eaa2c519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:28.654690 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f7c48-da67-4a3c-9ec2-9135eaa2c519 service nova] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:28.665615 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1466/2884] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:13:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 14:13:36.154364 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28101b-1388-4fd2-9e32-6ed10d7e8d3d service nova] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:36.155950 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-0c28101b-1388-4fd2-9e32-6ed10d7e8d3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:36.260011 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28101b-1388-4fd2-9e32-6ed10d7e8d3d service nova] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:36.266522 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b09f3-c2b6-4c98-ba61-4802f2947155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:36.267053 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b09f3-c2b6-4c98-ba61-4802f2947155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:36.267331 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b09f3-c2b6-4c98-ba61-4802f2947155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:36.267861 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b09f3-c2b6-4c98-ba61-4802f2947155 admin admin] PATH_INFO: `/v3/users/eeb63f41f4b94ac29c82b334773ca9f8` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:36.269090 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b09f3-c2b6-4c98-ba61-4802f2947155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb63f41f4b94ac29c82b334773ca9f8)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:36.271362 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b09f3-c2b6-4c98-ba61-4802f2947155 admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:36.319246 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-535b09f3-c2b6-4c98-ba61-4802f2947155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb63f41f4b94ac29c82b334773ca9f8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:36.319922 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-535b09f3-c2b6-4c98-ba61-4802f2947155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb63f41f4b94ac29c82b334773ca9f8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:36.331241 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-535b09f3-c2b6-4c98-ba61-4802f2947155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb63f41f4b94ac29c82b334773ca9f8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:36.338692 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-535b09f3-c2b6-4c98-ba61-4802f2947155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb63f41f4b94ac29c82b334773ca9f8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:36.339303 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-535b09f3-c2b6-4c98-ba61-4802f2947155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb63f41f4b94ac29c82b334773ca9f8'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:36.351517 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1419/2885] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:13:36 2022] DELETE /identity/v3/users/eeb63f41f4b94ac29c82b334773ca9f8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:13:36.520406 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f7c48-da67-4a3c-9ec2-9135eaa2c519 service nova] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:36.531595 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f7c48-da67-4a3c-9ec2-9135eaa2c519 service nova] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:36.592229 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1775c8-950b-434a-917f-c5a9c82e5150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:36.593093 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1775c8-950b-434a-917f-c5a9c82e5150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:36.593375 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1775c8-950b-434a-917f-c5a9c82e5150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:36.593651 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1775c8-950b-434a-917f-c5a9c82e5150 admin admin] PATH_INFO: `/v3/projects/5534e7deeddb4f72b5e068060f617c76` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:36.594842 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1775c8-950b-434a-917f-c5a9c82e5150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5534e7deeddb4f72b5e068060f617c76)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:36.596767 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1775c8-950b-434a-917f-c5a9c82e5150 admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:36.639377 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9b1775c8-950b-434a-917f-c5a9c82e5150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5534e7deeddb4f72b5e068060f617c76', 'request_id': 'req-9b1775c8-950b-434a-917f-c5a9c82e5150'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:36.647104 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9b1775c8-950b-434a-917f-c5a9c82e5150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5534e7deeddb4f72b5e068060f617c76', 'request_id': 'req-9b1775c8-950b-434a-917f-c5a9c82e5150'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:36.652513 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9b1775c8-950b-434a-917f-c5a9c82e5150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5534e7deeddb4f72b5e068060f617c76', 'request_id': 'req-9b1775c8-950b-434a-917f-c5a9c82e5150'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:36.663720 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9b1775c8-950b-434a-917f-c5a9c82e5150 admin admin] The token cache is being invalidate because project 5534e7deeddb4f72b5e068060f617c76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:13:36.664006 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9b1775c8-950b-434a-917f-c5a9c82e5150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:36.664659 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-9b1775c8-950b-434a-917f-c5a9c82e5150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:36.666172 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1467/2886] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:13:36 2022] DELETE /identity/v3/projects/5534e7deeddb4f72b5e068060f617c76 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:13:36.670160 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b09f3-c2b6-4c98-ba61-4802f2947155 admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:36.671644 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-535b09f3-c2b6-4c98-ba61-4802f2947155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:36.684348 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b09f3-c2b6-4c98-ba61-4802f2947155 admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:36.738282 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9409e-331c-43e0-b2bf-03f26df4f1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:36.739066 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9409e-331c-43e0-b2bf-03f26df4f1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:36.739341 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9409e-331c-43e0-b2bf-03f26df4f1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:36.739612 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9409e-331c-43e0-b2bf-03f26df4f1cb admin admin] PATH_INFO: `/v3/users/d0234f0dd16f499a827cd0ec912aa8a5` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:36.740804 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9409e-331c-43e0-b2bf-03f26df4f1cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0234f0dd16f499a827cd0ec912aa8a5)` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:36.742702 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9409e-331c-43e0-b2bf-03f26df4f1cb admin admin] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:36.787568 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4ea9409e-331c-43e0-b2bf-03f26df4f1cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0234f0dd16f499a827cd0ec912aa8a5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:36.788256 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4ea9409e-331c-43e0-b2bf-03f26df4f1cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0234f0dd16f499a827cd0ec912aa8a5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:36.799645 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4ea9409e-331c-43e0-b2bf-03f26df4f1cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0234f0dd16f499a827cd0ec912aa8a5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:36.806092 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4ea9409e-331c-43e0-b2bf-03f26df4f1cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0234f0dd16f499a827cd0ec912aa8a5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:36.806848 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.notifications [None req-4ea9409e-331c-43e0-b2bf-03f26df4f1cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0234f0dd16f499a827cd0ec912aa8a5'} {{(pid=79925) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:36.818617 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1420/2887] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 14:13:36 2022] DELETE /identity/v3/users/d0234f0dd16f499a827cd0ec912aa8a5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:13:36.985059 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1775c8-950b-434a-917f-c5a9c82e5150 admin admin] Authenticating user token {{(pid=79924) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:13:36.986553 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.fernet_utils [None req-9b1775c8-950b-434a-917f-c5a9c82e5150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79924) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:13:37.001317 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1775c8-950b-434a-917f-c5a9c82e5150 admin admin] Validating token access rules against request {{(pid=79924) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:13:37.057550 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178b380-8ce6-4bbe-936c-0d4fdc7c1d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfaa5ec258f44012bccce1e5ad959ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71179eb4635448dd8ef63856db24457f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79924) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:13:37.058410 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178b380-8ce6-4bbe-936c-0d4fdc7c1d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:13:37.058692 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178b380-8ce6-4bbe-936c-0d4fdc7c1d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:13:37.058968 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178b380-8ce6-4bbe-936c-0d4fdc7c1d2a admin admin] PATH_INFO: `/v3/projects/e8d60c3a227e4d0f9ee942520ce94f06` {{(pid=79924) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:13:37.060157 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178b380-8ce6-4bbe-936c-0d4fdc7c1d2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8d60c3a227e4d0f9ee942520ce94f06)` {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:13:37.062067 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178b380-8ce6-4bbe-936c-0d4fdc7c1d2a admin admin] RBAC: Authorization granted {{(pid=79924) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:13:37.105683 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-f178b380-8ce6-4bbe-936c-0d4fdc7c1d2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8d60c3a227e4d0f9ee942520ce94f06', 'request_id': 'req-f178b380-8ce6-4bbe-936c-0d4fdc7c1d2a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:37.112353 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-f178b380-8ce6-4bbe-936c-0d4fdc7c1d2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8d60c3a227e4d0f9ee942520ce94f06', 'request_id': 'req-f178b380-8ce6-4bbe-936c-0d4fdc7c1d2a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:37.117663 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-f178b380-8ce6-4bbe-936c-0d4fdc7c1d2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8d60c3a227e4d0f9ee942520ce94f06', 'request_id': 'req-f178b380-8ce6-4bbe-936c-0d4fdc7c1d2a'} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:37.128214 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-f178b380-8ce6-4bbe-936c-0d4fdc7c1d2a admin admin] The token cache is being invalidate because project e8d60c3a227e4d0f9ee942520ce94f06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79924) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 14:13:37.128503 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-f178b380-8ce6-4bbe-936c-0d4fdc7c1d2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:37.129138 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: DEBUG keystone.notifications [None req-f178b380-8ce6-4bbe-936c-0d4fdc7c1d2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79924) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 14:13:37.131216 dv-cinder-840678-6-iscsi devstack@keystone.service[79924]: [pid: 79924|app: 0|req: 1468/2888] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 14:13:36 2022] DELETE /identity/v3/projects/e8d60c3a227e4d0f9ee942520ce94f06 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 14:18:09.641478 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9409e-331c-43e0-b2bf-03f26df4f1cb admin admin] Authenticating user token {{(pid=79925) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 14:18:09.643140 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-4ea9409e-331c-43e0-b2bf-03f26df4f1cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:18:09.709587 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9409e-331c-43e0-b2bf-03f26df4f1cb admin admin] Validating token access rules against request {{(pid=79925) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 14:18:09.765668 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d900e2-9e7f-415d-9e59-80cf4cceaa1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8a29487b009419dbead4684bcd01cae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9613de9a3bc9461d9d348e5b66b8d684', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79925) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 14:18:09.766311 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d900e2-9e7f-415d-9e59-80cf4cceaa1e service placement] REQUEST_METHOD: `GET` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 14:18:09.766594 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d900e2-9e7f-415d-9e59-80cf4cceaa1e service placement] SCRIPT_NAME: `/identity` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 14:18:09.766875 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d900e2-9e7f-415d-9e59-80cf4cceaa1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79925) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 14:18:09.768920 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.fernet_utils [None req-36d900e2-9e7f-415d-9e59-80cf4cceaa1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79925) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 14:18:09.779753 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d900e2-9e7f-415d-9e59-80cf4cceaa1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 14:18:09.781348 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d900e2-9e7f-415d-9e59-80cf4cceaa1e service placement] RBAC: Authorization granted {{(pid=79925) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 14:18:09.791466 dv-cinder-840678-6-iscsi devstack@keystone.service[79925]: [pid: 79925|app: 0|req: 1421/2889] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 14:18:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)